Sep 17 17:29:18.306037 ip-10-0-131-245 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 17:29:18.306049 ip-10-0-131-245 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 17:29:18.306055 ip-10-0-131-245 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 17:29:18.306201 ip-10-0-131-245 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 17:29:28.444314 ip-10-0-131-245 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 17:29:28.444334 ip-10-0-131-245 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e3806cbe2c0b4da5a7fb59ff89b09ae9 --
Sep 17 17:31:11.884984 ip-10-0-131-245 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 17:31:15.425464 ip-10-0-131-245 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:31:15.425464 ip-10-0-131-245 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 17:31:15.425464 ip-10-0-131-245 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:31:15.425464 ip-10-0-131-245 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 17:31:15.425464 ip-10-0-131-245 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:31:15.426320 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.425553    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 17:31:15.429093 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429077    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:15.429093 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429092    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429096    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429099    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429102    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429105    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429108    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429111    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429114    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429116    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429119    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429122    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429124    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429127    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429130    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429132    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429135    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429137    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429140    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429143    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429145    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:15.429162 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429148    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429151    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429153    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429155    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429158    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429161    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429168    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429172    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429174    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429177    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429180    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429182    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429185    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429187    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429190    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429194    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429198    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429201    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429204    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:15.429636 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429206    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429210    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429214    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429217    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429220    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429223    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429227    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429230    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429233    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429235    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429238    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429240    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429243    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429246    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429248    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429252    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429255    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429258    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429260    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:15.430118 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429263    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429265    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429268    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429271    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429274    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429276    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429279    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429282    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429284    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429287    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429289    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429292    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429296    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429300    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429303    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429306    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429308    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429311    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429315    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:15.430584 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429318    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429320    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429322    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429325    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429328    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429356    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429360    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429363    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429366    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429369    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429372    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429375    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429378    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429380    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429383    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429385    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429388    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429391    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429394    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429396    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:15.431068 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.429399    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430097    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430104    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430107    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430109    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430112    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430116    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430119    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430121    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430125    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430128    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430131    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430134    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430137    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430140    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430142    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430145    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430148    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430150    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430153    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:15.431577 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430156    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430159    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430162    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430165    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430167    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430171    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430173    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430176    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430179    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430182    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430184    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430187    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430189    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430192    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430194    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430197    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430200    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430202    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430213    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430216    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:15.432101 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430219    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430222    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430225    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430228    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430230    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430234    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430236    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430239    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430242    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430245    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430248    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430251    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430254    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430257    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430260    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430263    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430266    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430269    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430272    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430274    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:15.432582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430277    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430279    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430282    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430284    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430287    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430289    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430292    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430295    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430297    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430302    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430307    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430312    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430315    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430318    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430320    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430323    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430325    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430328    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430334    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:15.433081 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430337    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430339    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430342    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430345    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430347    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430353    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430356    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430359    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430362    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430366    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430370    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430373    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430376    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430380    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430383    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430386    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430389    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430392    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430394    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:15.433545 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430397    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430400    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430781    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430787    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430790    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430792    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430795    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430798    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430801    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430803    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430806    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430809    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430812    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430814    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430817    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430820    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430823    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430825    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430829    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430832    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:15.434014 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430835    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430838    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430841    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430844    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430847    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430850    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430853    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430856    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430858    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430861    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430864    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430866    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430868    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430871    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430874    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430878    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430882    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430885    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430887    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:15.434502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430890    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430893    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430895    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430898    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430900    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430903    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430906    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430908    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430911    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430913    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430916    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430920    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430923    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430925    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430928    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430931    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430933    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430936    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430938    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430941    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:15.434976 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430944    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430947    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430949    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430952    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430954    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430957    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430960    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430962    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430965    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430968    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430970    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430973    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430975    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430978    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430980    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430982    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430985    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430988    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430991    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430994    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:15.435462 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.430997    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431000    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431003    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431009    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431013    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431016    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431019    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431023    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431026    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431029    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431031    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431034    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431036    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431039    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431042    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431044    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431047    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431049    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431052    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:15.435971 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431054    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431057    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431059    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431126    2563 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431159    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431164    2563 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431169    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431173    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431177    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431181    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431185    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431188    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431191    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431195    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431199    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431202    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431206    2563 flags.go:64] FLAG: --cgroup-root=""
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431209    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431212    2563 flags.go:64] FLAG: --client-ca-file=""
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431215    2563 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431219    2563 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431223    2563 flags.go:64] FLAG: --cluster-domain=""
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431226    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431229    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 17:31:15.436469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431232    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431235    2563 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431239    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431242    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431245    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431249    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431252    2563 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431254    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431258    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431261    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431264    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431268    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431271    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431273    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431276    2563 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431279    2563 flags.go:64] FLAG: --enable-server="true"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431282    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431286    2563 flags.go:64] FLAG: --event-burst="100"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431289    2563 flags.go:64] FLAG: --event-qps="50"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431292    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431295    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431298    2563 flags.go:64] FLAG: --eviction-hard=""
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431303    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431306    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431309    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 17:31:15.437123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431312    2563 flags.go:64] FLAG: --eviction-soft=""
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431315    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431318    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431322    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431326    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431328    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431331    2563 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431335    2563 flags.go:64] FLAG: --feature-gates=""
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431338    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431341    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431344    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431347    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431350    2563 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431353    2563 flags.go:64] FLAG: --help="false"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431356    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431359    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431362    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431365    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431368    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431372    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431375    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431377    2563 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431380    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 17:31:15.437733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431383    2563 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431386    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431389    2563 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431392    2563 flags.go:64] FLAG: --kube-reserved=""
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431396    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431398    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431402    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431405    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431408    2563 flags.go:64] FLAG: --lock-file=""
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431411    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431414    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431417    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431429    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431431    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431434    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431437    2563 flags.go:64] FLAG: --logging-format="text"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431440    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431443    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431446    2563 flags.go:64] FLAG: --manifest-url=""
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431450    2563 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431454    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431457    2563 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431461    2563 flags.go:64] FLAG: --max-pods="110"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431464    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431467    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 17:31:15.438326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431469    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431472    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431475    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431478    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431481    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431490    2563 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431493    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431496    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431499    2563 flags.go:64] FLAG: --pod-cidr=""
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431502    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431507    2563 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431510    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431513    2563 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431516    2563 flags.go:64] FLAG: --port="10250"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431519    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431522    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cfcc8209c3a04d4d"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431526    2563 flags.go:64] FLAG: --qos-reserved=""
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431528    2563 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431531    2563 flags.go:64] FLAG: --register-node="true"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431536    2563 flags.go:64] FLAG: --register-with-taints=""
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431539    2563 flags.go:64] FLAG: --registry-burst="10"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431542    2563 flags.go:64] FLAG: --registry-qps="5"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431545    2563 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431548    2563 flags.go:64] FLAG: --reserved-memory=""
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431551    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 17:31:15.438967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431554    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431557    2563 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431560    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431563    2563 flags.go:64] FLAG: --runonce="false"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431565    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431568    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431571    2563 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431574    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431577    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431580    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431583    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431586    2563 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431589    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431592    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431595    2563 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431598    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431601    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431604    2563 flags.go:64] FLAG: --system-cgroups=""
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431608    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431613    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431616    2563 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431618    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431623    2563 flags.go:64] FLAG: --tls-min-version=""
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431626    2563 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431629    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 17:31:15.439589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431632    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431636    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431640    2563 flags.go:64] FLAG: --v="2"
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431643    2563 flags.go:64] FLAG: --version="false"
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431647    2563 flags.go:64] FLAG: --vmodule=""
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431651    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.431654    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431783    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431789    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431792    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431796    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431799    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431802    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431805    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431808    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431811    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431814    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431816    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431819    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431822    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431825    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:15.440240 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431828    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431830    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431833    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431836    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431840    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431844    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431847    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431850    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431853    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431856    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431859    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431862    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431866    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431869    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431873    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431877    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431881    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431885    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431888    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:15.440751 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431891    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431895    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431899    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431902    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431905    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431907    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431910    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431913    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431915    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431918    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431920    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431923    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431926    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431928    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431931    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431933    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431936    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431940    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431942    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:15.441224 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431945    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431947    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431950    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431953    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431955    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431959    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431963    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431965    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431968    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431970    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431973    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431976    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431978    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431981    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431984    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431986    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431989    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431992    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431995    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.431997    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:15.441695 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432000    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432002    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432005    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432008    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432011    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432013    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432016    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432018    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432021    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432024    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432027    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432030    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432033    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432035    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432038    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432040    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432043    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432045    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432050    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432053    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:15.442195 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432055    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432058    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432061    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432063    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432066    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432068    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.432071    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.432927    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.440441    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.440455    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.440474    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.440483    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440536    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440541    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440544    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:15.442765 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440548    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440551    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440554    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440557    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440560    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440563    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440565    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440570    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440574    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440578    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440581    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440584    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440586    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440589    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440592    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440596    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440599    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440602    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440605    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440607    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:15.443145 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440610    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440612    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440615    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440618    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440620    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440623    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440626    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440628    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440631    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440633    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440636    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440639    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440643    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440646    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440649    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440653    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440656    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440659    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440662    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:15.443666 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440665    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440668    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440671    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440674    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440677    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440680    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440682    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440685    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440688    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440691    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440694    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440696    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440716    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440719    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440722    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440725    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440727    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440730    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440733    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440736    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:15.444137 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440738    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440741    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440744    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440747    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440749    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440752    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440755    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440758    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440762    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440765    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440769    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440772    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440775    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440777    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440780    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440783    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440785    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440788    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440791    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440794    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:15.444618 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440796    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440799    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440803    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440805    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440808    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440811    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440813    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440816    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440818    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440821    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440823    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440826    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440828    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440831    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440834    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440836    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:15.445120 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440839    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.440843    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440955    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440959    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440963    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440966    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440969    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440972    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440974    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440977    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440981    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440984    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440987    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440989    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:15.445502 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440992    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440994    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.440997    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441000    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441002    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441006    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441008    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441011    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441013    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441016    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441018    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441021    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441024    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441026    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441029    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441032    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441034    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441037    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441039    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441042    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:15.445857 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441045    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441047    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441050    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441054    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441057    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441060    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441063    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441065    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441068    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441071    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441074    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441076    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441079    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441081    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441084    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441087    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441089    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441094    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441097    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441099    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:15.446344 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441102    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441104    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441107    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441110    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441112    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441114    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441117    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441120    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441122    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441125    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441128    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441130    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441133    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441135    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441138    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441140    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441144    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441148    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441150    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:15.446855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441153    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441155    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441158    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441161    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441163    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441166    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441169    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441171    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441174    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441176    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441180    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441183    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441186    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441189    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441191    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441194    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441197    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441199    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441202    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441204    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:15.447324 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441207    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441210    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441212    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441215    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441218    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441222    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441225    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:15.441228    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.441233    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.441331    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.443316    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.444128    2563 server.go:1019] "Starting client certificate rotation"
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.444229    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 17:31:15.448021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.444271    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 17:31:15.448535 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.446400    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 17:31:15.449661 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.449641    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 17:31:15.456561 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.456544    2563 log.go:25] "Validated CRI v1 runtime API"
Sep 17 17:31:15.458121 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.458105    2563 log.go:25] "Validated CRI v1 image API"
Sep 17 17:31:15.459559 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.459542    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 17:31:15.462604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.462583    2563 fs.go:135] Filesystem UUIDs: map[70a530df-23c2-4bd8-ae0a-62b9d396ca98:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8fc6b3ef-f14f-49ac-b5b5-061d8b0baf56:/dev/nvme0n1p4]
Sep 17 17:31:15.462677 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.462603    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 17:31:15.466861 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.466755    2563 manager.go:216] Machine: {Timestamp:2026-09-17 17:31:15.466276947 +0000 UTC m=+2.117182931 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095862 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b7020abf30b0f9c18c785a8ec6972 SystemUUID:ec2b7020-abf3-0b0f-9c18-c785a8ec6972 BootID:e3806cbe-2c0b-4da5-a7fb-59ff89b09ae9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:db:13:d8:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:db:13:d8:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:1e:cc:68:f0:b8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 17:31:15.466861 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.466858    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 17:31:15.466967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.466935    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 17:31:15.468413 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.468390    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 17:31:15.468583 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.468416    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-245.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 17:31:15.469660 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.469648    2563 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 17:31:15.469731 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.469672    2563 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 17:31:15.469731 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.469683    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 17:31:15.469731 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.469713    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 17:31:15.469924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.469803    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 17:31:15.473464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.473449    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 17:31:15.473599 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.473588    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 17:31:15.473655 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.473631    2563 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 17:31:15.473655 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.473645    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 17:31:15.473777 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.473661    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 17:31:15.473777 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.473677    2563 kubelet.go:398] "Adding apiserver pod source"
Sep 17 17:31:15.473777 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.473689    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 17:31:15.474599 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.474585    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 17:31:15.474666 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.474619    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 17:31:15.477999 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.477984    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 17:31:15.480023 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.480009    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 17:31:15.480091 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.480040    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 17:31:15.481009 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.480997    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 17:31:15.481049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481014    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 17:31:15.481049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481021    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 17:31:15.481049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481026    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 17:31:15.481049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481034    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 17:31:15.481049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481039    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 17:31:15.481176 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481052    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 17:31:15.481176 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481058    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 17:31:15.481176 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481064    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 17:31:15.481176 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481069    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 17:31:15.481176 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481078    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 17:31:15.481176 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481083    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 17:31:15.481176 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481108    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 17:31:15.481176 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.481113    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 17:31:15.492211 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.492190    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 17:31:15.492868 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.492857    2563 server.go:1268] "Started kubelet"
Sep 17 17:31:15.492979 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.492941    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 17:31:15.493044 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.492948    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 17:31:15.493044 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.493020    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 17:31:15.493664 ip-10-0-131-245 systemd[1]: Started Kubernetes Kubelet.
Sep 17 17:31:15.494183 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.494109    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 17:31:15.494251 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.494216    2563 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 17:31:15.497476 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.497441    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 17:31:15.497655 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.497640    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-245.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 17:31:15.497747 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.497726    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 17:31:15.497821 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.497802    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 17:31:15.499660 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.499645    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 17:31:15.499660 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.499654    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 17:31:15.499779 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.499745    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:15.500276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500180    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 17:31:15.500276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500206    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 17:31:15.500276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500217    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 17:31:15.500461 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500297    2563 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 17:31:15.500461 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500309    2563 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 17:31:15.500543 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500530    2563 factory.go:55] Registering systemd factory
Sep 17 17:31:15.500589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500550    2563 factory.go:223] Registration of the systemd container factory successfully
Sep 17 17:31:15.500774 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500762    2563 factory.go:153] Registering CRI-O factory
Sep 17 17:31:15.500822 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500778    2563 factory.go:223] Registration of the crio container factory successfully
Sep 17 17:31:15.500857 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500830    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 17:31:15.500857 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500849    2563 factory.go:103] Registering Raw factory
Sep 17 17:31:15.500964 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.500868    2563 manager.go:1196] Started watching for new ooms in manager
Sep 17 17:31:15.501322 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.501310    2563 manager.go:349] Starting recovery of all containers
Sep 17 17:31:15.512929 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.512907    2563 manager.go:354] Recovery completed
Sep 17 17:31:15.513769 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.513745    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 17:31:15.513769 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.513741    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 17:31:15.525120 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.525103    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:15.527594 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.527569    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:15.527678 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.527609    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:15.527678 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.527622    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:15.528217 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.528199    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 17:31:15.528217 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.528209    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:15.528217 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.528215    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 17:31:15.528375 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.528234    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 17:31:15.529501 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.529489    2563 policy_none.go:49] "None policy: Start"
Sep 17 17:31:15.529544 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.529505    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 17:31:15.529544 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.529514    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 17:31:15.530341 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.530322    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:15.530411 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.530350    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:15.530411 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.530361    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:15.530663 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.530647    2563 policy_none.go:47] "Start"
Sep 17 17:31:15.535426 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.535412    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-87mts"
Sep 17 17:31:15.538169 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.537323    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-245.ec2.internal.18d62bfed93ef5a7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-245.ec2.internal,UID:ip-10-0-131-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-245.ec2.internal,},FirstTimestamp:2026-09-17 17:31:15.492820391 +0000 UTC m=+2.143726421,LastTimestamp:2026-09-17 17:31:15.492820391 +0000 UTC m=+2.143726421,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-245.ec2.internal,}"
Sep 17 17:31:15.545030 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.545008    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-87mts"
Sep 17 17:31:15.547590 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.547529    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-245.ec2.internal.18d62bfedb5191db  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-245.ec2.internal,UID:ip-10-0-131-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-245.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-245.ec2.internal,},FirstTimestamp:2026-09-17 17:31:15.527594459 +0000 UTC m=+2.178500442,LastTimestamp:2026-09-17 17:31:15.527594459 +0000 UTC m=+2.178500442,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-245.ec2.internal,}"
Sep 17 17:31:15.550779 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.550694    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-245.ec2.internal.18d62bfedb51e7e7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-245.ec2.internal,UID:ip-10-0-131-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-245.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-245.ec2.internal,},FirstTimestamp:2026-09-17 17:31:15.527616487 +0000 UTC m=+2.178522470,LastTimestamp:2026-09-17 17:31:15.527616487 +0000 UTC m=+2.178522470,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-245.ec2.internal,}"
Sep 17 17:31:15.572284 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.572269    2563 manager.go:337] "Starting Device Plugin manager"
Sep 17 17:31:15.572384 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.572319    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 17:31:15.572384 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.572333    2563 server.go:87] "Starting device plugin registration server"
Sep 17 17:31:15.572607 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.572594    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 17:31:15.572666 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.572610    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 17:31:15.572729 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.572718    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 17:31:15.572819 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.572792    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 17:31:15.572819 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.572804    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 17:31:15.573355 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.573331    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 17:31:15.573446 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.573391    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:15.606042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.606018    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 17:31:15.607188 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.607167    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 17:31:15.607301 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.607224    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 17:31:15.607301 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.607254    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 17:31:15.607416 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.607300    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 17:31:15.616033 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.616014    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:31:15.673190 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.673160    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:15.674171 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.674138    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:15.674273 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.674177    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:15.674273 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.674189    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:15.674273 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.674221    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.683101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.683058    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.683101 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.683080    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-245.ec2.internal\": node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:15.707579 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.707547    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-245.ec2.internal"]
Sep 17 17:31:15.707673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.707633    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:15.709579 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.709564    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:15.709652 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.709589    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:15.709652 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.709598    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:15.710874 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.710862    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:15.711007 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.710993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.711043 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.711021    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:15.711525 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.711509    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:15.711603 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.711524    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:15.711603 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.711535    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:15.711603 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.711547    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:15.711603 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.711548    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:15.711778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.711640    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:15.712654 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.712639    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.712730 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.712662    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:15.713315 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.713291    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:15.713405 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.713324    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:15.713405 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.713340    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:15.713493 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.713450    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:15.730204 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.730183    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-245.ec2.internal\" not found" node="ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.733487 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.733473    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-245.ec2.internal\" not found" node="ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.801542 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.801516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cce695a621161a79a3b2cd8ae46e7e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal\" (UID: \"cce695a621161a79a3b2cd8ae46e7e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.801647 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.801549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cce695a621161a79a3b2cd8ae46e7e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal\" (UID: \"cce695a621161a79a3b2cd8ae46e7e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.801647 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.801567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/254195a29b049715cb5595a99d80b7be-config\") pod \"kube-apiserver-proxy-ip-10-0-131-245.ec2.internal\" (UID: \"254195a29b049715cb5595a99d80b7be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.813559 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.813534    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:15.902155 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.902130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cce695a621161a79a3b2cd8ae46e7e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal\" (UID: \"cce695a621161a79a3b2cd8ae46e7e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.902244 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.902157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cce695a621161a79a3b2cd8ae46e7e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal\" (UID: \"cce695a621161a79a3b2cd8ae46e7e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.902244 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.902174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/254195a29b049715cb5595a99d80b7be-config\") pod \"kube-apiserver-proxy-ip-10-0-131-245.ec2.internal\" (UID: \"254195a29b049715cb5595a99d80b7be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.902244 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.902231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cce695a621161a79a3b2cd8ae46e7e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal\" (UID: \"cce695a621161a79a3b2cd8ae46e7e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.902342 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.902231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/254195a29b049715cb5595a99d80b7be-config\") pod \"kube-apiserver-proxy-ip-10-0-131-245.ec2.internal\" (UID: \"254195a29b049715cb5595a99d80b7be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.902342 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:15.902258    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cce695a621161a79a3b2cd8ae46e7e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal\" (UID: \"cce695a621161a79a3b2cd8ae46e7e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:15.914276 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:15.914236    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:16.014428 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:16.014353    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:16.035525 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.035497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:16.037652 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.037638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:16.115005 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:16.114972    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:16.215509 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:16.215485    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:16.315988 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:16.315959    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:16.416539 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:16.416507    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:16.443643 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.443607    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 17:31:16.444080 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.443770    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 17:31:16.517173 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:16.517151    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:16.545852 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.545719    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:16.547264 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.547249    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:16.547356 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.547282    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:16.547356 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.547298    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:16.549406 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.549377    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 17:26:15 +0000 UTC" deadline="2028-03-30 17:50:21.833933529 +0000 UTC"
Sep 17 17:31:16.549406 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.549404    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13440h19m5.284532618s"
Sep 17 17:31:16.617482 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:16.617423    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-245.ec2.internal\" not found"
Sep 17 17:31:16.705310 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:16.705265    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254195a29b049715cb5595a99d80b7be.slice/crio-c410faddabd457fed03179884060fd99ab964872dbbd39eed8c42001807bcc2e WatchSource:0}: Error finding container c410faddabd457fed03179884060fd99ab964872dbbd39eed8c42001807bcc2e: Status 404 returned error can't find the container with id c410faddabd457fed03179884060fd99ab964872dbbd39eed8c42001807bcc2e
Sep 17 17:31:16.705727 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:16.705711    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce695a621161a79a3b2cd8ae46e7e0c.slice/crio-f527016336253f441b73bdfa84f5601a55a0307ad1c0c07e7903736328f8007e WatchSource:0}: Error finding container f527016336253f441b73bdfa84f5601a55a0307ad1c0c07e7903736328f8007e: Status 404 returned error can't find the container with id f527016336253f441b73bdfa84f5601a55a0307ad1c0c07e7903736328f8007e
Sep 17 17:31:16.708001 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.707983    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:31:16.710454 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.710441    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:31:16.799878 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.799849    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:16.815284 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.815265    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 17:31:16.816895 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.816883    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-245.ec2.internal"
Sep 17 17:31:16.832800 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.832778    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 17:31:16.889846 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.889788    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:31:16.966083 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:16.966055    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:31:17.474874 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.474834    2563 apiserver.go:52] "Watching apiserver"
Sep 17 17:31:17.482368 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.482340    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 17:31:17.482980 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.482947    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5fvs6","kube-system/konnectivity-agent-t5gp8","kube-system/kube-apiserver-proxy-ip-10-0-131-245.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw","openshift-cluster-node-tuning-operator/tuned-7mhbt","openshift-dns/node-resolver-8dcd2","openshift-image-registry/node-ca-96rtm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal","openshift-multus/multus-additional-cni-plugins-6t8mv","openshift-multus/multus-qzxbl","openshift-multus/network-metrics-daemon-xhm5z","openshift-network-diagnostics/network-check-target-zmnd2","openshift-network-operator/iptables-alerter-pz4f5","openshift-ovn-kubernetes/ovnkube-node-g2fxq"]
Sep 17 17:31:17.485479 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.485455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-96rtm"
Sep 17 17:31:17.485959 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.485934    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:31:17.487651 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.487634    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pz4f5"
Sep 17 17:31:17.487827 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.487809    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 17:31:17.488054 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.488039    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5m2wp\""
Sep 17 17:31:17.488236 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.488223    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 17:31:17.488741 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.488720    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 17:31:17.490030 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.490011    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.491821 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.490887    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:31:17.491821 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.491021    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 17:31:17.491821 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.491278    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v8vpq\""
Sep 17 17:31:17.491821 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.491417    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 17:31:17.492157 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.492137    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 17:31:17.492360 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.492343    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 17:31:17.492430 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.492400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.492625 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.492607    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 17:31:17.492893 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.492874    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 17:31:17.493331 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.493116    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r767r\""
Sep 17 17:31:17.493331 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.493127    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 17:31:17.493475 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.493435    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 17:31:17.495238 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.494963    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 17:31:17.495238 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.495013    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 17:31:17.495238 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.495166    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.495943 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.495729    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kjffg\""
Sep 17 17:31:17.495943 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.495758    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 17:31:17.496972 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.496954    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8dcd2"
Sep 17 17:31:17.499094 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.499076    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 17:31:17.501521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.499398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.501521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.499777    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 17:31:17.501521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.499867    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hk6h6\""
Sep 17 17:31:17.501521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.499979    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tkjl5\""
Sep 17 17:31:17.501521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.500209    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:31:17.501521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.500658    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 17:31:17.501521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.500879    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 17:31:17.501936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.501915    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:17.502036 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:17.501985    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:17.504278 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.504041    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:17.506688 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.506491    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.507320 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.507098    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 17:31:17.507320 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.507110    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 17:31:17.507320 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.507247    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qbmlk\""
Sep 17 17:31:17.509859 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.509838    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.510661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72664012-dccc-49e5-b790-333fd5db999f-serviceca\") pod \"node-ca-96rtm\" (UID: \"72664012-dccc-49e5-b790-333fd5db999f\") " pod="openshift-image-registry/node-ca-96rtm"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.510713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlvx6\" (UniqueName: \"kubernetes.io/projected/4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585-kube-api-access-nlvx6\") pod \"iptables-alerter-pz4f5\" (UID: \"4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585\") " pod="openshift-network-operator/iptables-alerter-pz4f5"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.510749    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-var-lib-openvswitch\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.510777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-node-log\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.510810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-log-socket\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.510853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a716c236-02eb-4a29-8500-b99f47fb2abe-env-overrides\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.510891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-run-ovn\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.510931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-registration-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-sys-fs\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45dcbf30-6c5f-44a5-a37c-74825385a0de-tmp-dir\") pod \"node-resolver-8dcd2\" (UID: \"45dcbf30-6c5f-44a5-a37c-74825385a0de\") " pod="openshift-dns/node-resolver-8dcd2"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc8c4\" (UniqueName: \"kubernetes.io/projected/45dcbf30-6c5f-44a5-a37c-74825385a0de-kube-api-access-gc8c4\") pod \"node-resolver-8dcd2\" (UID: \"45dcbf30-6c5f-44a5-a37c-74825385a0de\") " pod="openshift-dns/node-resolver-8dcd2"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fe498d7-a0fc-4320-8898-5f3161cf97f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72664012-dccc-49e5-b790-333fd5db999f-host\") pod \"node-ca-96rtm\" (UID: \"72664012-dccc-49e5-b790-333fd5db999f\") " pod="openshift-image-registry/node-ca-96rtm"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-etc-openvswitch\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585-host-slash\") pod \"iptables-alerter-pz4f5\" (UID: \"4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585\") " pod="openshift-network-operator/iptables-alerter-pz4f5"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511315    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a716c236-02eb-4a29-8500-b99f47fb2abe-ovnkube-config\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-run\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511382    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-systemd-units\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-slash\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-sys\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-var-lib-kubelet\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-kubelet\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4b01303-d780-42cb-8919-f006e713fd5a-etc-tuned\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-run-netns\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-socket-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-sysctl-d\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511735    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-run-ovn-kubernetes\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-cni-bin\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zr89\" (UniqueName: \"kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89\") pod \"network-check-target-zmnd2\" (UID: \"cd07b5db-1573-4198-bc08-54d45e2ed720\") " pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-sysconfig\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.514996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-sysctl-conf\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fe498d7-a0fc-4320-8898-5f3161cf97f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.511992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-host\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512034    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fe498d7-a0fc-4320-8898-5f3161cf97f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-849jd\" (UniqueName: \"kubernetes.io/projected/5fe498d7-a0fc-4320-8898-5f3161cf97f0-kube-api-access-849jd\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585-iptables-alerter-script\") pod \"iptables-alerter-pz4f5\" (UID: \"4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585\") " pod="openshift-network-operator/iptables-alerter-pz4f5"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-device-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-kubernetes\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksmn7\" (UniqueName: \"kubernetes.io/projected/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-kube-api-access-ksmn7\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-modprobe-d\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fe498d7-a0fc-4320-8898-5f3161cf97f0-cnibin\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vhjf\" (UniqueName: \"kubernetes.io/projected/72664012-dccc-49e5-b790-333fd5db999f-kube-api-access-2vhjf\") pod \"node-ca-96rtm\" (UID: \"72664012-dccc-49e5-b790-333fd5db999f\") " pod="openshift-image-registry/node-ca-96rtm"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-cni-netd\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8wqp\" (UniqueName: \"kubernetes.io/projected/a716c236-02eb-4a29-8500-b99f47fb2abe-kube-api-access-f8wqp\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.515760 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-systemd\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fe498d7-a0fc-4320-8898-5f3161cf97f0-system-cni-dir\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fe498d7-a0fc-4320-8898-5f3161cf97f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a716c236-02eb-4a29-8500-b99f47fb2abe-ovnkube-script-lib\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45dcbf30-6c5f-44a5-a37c-74825385a0de-hosts-file\") pod \"node-resolver-8dcd2\" (UID: \"45dcbf30-6c5f-44a5-a37c-74825385a0de\") " pod="openshift-dns/node-resolver-8dcd2"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4b01303-d780-42cb-8919-f006e713fd5a-tmp\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-run-systemd\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-run-openvswitch\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a716c236-02eb-4a29-8500-b99f47fb2abe-ovn-node-metrics-cert\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-lib-modules\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.512892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp6pk\" (UniqueName: \"kubernetes.io/projected/b4b01303-d780-42cb-8919-f006e713fd5a-kube-api-access-pp6pk\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.514082    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:17.514164    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.514621    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.514874    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.515087    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.515424    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bjgfm\""
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.515643    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.515913    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 17:31:17.516456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.516142    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bm94f\""
Sep 17 17:31:17.519889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.519867    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:17.519980 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:17.519931    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:17.527131 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.527103    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 17:31:17.552890 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.552863    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-btczs"
Sep 17 17:31:17.562040 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.562013    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-btczs"
Sep 17 17:31:17.601478 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.601435    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 17:31:17.612754 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.612679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-245.ec2.internal" event={"ID":"254195a29b049715cb5595a99d80b7be","Type":"ContainerStarted","Data":"c410faddabd457fed03179884060fd99ab964872dbbd39eed8c42001807bcc2e"}
Sep 17 17:31:17.613065 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-lib-modules\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.613156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp6pk\" (UniqueName: \"kubernetes.io/projected/b4b01303-d780-42cb-8919-f006e713fd5a-kube-api-access-pp6pk\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.613156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:17.613156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72664012-dccc-49e5-b790-333fd5db999f-serviceca\") pod \"node-ca-96rtm\" (UID: \"72664012-dccc-49e5-b790-333fd5db999f\") " pod="openshift-image-registry/node-ca-96rtm"
Sep 17 17:31:17.613306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlvx6\" (UniqueName: \"kubernetes.io/projected/4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585-kube-api-access-nlvx6\") pod \"iptables-alerter-pz4f5\" (UID: \"4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585\") " pod="openshift-network-operator/iptables-alerter-pz4f5"
Sep 17 17:31:17.613306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-var-lib-openvswitch\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.613306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-node-log\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.613306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613241    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-log-socket\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.613306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a716c236-02eb-4a29-8500-b99f47fb2abe-env-overrides\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.613306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-run-ovn\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-registration-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-sys-fs\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45dcbf30-6c5f-44a5-a37c-74825385a0de-tmp-dir\") pod \"node-resolver-8dcd2\" (UID: \"45dcbf30-6c5f-44a5-a37c-74825385a0de\") " pod="openshift-dns/node-resolver-8dcd2"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc8c4\" (UniqueName: \"kubernetes.io/projected/45dcbf30-6c5f-44a5-a37c-74825385a0de-kube-api-access-gc8c4\") pod \"node-resolver-8dcd2\" (UID: \"45dcbf30-6c5f-44a5-a37c-74825385a0de\") " pod="openshift-dns/node-resolver-8dcd2"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fe498d7-a0fc-4320-8898-5f3161cf97f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-var-lib-cni-bin\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72664012-dccc-49e5-b790-333fd5db999f-host\") pod \"node-ca-96rtm\" (UID: \"72664012-dccc-49e5-b790-333fd5db999f\") " pod="openshift-image-registry/node-ca-96rtm"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-etc-openvswitch\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-run-multus-certs\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/124f3ca2-a7c1-4341-9057-cbdee0290438-dbus\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585-host-slash\") pod \"iptables-alerter-pz4f5\" (UID: \"4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585\") " pod="openshift-network-operator/iptables-alerter-pz4f5"
Sep 17 17:31:17.613576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a716c236-02eb-4a29-8500-b99f47fb2abe-ovnkube-config\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613586    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-run\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-systemd-units\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-slash\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-sys\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-var-lib-kubelet\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-run-k8s-cni-cncf-io\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/124f3ca2-a7c1-4341-9057-cbdee0290438-kubelet-config\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-kubelet\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4b01303-d780-42cb-8919-f006e713fd5a-etc-tuned\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7fe879ea-0463-4647-8190-5cb7552bb02f-konnectivity-ca\") pod \"konnectivity-agent-t5gp8\" (UID: \"7fe879ea-0463-4647-8190-5cb7552bb02f\") " pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-run-netns\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613835    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-socket-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-sysctl-d\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-run-netns\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-etc-kubernetes\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.614042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjr9z\" (UniqueName: \"kubernetes.io/projected/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-kube-api-access-hjr9z\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-run-ovn-kubernetes\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.613986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-cni-bin\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr89\" (UniqueName: \"kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89\") pod \"network-check-target-zmnd2\" (UID: \"cd07b5db-1573-4198-bc08-54d45e2ed720\") " pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-sysconfig\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-sysctl-conf\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fe498d7-a0fc-4320-8898-5f3161cf97f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-cni-dir\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-host\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fe498d7-a0fc-4320-8898-5f3161cf97f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-849jd\" (UniqueName: \"kubernetes.io/projected/5fe498d7-a0fc-4320-8898-5f3161cf97f0-kube-api-access-849jd\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-socket-dir-parent\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-var-lib-cni-multus\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-hostroot\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-conf-dir\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585-iptables-alerter-script\") pod \"iptables-alerter-pz4f5\" (UID: \"4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585\") " pod="openshift-network-operator/iptables-alerter-pz4f5"
Sep 17 17:31:17.614862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-device-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-kubernetes\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksmn7\" (UniqueName: \"kubernetes.io/projected/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-kube-api-access-ksmn7\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-modprobe-d\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fe498d7-a0fc-4320-8898-5f3161cf97f0-cnibin\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7fe879ea-0463-4647-8190-5cb7552bb02f-agent-certs\") pod \"konnectivity-agent-t5gp8\" (UID: \"7fe879ea-0463-4647-8190-5cb7552bb02f\") " pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-system-cni-dir\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-cni-binary-copy\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-daemon-config\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdst9\" (UniqueName: \"kubernetes.io/projected/adef32ee-aef3-4bdd-a6df-62f66b8b7466-kube-api-access-rdst9\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vhjf\" (UniqueName: \"kubernetes.io/projected/72664012-dccc-49e5-b790-333fd5db999f-kube-api-access-2vhjf\") pod \"node-ca-96rtm\" (UID: \"72664012-dccc-49e5-b790-333fd5db999f\") " pod="openshift-image-registry/node-ca-96rtm"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-cni-netd\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614685    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8wqp\" (UniqueName: \"kubernetes.io/projected/a716c236-02eb-4a29-8500-b99f47fb2abe-kube-api-access-f8wqp\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-systemd\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fe498d7-a0fc-4320-8898-5f3161cf97f0-system-cni-dir\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72664012-dccc-49e5-b790-333fd5db999f-host\") pod \"node-ca-96rtm\" (UID: \"72664012-dccc-49e5-b790-333fd5db999f\") " pod="openshift-image-registry/node-ca-96rtm"
Sep 17 17:31:17.615650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fe498d7-a0fc-4320-8898-5f3161cf97f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a716c236-02eb-4a29-8500-b99f47fb2abe-ovnkube-script-lib\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45dcbf30-6c5f-44a5-a37c-74825385a0de-hosts-file\") pod \"node-resolver-8dcd2\" (UID: \"45dcbf30-6c5f-44a5-a37c-74825385a0de\") " pod="openshift-dns/node-resolver-8dcd2"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4b01303-d780-42cb-8919-f006e713fd5a-tmp\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-cnibin\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.614973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-run-systemd\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-run-openvswitch\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a716c236-02eb-4a29-8500-b99f47fb2abe-ovn-node-metrics-cert\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-var-lib-kubelet\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-etc-openvswitch\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585-host-slash\") pod \"iptables-alerter-pz4f5\" (UID: \"4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585\") " pod="openshift-network-operator/iptables-alerter-pz4f5"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615238    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fe498d7-a0fc-4320-8898-5f3161cf97f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fe498d7-a0fc-4320-8898-5f3161cf97f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615388    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-socket-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-sysctl-d\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-run-ovn-kubernetes\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615608    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-cni-bin\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.616521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72664012-dccc-49e5-b790-333fd5db999f-serviceca\") pod \"node-ca-96rtm\" (UID: \"72664012-dccc-49e5-b790-333fd5db999f\") " pod="openshift-image-registry/node-ca-96rtm"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-run-netns\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-slash\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615767    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-systemd-units\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-var-lib-openvswitch\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-var-lib-kubelet\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-sysconfig\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-kubelet\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615955    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-sysctl-conf\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-node-log\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616157    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616320    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a716c236-02eb-4a29-8500-b99f47fb2abe-env-overrides\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-run-ovn\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-registration-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-sys-fs\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616503    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585-iptables-alerter-script\") pod \"iptables-alerter-pz4f5\" (UID: \"4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585\") " pod="openshift-network-operator/iptables-alerter-pz4f5"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45dcbf30-6c5f-44a5-a37c-74825385a0de-tmp-dir\") pod \"node-resolver-8dcd2\" (UID: \"45dcbf30-6c5f-44a5-a37c-74825385a0de\") " pod="openshift-dns/node-resolver-8dcd2"
Sep 17 17:31:17.617298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-lib-modules\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45dcbf30-6c5f-44a5-a37c-74825385a0de-hosts-file\") pod \"node-resolver-8dcd2\" (UID: \"45dcbf30-6c5f-44a5-a37c-74825385a0de\") " pod="openshift-dns/node-resolver-8dcd2"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-device-dir\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616852    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a716c236-02eb-4a29-8500-b99f47fb2abe-ovnkube-script-lib\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616918    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-host\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.615724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a716c236-02eb-4a29-8500-b99f47fb2abe-ovnkube-config\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616966    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-kubernetes\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.616989    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-sys\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617079    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-run\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617122    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-cni-netd\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617194    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-modprobe-d\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-run-systemd\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617264    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-log-socket\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617248    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fe498d7-a0fc-4320-8898-5f3161cf97f0-system-cni-dir\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617309    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4b01303-d780-42cb-8919-f006e713fd5a-etc-systemd\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fe498d7-a0fc-4320-8898-5f3161cf97f0-cnibin\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617556    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fe498d7-a0fc-4320-8898-5f3161cf97f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.618101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-run-openvswitch\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.618995 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a716c236-02eb-4a29-8500-b99f47fb2abe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.618995 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.617867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fe498d7-a0fc-4320-8898-5f3161cf97f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.618995 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.618262    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal" event={"ID":"cce695a621161a79a3b2cd8ae46e7e0c","Type":"ContainerStarted","Data":"f527016336253f441b73bdfa84f5601a55a0307ad1c0c07e7903736328f8007e"}
Sep 17 17:31:17.620959 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.620926    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4b01303-d780-42cb-8919-f006e713fd5a-tmp\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.621461 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.621431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a716c236-02eb-4a29-8500-b99f47fb2abe-ovn-node-metrics-cert\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.621649 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.621626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4b01303-d780-42cb-8919-f006e713fd5a-etc-tuned\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.624094 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:17.623098    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:17.624094 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:17.623122    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:17.624094 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:17.623132    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9zr89 for pod openshift-network-diagnostics/network-check-target-zmnd2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:17.624094 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:17.623212    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89 podName:cd07b5db-1573-4198-bc08-54d45e2ed720 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:18.123183621 +0000 UTC m=+4.774089613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9zr89" (UniqueName: "kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89") pod "network-check-target-zmnd2" (UID: "cd07b5db-1573-4198-bc08-54d45e2ed720") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:17.628689 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.628206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp6pk\" (UniqueName: \"kubernetes.io/projected/b4b01303-d780-42cb-8919-f006e713fd5a-kube-api-access-pp6pk\") pod \"tuned-7mhbt\" (UID: \"b4b01303-d780-42cb-8919-f006e713fd5a\") " pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.628689 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.628457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlvx6\" (UniqueName: \"kubernetes.io/projected/4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585-kube-api-access-nlvx6\") pod \"iptables-alerter-pz4f5\" (UID: \"4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585\") " pod="openshift-network-operator/iptables-alerter-pz4f5"
Sep 17 17:31:17.629716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.629258    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc8c4\" (UniqueName: \"kubernetes.io/projected/45dcbf30-6c5f-44a5-a37c-74825385a0de-kube-api-access-gc8c4\") pod \"node-resolver-8dcd2\" (UID: \"45dcbf30-6c5f-44a5-a37c-74825385a0de\") " pod="openshift-dns/node-resolver-8dcd2"
Sep 17 17:31:17.629716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.629659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-849jd\" (UniqueName: \"kubernetes.io/projected/5fe498d7-a0fc-4320-8898-5f3161cf97f0-kube-api-access-849jd\") pod \"multus-additional-cni-plugins-6t8mv\" (UID: \"5fe498d7-a0fc-4320-8898-5f3161cf97f0\") " pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.629970 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.629944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8wqp\" (UniqueName: \"kubernetes.io/projected/a716c236-02eb-4a29-8500-b99f47fb2abe-kube-api-access-f8wqp\") pod \"ovnkube-node-g2fxq\" (UID: \"a716c236-02eb-4a29-8500-b99f47fb2abe\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.631119 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.631078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksmn7\" (UniqueName: \"kubernetes.io/projected/8341b4db-17a6-4d39-9ac4-e2a0e6d69264-kube-api-access-ksmn7\") pod \"aws-ebs-csi-driver-node-r8nrw\" (UID: \"8341b4db-17a6-4d39-9ac4-e2a0e6d69264\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.632079 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.632025    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vhjf\" (UniqueName: \"kubernetes.io/projected/72664012-dccc-49e5-b790-333fd5db999f-kube-api-access-2vhjf\") pod \"node-ca-96rtm\" (UID: \"72664012-dccc-49e5-b790-333fd5db999f\") " pod="openshift-image-registry/node-ca-96rtm"
Sep 17 17:31:17.716066 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-var-lib-cni-bin\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.716066 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-run-multus-certs\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.716303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/124f3ca2-a7c1-4341-9057-cbdee0290438-dbus\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:17.716303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-var-lib-cni-bin\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.716303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-run-multus-certs\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.716303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716190    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-run-k8s-cni-cncf-io\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.716303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-run-k8s-cni-cncf-io\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.716303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716241    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/124f3ca2-a7c1-4341-9057-cbdee0290438-kubelet-config\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:17.716303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7fe879ea-0463-4647-8190-5cb7552bb02f-konnectivity-ca\") pod \"konnectivity-agent-t5gp8\" (UID: \"7fe879ea-0463-4647-8190-5cb7552bb02f\") " pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:17.716303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:17.716303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/124f3ca2-a7c1-4341-9057-cbdee0290438-dbus\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:17.716303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-run-netns\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.716716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-etc-kubernetes\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.716716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjr9z\" (UniqueName: \"kubernetes.io/projected/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-kube-api-access-hjr9z\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.716716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716417    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-run-netns\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.716716 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:17.716505    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:17.716716 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:17.716567    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs podName:adef32ee-aef3-4bdd-a6df-62f66b8b7466 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:18.216548905 +0000 UTC m=+4.867454891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs") pod "network-metrics-daemon-xhm5z" (UID: "adef32ee-aef3-4bdd-a6df-62f66b8b7466") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:17.716716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716630    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/124f3ca2-a7c1-4341-9057-cbdee0290438-kubelet-config\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:17.716716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-etc-kubernetes\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.716716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-cni-dir\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-socket-dir-parent\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-var-lib-cni-multus\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-hostroot\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-conf-dir\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7fe879ea-0463-4647-8190-5cb7552bb02f-agent-certs\") pod \"konnectivity-agent-t5gp8\" (UID: \"7fe879ea-0463-4647-8190-5cb7552bb02f\") " pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-socket-dir-parent\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-system-cni-dir\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-cni-binary-copy\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-daemon-config\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-cni-dir\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7fe879ea-0463-4647-8190-5cb7552bb02f-konnectivity-ca\") pod \"konnectivity-agent-t5gp8\" (UID: \"7fe879ea-0463-4647-8190-5cb7552bb02f\") " pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdst9\" (UniqueName: \"kubernetes.io/projected/adef32ee-aef3-4bdd-a6df-62f66b8b7466-kube-api-access-rdst9\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-cnibin\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-conf-dir\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-var-lib-kubelet\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716951    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-hostroot\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:17.717062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.716975    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-system-cni-dir\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.717013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-var-lib-cni-multus\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.717036    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-host-var-lib-kubelet\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.717062    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-cnibin\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717753 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:17.717123    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:17.717753 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:17.717177    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret podName:124f3ca2-a7c1-4341-9057-cbdee0290438 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:18.21716062 +0000 UTC m=+4.868066593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret") pod "global-pull-secret-syncer-5fvs6" (UID: "124f3ca2-a7c1-4341-9057-cbdee0290438") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:17.717753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.717414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-multus-daemon-config\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.717753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.717423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-cni-binary-copy\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.719841 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.719816    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7fe879ea-0463-4647-8190-5cb7552bb02f-agent-certs\") pod \"konnectivity-agent-t5gp8\" (UID: \"7fe879ea-0463-4647-8190-5cb7552bb02f\") " pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:17.728876 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.728855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdst9\" (UniqueName: \"kubernetes.io/projected/adef32ee-aef3-4bdd-a6df-62f66b8b7466-kube-api-access-rdst9\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:17.728969 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.728917    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjr9z\" (UniqueName: \"kubernetes.io/projected/7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d-kube-api-access-hjr9z\") pod \"multus-qzxbl\" (UID: \"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d\") " pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:17.799145 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.799069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-96rtm"
Sep 17 17:31:17.811173 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.811153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pz4f5"
Sep 17 17:31:17.825984 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.825962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:17.832680 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.832656    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw"
Sep 17 17:31:17.845992 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.845972    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7mhbt"
Sep 17 17:31:17.854674 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.854658    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8dcd2"
Sep 17 17:31:17.861342 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.861317    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6t8mv"
Sep 17 17:31:17.869210 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.869192    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:17.875821 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:17.875800    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qzxbl"
Sep 17 17:31:18.220591 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:18.220509    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:18.220591 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:18.220565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:18.220838 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:18.220599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr89\" (UniqueName: \"kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89\") pod \"network-check-target-zmnd2\" (UID: \"cd07b5db-1573-4198-bc08-54d45e2ed720\") " pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:18.220838 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:18.220673    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:18.220838 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:18.220726    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:18.220838 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:18.220746    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:18.220838 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:18.220757    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9zr89 for pod openshift-network-diagnostics/network-check-target-zmnd2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:18.220838 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:18.220759    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:18.220838 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:18.220768    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret podName:124f3ca2-a7c1-4341-9057-cbdee0290438 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:19.220747059 +0000 UTC m=+5.871653045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret") pod "global-pull-secret-syncer-5fvs6" (UID: "124f3ca2-a7c1-4341-9057-cbdee0290438") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:18.220838 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:18.220799    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs podName:adef32ee-aef3-4bdd-a6df-62f66b8b7466 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:19.220786837 +0000 UTC m=+5.871692820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs") pod "network-metrics-daemon-xhm5z" (UID: "adef32ee-aef3-4bdd-a6df-62f66b8b7466") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:18.220838 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:18.220814    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89 podName:cd07b5db-1573-4198-bc08-54d45e2ed720 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:19.220806102 +0000 UTC m=+5.871712080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zr89" (UniqueName: "kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89") pod "network-check-target-zmnd2" (UID: "cd07b5db-1573-4198-bc08-54d45e2ed720") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:18.565577 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:18.565530    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:26:17 +0000 UTC" deadline="2028-02-15 12:45:41.439681412 +0000 UTC"
Sep 17 17:31:18.565577 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:18.565579    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12379h14m22.874107112s"
Sep 17 17:31:18.608005 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:18.607978    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:18.608155 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:18.608078    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:18.643171 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:18.643130    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe498d7_a0fc_4320_8898_5f3161cf97f0.slice/crio-bde069cdd7534e4507902ef219019e44f92dc59e345207dc1e154c10cb5d842f WatchSource:0}: Error finding container bde069cdd7534e4507902ef219019e44f92dc59e345207dc1e154c10cb5d842f: Status 404 returned error can't find the container with id bde069cdd7534e4507902ef219019e44f92dc59e345207dc1e154c10cb5d842f
Sep 17 17:31:18.646405 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:18.646371    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45dcbf30_6c5f_44a5_a37c_74825385a0de.slice/crio-8dd4d62bc32580d160ba4fad19f9173d4a5b01348ca1d8713f6b6d9b481a3d20 WatchSource:0}: Error finding container 8dd4d62bc32580d160ba4fad19f9173d4a5b01348ca1d8713f6b6d9b481a3d20: Status 404 returned error can't find the container with id 8dd4d62bc32580d160ba4fad19f9173d4a5b01348ca1d8713f6b6d9b481a3d20
Sep 17 17:31:18.649468 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:18.649086    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b01303_d780_42cb_8919_f006e713fd5a.slice/crio-dfa318266311333541f80765bcf6e3c8621afdf853f442c47136fe1355b9595c WatchSource:0}: Error finding container dfa318266311333541f80765bcf6e3c8621afdf853f442c47136fe1355b9595c: Status 404 returned error can't find the container with id dfa318266311333541f80765bcf6e3c8621afdf853f442c47136fe1355b9595c
Sep 17 17:31:18.650464 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:18.650441    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5fa0d2_4bb4_4db1_9728_53c98bcb5c9d.slice/crio-b7bc080f6b666f7ac0e9f18d11811fa308881d87dc518fd78d296a406d1a4249 WatchSource:0}: Error finding container b7bc080f6b666f7ac0e9f18d11811fa308881d87dc518fd78d296a406d1a4249: Status 404 returned error can't find the container with id b7bc080f6b666f7ac0e9f18d11811fa308881d87dc518fd78d296a406d1a4249
Sep 17 17:31:18.651311 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:18.651208    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72664012_dccc_49e5_b790_333fd5db999f.slice/crio-d47d93d822929de80628eed886d43c1a3d9921673e154d38ce052b2972944ecb WatchSource:0}: Error finding container d47d93d822929de80628eed886d43c1a3d9921673e154d38ce052b2972944ecb: Status 404 returned error can't find the container with id d47d93d822929de80628eed886d43c1a3d9921673e154d38ce052b2972944ecb
Sep 17 17:31:18.652379 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:18.652299    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda716c236_02eb_4a29_8500_b99f47fb2abe.slice/crio-7c37626247c791974acba19dbacad07d1e6b706cb67569960d51135ad9734694 WatchSource:0}: Error finding container 7c37626247c791974acba19dbacad07d1e6b706cb67569960d51135ad9734694: Status 404 returned error can't find the container with id 7c37626247c791974acba19dbacad07d1e6b706cb67569960d51135ad9734694
Sep 17 17:31:18.657676 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:18.657656    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8341b4db_17a6_4d39_9ac4_e2a0e6d69264.slice/crio-daa299c2870337ee64a305b9226ae120f71825071ff07e1d5ca1390ee095193a WatchSource:0}: Error finding container daa299c2870337ee64a305b9226ae120f71825071ff07e1d5ca1390ee095193a: Status 404 returned error can't find the container with id daa299c2870337ee64a305b9226ae120f71825071ff07e1d5ca1390ee095193a
Sep 17 17:31:18.659082 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:18.659056    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2638a1_fd22_4d9e_b0ef_9d7c89cc3585.slice/crio-f9d1a89401f416d85d32eac9b46ce19c369fb5654aea63da41d1d26ed3ee8626 WatchSource:0}: Error finding container f9d1a89401f416d85d32eac9b46ce19c369fb5654aea63da41d1d26ed3ee8626: Status 404 returned error can't find the container with id f9d1a89401f416d85d32eac9b46ce19c369fb5654aea63da41d1d26ed3ee8626
Sep 17 17:31:18.680226 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:18.680207    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe879ea_0463_4647_8190_5cb7552bb02f.slice/crio-1dbcf4cf79413dab25d1af060477816b7284c65641801d70a2b5c6d9e2252f21 WatchSource:0}: Error finding container 1dbcf4cf79413dab25d1af060477816b7284c65641801d70a2b5c6d9e2252f21: Status 404 returned error can't find the container with id 1dbcf4cf79413dab25d1af060477816b7284c65641801d70a2b5c6d9e2252f21
Sep 17 17:31:19.228126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.227126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:19.228126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.227200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:19.228126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.227233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr89\" (UniqueName: \"kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89\") pod \"network-check-target-zmnd2\" (UID: \"cd07b5db-1573-4198-bc08-54d45e2ed720\") " pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:19.228126 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:19.227379    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:19.228126 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:19.227396    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:19.228126 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:19.227409    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9zr89 for pod openshift-network-diagnostics/network-check-target-zmnd2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:19.228126 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:19.227469    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89 podName:cd07b5db-1573-4198-bc08-54d45e2ed720 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:21.227450867 +0000 UTC m=+7.878356840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zr89" (UniqueName: "kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89") pod "network-check-target-zmnd2" (UID: "cd07b5db-1573-4198-bc08-54d45e2ed720") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:19.228126 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:19.227906    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:19.228126 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:19.227955    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret podName:124f3ca2-a7c1-4341-9057-cbdee0290438 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:21.227940696 +0000 UTC m=+7.878846671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret") pod "global-pull-secret-syncer-5fvs6" (UID: "124f3ca2-a7c1-4341-9057-cbdee0290438") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:19.228126 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:19.228011    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:19.228126 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:19.228043    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs podName:adef32ee-aef3-4bdd-a6df-62f66b8b7466 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:21.228031628 +0000 UTC m=+7.878937604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs") pod "network-metrics-daemon-xhm5z" (UID: "adef32ee-aef3-4bdd-a6df-62f66b8b7466") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:19.566273 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.566169    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:26:17 +0000 UTC" deadline="2028-04-13 12:19:47.365978708 +0000 UTC"
Sep 17 17:31:19.566273 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.566237    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13770h48m27.799745885s"
Sep 17 17:31:19.610912 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.610120    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:19.610912 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:19.610261    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:19.610912 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.610682    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:19.610912 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:19.610812    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:19.633679 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.633641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-245.ec2.internal" event={"ID":"254195a29b049715cb5595a99d80b7be","Type":"ContainerStarted","Data":"f30da5d070c66277af69bbba8405379f8a4bd5dc69847755c158f818361b8e4c"}
Sep 17 17:31:19.646662 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.646627    2563 generic.go:356] "Generic (PLEG): container finished" podID="cce695a621161a79a3b2cd8ae46e7e0c" containerID="e6e37708db853191763a0cc6e015f1bed1b6fcec9ed98eb2b6f44a1452415c2c" exitCode=0
Sep 17 17:31:19.647471 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.647443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal" event={"ID":"cce695a621161a79a3b2cd8ae46e7e0c","Type":"ContainerDied","Data":"e6e37708db853191763a0cc6e015f1bed1b6fcec9ed98eb2b6f44a1452415c2c"}
Sep 17 17:31:19.656989 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.656960    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq" event={"ID":"a716c236-02eb-4a29-8500-b99f47fb2abe","Type":"ContainerStarted","Data":"7c37626247c791974acba19dbacad07d1e6b706cb67569960d51135ad9734694"}
Sep 17 17:31:19.670431 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.670405    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-96rtm" event={"ID":"72664012-dccc-49e5-b790-333fd5db999f","Type":"ContainerStarted","Data":"d47d93d822929de80628eed886d43c1a3d9921673e154d38ce052b2972944ecb"}
Sep 17 17:31:19.678431 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.678384    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-245.ec2.internal" podStartSLOduration=3.678364715 podStartE2EDuration="3.678364715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:19.654028687 +0000 UTC m=+6.304934681" watchObservedRunningTime="2026-09-17 17:31:19.678364715 +0000 UTC m=+6.329270711"
Sep 17 17:31:19.684091 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.683840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw" event={"ID":"8341b4db-17a6-4d39-9ac4-e2a0e6d69264","Type":"ContainerStarted","Data":"daa299c2870337ee64a305b9226ae120f71825071ff07e1d5ca1390ee095193a"}
Sep 17 17:31:19.705077 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.705052    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qzxbl" event={"ID":"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d","Type":"ContainerStarted","Data":"b7bc080f6b666f7ac0e9f18d11811fa308881d87dc518fd78d296a406d1a4249"}
Sep 17 17:31:19.728969 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.728936    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8dcd2" event={"ID":"45dcbf30-6c5f-44a5-a37c-74825385a0de","Type":"ContainerStarted","Data":"8dd4d62bc32580d160ba4fad19f9173d4a5b01348ca1d8713f6b6d9b481a3d20"}
Sep 17 17:31:19.757388 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.757350    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t5gp8" event={"ID":"7fe879ea-0463-4647-8190-5cb7552bb02f","Type":"ContainerStarted","Data":"1dbcf4cf79413dab25d1af060477816b7284c65641801d70a2b5c6d9e2252f21"}
Sep 17 17:31:19.770610 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.770556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pz4f5" event={"ID":"4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585","Type":"ContainerStarted","Data":"f9d1a89401f416d85d32eac9b46ce19c369fb5654aea63da41d1d26ed3ee8626"}
Sep 17 17:31:19.777656 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.777518    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7mhbt" event={"ID":"b4b01303-d780-42cb-8919-f006e713fd5a","Type":"ContainerStarted","Data":"dfa318266311333541f80765bcf6e3c8621afdf853f442c47136fe1355b9595c"}
Sep 17 17:31:19.789826 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:19.789732    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t8mv" event={"ID":"5fe498d7-a0fc-4320-8898-5f3161cf97f0","Type":"ContainerStarted","Data":"bde069cdd7534e4507902ef219019e44f92dc59e345207dc1e154c10cb5d842f"}
Sep 17 17:31:20.608788 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:20.608244    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:20.608788 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:20.608382    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:20.812752 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:20.812696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal" event={"ID":"cce695a621161a79a3b2cd8ae46e7e0c","Type":"ContainerStarted","Data":"d35f8afc4755b029a6833f9f05d87e27c8e5f388ee53eeb8cbbf2dbd9790928d"}
Sep 17 17:31:21.245171 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:21.245136    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:21.245366 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:21.245200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:21.245366 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:21.245233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr89\" (UniqueName: \"kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89\") pod \"network-check-target-zmnd2\" (UID: \"cd07b5db-1573-4198-bc08-54d45e2ed720\") " pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:21.245482 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:21.245400    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:21.245482 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:21.245423    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:21.245482 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:21.245437    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9zr89 for pod openshift-network-diagnostics/network-check-target-zmnd2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:21.245616 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:21.245496    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89 podName:cd07b5db-1573-4198-bc08-54d45e2ed720 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:25.245477076 +0000 UTC m=+11.896383060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zr89" (UniqueName: "kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89") pod "network-check-target-zmnd2" (UID: "cd07b5db-1573-4198-bc08-54d45e2ed720") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:21.245951 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:21.245931    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:21.246047 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:21.245986    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret podName:124f3ca2-a7c1-4341-9057-cbdee0290438 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:25.245970912 +0000 UTC m=+11.896876887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret") pod "global-pull-secret-syncer-5fvs6" (UID: "124f3ca2-a7c1-4341-9057-cbdee0290438") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:21.246047 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:21.246044    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:21.246165 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:21.246081    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs podName:adef32ee-aef3-4bdd-a6df-62f66b8b7466 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:25.2460676 +0000 UTC m=+11.896973587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs") pod "network-metrics-daemon-xhm5z" (UID: "adef32ee-aef3-4bdd-a6df-62f66b8b7466") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:21.610597 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:21.609940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:21.610597 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:21.610074    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:21.610597 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:21.610440    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:21.610597 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:21.610544    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:22.608184 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:22.608125    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:22.608429 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:22.608262    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:23.608536 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:23.608502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:23.609010 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:23.608653    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:23.609085 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:23.609055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:23.609168 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:23.609143    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:24.607426 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:24.607398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:24.607623 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:24.607503    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:25.277469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:25.277417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:25.277966 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:25.277488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:25.277966 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:25.277522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr89\" (UniqueName: \"kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89\") pod \"network-check-target-zmnd2\" (UID: \"cd07b5db-1573-4198-bc08-54d45e2ed720\") " pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:25.277966 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:25.277594    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:25.277966 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:25.277643    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:25.277966 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:25.277656    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:25.277966 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:25.277670    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:25.277966 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:25.277678    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret podName:124f3ca2-a7c1-4341-9057-cbdee0290438 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:33.277658886 +0000 UTC m=+19.928564871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret") pod "global-pull-secret-syncer-5fvs6" (UID: "124f3ca2-a7c1-4341-9057-cbdee0290438") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:25.277966 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:25.277679    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9zr89 for pod openshift-network-diagnostics/network-check-target-zmnd2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:25.277966 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:25.277718    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs podName:adef32ee-aef3-4bdd-a6df-62f66b8b7466 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:33.27769058 +0000 UTC m=+19.928596554 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs") pod "network-metrics-daemon-xhm5z" (UID: "adef32ee-aef3-4bdd-a6df-62f66b8b7466") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:25.277966 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:25.277742    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89 podName:cd07b5db-1573-4198-bc08-54d45e2ed720 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:33.27773113 +0000 UTC m=+19.928637099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zr89" (UniqueName: "kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89") pod "network-check-target-zmnd2" (UID: "cd07b5db-1573-4198-bc08-54d45e2ed720") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:25.610420 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:25.610333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:25.610566 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:25.610439    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:25.610566 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:25.610496    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:25.610679 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:25.610596    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:26.608324 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:26.607941    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:26.608324 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:26.608073    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:27.607860 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:27.607826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:27.608022 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:27.607974    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:27.608309 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:27.607826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:27.608431 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:27.608396    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:28.608218 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:28.608174    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:28.608379 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:28.608313    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:29.607750 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:29.607719    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:29.608219 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:29.607732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:29.608219 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:29.607842    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:29.608219 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:29.607925    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:30.608090 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:30.608056    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:30.608472 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:30.608171    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:31.607594 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:31.607555    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:31.607594 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:31.607588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:31.607802 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:31.607726    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:31.607882 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:31.607840    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:32.608474 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:32.608436    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:32.608864 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:32.608583    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:33.342929 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:33.342885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:33.343110 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:33.342958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:33.343110 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:33.342987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr89\" (UniqueName: \"kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89\") pod \"network-check-target-zmnd2\" (UID: \"cd07b5db-1573-4198-bc08-54d45e2ed720\") " pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:33.343110 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:33.343043    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:33.343110 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:33.343091    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:33.343281 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:33.343118    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:33.343281 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:33.343125    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret podName:124f3ca2-a7c1-4341-9057-cbdee0290438 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:49.343105286 +0000 UTC m=+35.994011259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret") pod "global-pull-secret-syncer-5fvs6" (UID: "124f3ca2-a7c1-4341-9057-cbdee0290438") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:33.343281 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:33.343135    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:33.343281 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:33.343145    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9zr89 for pod openshift-network-diagnostics/network-check-target-zmnd2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:33.343281 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:33.343146    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs podName:adef32ee-aef3-4bdd-a6df-62f66b8b7466 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:49.343135552 +0000 UTC m=+35.994041521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs") pod "network-metrics-daemon-xhm5z" (UID: "adef32ee-aef3-4bdd-a6df-62f66b8b7466") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:33.343281 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:33.343193    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89 podName:cd07b5db-1573-4198-bc08-54d45e2ed720 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:49.343176982 +0000 UTC m=+35.994082975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zr89" (UniqueName: "kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89") pod "network-check-target-zmnd2" (UID: "cd07b5db-1573-4198-bc08-54d45e2ed720") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:33.608477 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:33.608388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:33.608626 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:33.608539    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:33.609020 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:33.608669    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:33.609020 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:33.608536    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:34.607632 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:34.607596    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:34.607825 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:34.607715    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:35.608040 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:35.608004    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:35.608424 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:35.608091    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:35.608424 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:35.608147    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:35.608424 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:35.608224    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:36.607575 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.607406    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:36.607735 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:36.607689    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:36.846913 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.846885    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:31:36.848303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.848269    2563 generic.go:356] "Generic (PLEG): container finished" podID="a716c236-02eb-4a29-8500-b99f47fb2abe" containerID="0e460a847112225d8deac522a5855398ccc665cc0138df76a327d343d964119f" exitCode=1
Sep 17 17:31:36.848400 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.848368    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq" event={"ID":"a716c236-02eb-4a29-8500-b99f47fb2abe","Type":"ContainerStarted","Data":"79ec11d8251f204e8e9d9547f1050e2e26ddb554e5a3e7c333680e475a5d2705"}
Sep 17 17:31:36.848465 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.848456    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq" event={"ID":"a716c236-02eb-4a29-8500-b99f47fb2abe","Type":"ContainerDied","Data":"0e460a847112225d8deac522a5855398ccc665cc0138df76a327d343d964119f"}
Sep 17 17:31:36.848522 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.848513    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq" event={"ID":"a716c236-02eb-4a29-8500-b99f47fb2abe","Type":"ContainerStarted","Data":"4a30ca1fcf1bc59dcbd895afb0870165f764b174f8d75cb726426026253daac8"}
Sep 17 17:31:36.850182 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.850153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-96rtm" event={"ID":"72664012-dccc-49e5-b790-333fd5db999f","Type":"ContainerStarted","Data":"8a7e7b6ab0f8531f5ed43ef87e6babfeb57fc2bd7d8da2bb69d370ec2997f277"}
Sep 17 17:31:36.851978 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.851956    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw" event={"ID":"8341b4db-17a6-4d39-9ac4-e2a0e6d69264","Type":"ContainerStarted","Data":"e9465ea4bc424c1569674096fd168be25fb41b572590fa8f09c94f0570f6eeed"}
Sep 17 17:31:36.853428 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.853403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qzxbl" event={"ID":"7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d","Type":"ContainerStarted","Data":"2f189ac7a352fcbb2d380d45ddcff1ead583e7ae7c0f1bc68fb59b3efa8672c6"}
Sep 17 17:31:36.854897 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.854875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8dcd2" event={"ID":"45dcbf30-6c5f-44a5-a37c-74825385a0de","Type":"ContainerStarted","Data":"f3e10f4acdbe980c22f3c3ff3840323d5a9a37fa966d7dda0dff4ca5f180f15e"}
Sep 17 17:31:36.856295 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.856267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t5gp8" event={"ID":"7fe879ea-0463-4647-8190-5cb7552bb02f","Type":"ContainerStarted","Data":"f702d6e14b3857adba9d042b1af613c375aec49ff4a1f42fd205eb2a01255cfc"}
Sep 17 17:31:36.857611 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.857590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7mhbt" event={"ID":"b4b01303-d780-42cb-8919-f006e713fd5a","Type":"ContainerStarted","Data":"ee54baa23bf4dd662edc48d97e2a2778414d208c1dd6e5aa41f8ac9cad8159ad"}
Sep 17 17:31:36.859027 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.859002    2563 generic.go:356] "Generic (PLEG): container finished" podID="5fe498d7-a0fc-4320-8898-5f3161cf97f0" containerID="f1a4983686381c4415f2c13c72aad89337454032ed1f9a3dcd0d39187f0bc1ce" exitCode=0
Sep 17 17:31:36.859111 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.859035    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t8mv" event={"ID":"5fe498d7-a0fc-4320-8898-5f3161cf97f0","Type":"ContainerDied","Data":"f1a4983686381c4415f2c13c72aad89337454032ed1f9a3dcd0d39187f0bc1ce"}
Sep 17 17:31:36.875522 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.873367    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-245.ec2.internal" podStartSLOduration=20.873324849 podStartE2EDuration="20.873324849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:20.833010334 +0000 UTC m=+7.483916326" watchObservedRunningTime="2026-09-17 17:31:36.873324849 +0000 UTC m=+23.524230837"
Sep 17 17:31:36.875522 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.874641    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-96rtm" podStartSLOduration=4.6323569209999995 podStartE2EDuration="21.874626036s" totalImagesPullingTime="17.242269115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:36.873310764 +0000 UTC m=+23.524216757" watchObservedRunningTime="2026-09-17 17:31:36.874626036 +0000 UTC m=+23.525532030"
Sep 17 17:31:36.956117 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.956076    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qzxbl" podStartSLOduration=4.674286246 podStartE2EDuration="21.956061772s" totalImagesPullingTime="17.281775526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:36.955753481 +0000 UTC m=+23.606659472" watchObservedRunningTime="2026-09-17 17:31:36.956061772 +0000 UTC m=+23.606967764"
Sep 17 17:31:36.956403 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.956383    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t5gp8" podStartSLOduration=4.7891666619999995 podStartE2EDuration="21.95637633s" totalImagesPullingTime="17.167209668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:36.919688199 +0000 UTC m=+23.570594190" watchObservedRunningTime="2026-09-17 17:31:36.95637633 +0000 UTC m=+23.607282324"
Sep 17 17:31:36.982431 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:36.982269    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7mhbt" podStartSLOduration=4.7841869169999995 podStartE2EDuration="21.982254913s" totalImagesPullingTime="17.198067996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:36.981980815 +0000 UTC m=+23.632886806" watchObservedRunningTime="2026-09-17 17:31:36.982254913 +0000 UTC m=+23.633160905"
Sep 17 17:31:37.000627 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.000591    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8dcd2" podStartSLOduration=4.752683722 podStartE2EDuration="22.000577672s" totalImagesPullingTime="17.24789395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:37.000556652 +0000 UTC m=+23.651462671" watchObservedRunningTime="2026-09-17 17:31:37.000577672 +0000 UTC m=+23.651483664"
Sep 17 17:31:37.301318 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.301290    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:37.301892 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.301871    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:37.417599 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.417576    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 17:31:37.583944 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.583819    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T17:31:37.4175942Z","UUID":"00829050-3822-4387-8ac1-2cb89a932881","Handler":null,"Name":"","Endpoint":""}
Sep 17 17:31:37.585172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.585152    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 17:31:37.585299 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.585183    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 17:31:37.607422 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.607395    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:37.607543 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.607429    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:37.607543 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:37.607500    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:37.607648 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:37.607624    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:37.865613 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.865538    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:31:37.866018 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.865996    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq" event={"ID":"a716c236-02eb-4a29-8500-b99f47fb2abe","Type":"ContainerStarted","Data":"9a6adaec43cdf13ba53bfbc0f4ef0e17a79cc19bb79351a2386fbd6c7381252b"}
Sep 17 17:31:37.866083 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.866069    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq" event={"ID":"a716c236-02eb-4a29-8500-b99f47fb2abe","Type":"ContainerStarted","Data":"b718de5187419ace55be6efd5f7d8f04b571d520d20fda112201bed452298955"}
Sep 17 17:31:37.866134 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.866116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq" event={"ID":"a716c236-02eb-4a29-8500-b99f47fb2abe","Type":"ContainerStarted","Data":"9c4ae29b405555cc62695f919b9cb84608f4624fb8e4d8f54b7c2d58fe498c2d"}
Sep 17 17:31:37.868251 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.868221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw" event={"ID":"8341b4db-17a6-4d39-9ac4-e2a0e6d69264","Type":"ContainerStarted","Data":"1081c3afd1719c8dae6ed7b2b489a6eb1c16ac0243cd5bf3466b50add5cbc422"}
Sep 17 17:31:37.869819 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.869792    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pz4f5" event={"ID":"4c2638a1-fd22-4d9e-b0ef-9d7c89cc3585","Type":"ContainerStarted","Data":"859cb1f65dd108c9e1751ec1104b492fd63d764a05c880dc95b6a001b3ae7d2c"}
Sep 17 17:31:37.870821 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.870797    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:37.873665 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.872233    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t5gp8"
Sep 17 17:31:37.890621 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:37.890575    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pz4f5" podStartSLOduration=5.720186498 podStartE2EDuration="22.89055971s" totalImagesPullingTime="17.170373212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:37.890471082 +0000 UTC m=+24.541377075" watchObservedRunningTime="2026-09-17 17:31:37.89055971 +0000 UTC m=+24.541465703"
Sep 17 17:31:38.608341 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:38.608302    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:38.608538 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:38.608446    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:38.874904 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:38.874808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw" event={"ID":"8341b4db-17a6-4d39-9ac4-e2a0e6d69264","Type":"ContainerStarted","Data":"f65817554b8cfcb2e5b79bcc1edd1afd976087c5996037f35969e70f248ff4dd"}
Sep 17 17:31:39.608096 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:39.608063    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:39.608259 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:39.608063    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:39.608259 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:39.608188    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:39.608367 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:39.608269    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:39.881049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:39.881019    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:31:39.881532 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:39.881491    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq" event={"ID":"a716c236-02eb-4a29-8500-b99f47fb2abe","Type":"ContainerStarted","Data":"35fa57b7bf34d994a485f107230c7cd160ae76f48d9757f5f4b9423f857c1af5"}
Sep 17 17:31:40.608137 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:40.608107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:40.608299 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:40.608228    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:41.607934 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.607799    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:41.608339 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.607852    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:41.608339 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:41.608015    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:41.608339 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:41.608071    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:41.888306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.888231    2563 generic.go:356] "Generic (PLEG): container finished" podID="5fe498d7-a0fc-4320-8898-5f3161cf97f0" containerID="f528eac991b6395e158dafed65036986f4980ddf1cfeedfdac384649d4d5fafe" exitCode=0
Sep 17 17:31:41.888306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.888287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t8mv" event={"ID":"5fe498d7-a0fc-4320-8898-5f3161cf97f0","Type":"ContainerDied","Data":"f528eac991b6395e158dafed65036986f4980ddf1cfeedfdac384649d4d5fafe"}
Sep 17 17:31:41.892131 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.892116    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:31:41.892500 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.892481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq" event={"ID":"a716c236-02eb-4a29-8500-b99f47fb2abe","Type":"ContainerStarted","Data":"2498c12f27da61c615b692a922c4aeada14bff4a31beec370837c34e8cba0b89"}
Sep 17 17:31:41.892757 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.892742    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:41.892825 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.892794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:41.892825 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.892824    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:41.893067 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.893037    2563 scope.go:117] "RemoveContainer" containerID="0e460a847112225d8deac522a5855398ccc665cc0138df76a327d343d964119f"
Sep 17 17:31:41.908668 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.908647    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:41.908992 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.908978    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:31:41.911545 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:41.911505    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8nrw" podStartSLOduration=7.361807135 podStartE2EDuration="26.911489441s" totalImagesPullingTime="19.549682306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:38.910929681 +0000 UTC m=+25.561835685" watchObservedRunningTime="2026-09-17 17:31:41.911489441 +0000 UTC m=+28.562395411"
Sep 17 17:31:42.607626 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:42.607435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:42.607857 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:42.607737    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:42.899902 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:42.899819    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:31:42.900641 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:42.900327    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq" event={"ID":"a716c236-02eb-4a29-8500-b99f47fb2abe","Type":"ContainerStarted","Data":"3ef4cb8729c8a73f8145a3eb513f54b4f9f943b8ab72732d51507f6e53ae43d1"}
Sep 17 17:31:42.903342 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:42.902810    2563 generic.go:356] "Generic (PLEG): container finished" podID="5fe498d7-a0fc-4320-8898-5f3161cf97f0" containerID="c22daa0fe5299d6ec4ceb20efc8e2a1c0ae00c9d840098025f6b82a59822f9b1" exitCode=0
Sep 17 17:31:42.903342 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:42.902851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t8mv" event={"ID":"5fe498d7-a0fc-4320-8898-5f3161cf97f0","Type":"ContainerDied","Data":"c22daa0fe5299d6ec4ceb20efc8e2a1c0ae00c9d840098025f6b82a59822f9b1"}
Sep 17 17:31:42.957209 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:42.957146    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq" podStartSLOduration=10.178424244 podStartE2EDuration="27.957125282s" totalImagesPullingTime="17.778701038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:42.955886116 +0000 UTC m=+29.606792109" watchObservedRunningTime="2026-09-17 17:31:42.957125282 +0000 UTC m=+29.608031274"
Sep 17 17:31:43.607667 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:43.607644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:43.607777 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:43.607644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:43.607828 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:43.607783    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:43.607876 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:43.607858    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:43.808554 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:43.808484    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zmnd2"]
Sep 17 17:31:43.810158 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:43.810109    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xhm5z"]
Sep 17 17:31:43.811879 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:43.811856    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5fvs6"]
Sep 17 17:31:43.811976 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:43.811965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:43.812074 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:43.812058    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:43.907526 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:43.907493    2563 generic.go:356] "Generic (PLEG): container finished" podID="5fe498d7-a0fc-4320-8898-5f3161cf97f0" containerID="7dd1487819039b761422c07442da57e3e466811db22844fa2d498214aeabc60a" exitCode=0
Sep 17 17:31:43.907979 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:43.907601    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:43.907979 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:43.907592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t8mv" event={"ID":"5fe498d7-a0fc-4320-8898-5f3161cf97f0","Type":"ContainerDied","Data":"7dd1487819039b761422c07442da57e3e466811db22844fa2d498214aeabc60a"}
Sep 17 17:31:43.907979 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:43.907742    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:43.908088 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:43.908068    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:43.908187 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:43.908164    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:45.609242 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:45.609193    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:45.609936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:45.609291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:45.609936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:45.609334    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:45.609936 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:45.609417    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:45.609936 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:45.609634    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:45.609936 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:45.609589    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:47.607967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:47.607928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:47.608385 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:47.607973    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:47.608385 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:47.607981    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:47.608385 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:47.608115    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:47.608385 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:47.608256    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:47.608385 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:47.608349    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:48.921934 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:48.921745    2563 generic.go:356] "Generic (PLEG): container finished" podID="5fe498d7-a0fc-4320-8898-5f3161cf97f0" containerID="89bb9e032800a710af5ad80464cb73b882efd92678248551eff25d656860c767" exitCode=0
Sep 17 17:31:48.921934 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:48.921801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t8mv" event={"ID":"5fe498d7-a0fc-4320-8898-5f3161cf97f0","Type":"ContainerDied","Data":"89bb9e032800a710af5ad80464cb73b882efd92678248551eff25d656860c767"}
Sep 17 17:31:49.365414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.365384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:49.365606 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.365426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:49.365606 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.365445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr89\" (UniqueName: \"kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89\") pod \"network-check-target-zmnd2\" (UID: \"cd07b5db-1573-4198-bc08-54d45e2ed720\") " pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:49.365606 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:49.365520    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:49.365606 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:49.365532    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:49.365606 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:49.365536    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:49.365606 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:49.365583    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret podName:124f3ca2-a7c1-4341-9057-cbdee0290438 nodeName:}" failed. No retries permitted until 2026-09-17 17:32:21.365565451 +0000 UTC m=+68.016471420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret") pod "global-pull-secret-syncer-5fvs6" (UID: "124f3ca2-a7c1-4341-9057-cbdee0290438") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:49.365606 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:49.365595    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:49.365606 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:49.365608    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9zr89 for pod openshift-network-diagnostics/network-check-target-zmnd2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:49.365920 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:49.365598    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs podName:adef32ee-aef3-4bdd-a6df-62f66b8b7466 nodeName:}" failed. No retries permitted until 2026-09-17 17:32:21.365590946 +0000 UTC m=+68.016496917 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs") pod "network-metrics-daemon-xhm5z" (UID: "adef32ee-aef3-4bdd-a6df-62f66b8b7466") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:49.365920 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:49.365663    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89 podName:cd07b5db-1573-4198-bc08-54d45e2ed720 nodeName:}" failed. No retries permitted until 2026-09-17 17:32:21.365646549 +0000 UTC m=+68.016552519 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zr89" (UniqueName: "kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89") pod "network-check-target-zmnd2" (UID: "cd07b5db-1573-4198-bc08-54d45e2ed720") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:49.610839 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.610813    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:49.610982 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.610905    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:49.610982 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:49.610913    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zmnd2" podUID="cd07b5db-1573-4198-bc08-54d45e2ed720"
Sep 17 17:31:49.610982 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.610935    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:49.611085 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:49.611016    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xhm5z" podUID="adef32ee-aef3-4bdd-a6df-62f66b8b7466"
Sep 17 17:31:49.611085 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:49.611074    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fvs6" podUID="124f3ca2-a7c1-4341-9057-cbdee0290438"
Sep 17 17:31:49.828694 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.828668    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-245.ec2.internal" event="NodeReady"
Sep 17 17:31:49.828868 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.828844    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 17:31:49.898162 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.898085    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c7tsd"]
Sep 17 17:31:49.900492 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.900476    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-97vgb"]
Sep 17 17:31:49.900604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.900588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:49.903063 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.903044    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 17:31:49.903063 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.903054    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 17:31:49.903234 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.903228    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fv9xq\""
Sep 17 17:31:49.903548 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.903528    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-97vgb"
Sep 17 17:31:49.905959 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.905893    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 17:31:49.906058 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.906039    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 17:31:49.906118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.906092    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 17:31:49.906476 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.906462    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mkhl7\""
Sep 17 17:31:49.912836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.912813    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-97vgb"]
Sep 17 17:31:49.913339 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.913320    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c7tsd"]
Sep 17 17:31:49.927294 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.927274    2563 generic.go:356] "Generic (PLEG): container finished" podID="5fe498d7-a0fc-4320-8898-5f3161cf97f0" containerID="0a5f642310f6fa2336963cf1cae2e4a617bbfe1b6f45ecbeb974878b5e94eb10" exitCode=0
Sep 17 17:31:49.927576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:49.927307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t8mv" event={"ID":"5fe498d7-a0fc-4320-8898-5f3161cf97f0","Type":"ContainerDied","Data":"0a5f642310f6fa2336963cf1cae2e4a617bbfe1b6f45ecbeb974878b5e94eb10"}
Sep 17 17:31:50.071904 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.071877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d2703893-5d20-4d4f-88d0-a6f5e28da54b-config-volume\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.072021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.071920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2703893-5d20-4d4f-88d0-a6f5e28da54b-tmp-dir\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.072021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.071937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6gm\" (UniqueName: \"kubernetes.io/projected/d2703893-5d20-4d4f-88d0-a6f5e28da54b-kube-api-access-qz6gm\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.072021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.071967    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83175e6e-f6e0-49dc-986b-b05ebe54fbef-cert\") pod \"ingress-canary-97vgb\" (UID: \"83175e6e-f6e0-49dc-986b-b05ebe54fbef\") " pod="openshift-ingress-canary/ingress-canary-97vgb"
Sep 17 17:31:50.072021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.072011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.072237 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.072129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zbbz\" (UniqueName: \"kubernetes.io/projected/83175e6e-f6e0-49dc-986b-b05ebe54fbef-kube-api-access-7zbbz\") pod \"ingress-canary-97vgb\" (UID: \"83175e6e-f6e0-49dc-986b-b05ebe54fbef\") " pod="openshift-ingress-canary/ingress-canary-97vgb"
Sep 17 17:31:50.173267 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.173178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zbbz\" (UniqueName: \"kubernetes.io/projected/83175e6e-f6e0-49dc-986b-b05ebe54fbef-kube-api-access-7zbbz\") pod \"ingress-canary-97vgb\" (UID: \"83175e6e-f6e0-49dc-986b-b05ebe54fbef\") " pod="openshift-ingress-canary/ingress-canary-97vgb"
Sep 17 17:31:50.173267 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.173245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d2703893-5d20-4d4f-88d0-a6f5e28da54b-config-volume\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.173462 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.173278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2703893-5d20-4d4f-88d0-a6f5e28da54b-tmp-dir\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.173462 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.173296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6gm\" (UniqueName: \"kubernetes.io/projected/d2703893-5d20-4d4f-88d0-a6f5e28da54b-kube-api-access-qz6gm\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.173462 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.173311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83175e6e-f6e0-49dc-986b-b05ebe54fbef-cert\") pod \"ingress-canary-97vgb\" (UID: \"83175e6e-f6e0-49dc-986b-b05ebe54fbef\") " pod="openshift-ingress-canary/ingress-canary-97vgb"
Sep 17 17:31:50.173462 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.173338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.173462 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:50.173434    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:31:50.173687 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:50.173480    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls podName:d2703893-5d20-4d4f-88d0-a6f5e28da54b nodeName:}" failed. No retries permitted until 2026-09-17 17:31:50.673467863 +0000 UTC m=+37.324373833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls") pod "dns-default-c7tsd" (UID: "d2703893-5d20-4d4f-88d0-a6f5e28da54b") : secret "dns-default-metrics-tls" not found
Sep 17 17:31:50.173687 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.173658    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2703893-5d20-4d4f-88d0-a6f5e28da54b-tmp-dir\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.173881 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.173865    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d2703893-5d20-4d4f-88d0-a6f5e28da54b-config-volume\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.177444 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.177416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83175e6e-f6e0-49dc-986b-b05ebe54fbef-cert\") pod \"ingress-canary-97vgb\" (UID: \"83175e6e-f6e0-49dc-986b-b05ebe54fbef\") " pod="openshift-ingress-canary/ingress-canary-97vgb"
Sep 17 17:31:50.187301 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.187281    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zbbz\" (UniqueName: \"kubernetes.io/projected/83175e6e-f6e0-49dc-986b-b05ebe54fbef-kube-api-access-7zbbz\") pod \"ingress-canary-97vgb\" (UID: \"83175e6e-f6e0-49dc-986b-b05ebe54fbef\") " pod="openshift-ingress-canary/ingress-canary-97vgb"
Sep 17 17:31:50.191858 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.191843    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6gm\" (UniqueName: \"kubernetes.io/projected/d2703893-5d20-4d4f-88d0-a6f5e28da54b-kube-api-access-qz6gm\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.215921 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.215896    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-97vgb"
Sep 17 17:31:50.506238 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.506163    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-97vgb"]
Sep 17 17:31:50.510178 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:31:50.510036    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83175e6e_f6e0_49dc_986b_b05ebe54fbef.slice/crio-a259588c2b5a89757147b061887177ee02e89d023f87f2565a59d0ed9d55af24 WatchSource:0}: Error finding container a259588c2b5a89757147b061887177ee02e89d023f87f2565a59d0ed9d55af24: Status 404 returned error can't find the container with id a259588c2b5a89757147b061887177ee02e89d023f87f2565a59d0ed9d55af24
Sep 17 17:31:50.678055 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.678028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:50.678222 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:50.678162    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:31:50.678266 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:50.678223    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls podName:d2703893-5d20-4d4f-88d0-a6f5e28da54b nodeName:}" failed. No retries permitted until 2026-09-17 17:31:51.67820854 +0000 UTC m=+38.329114509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls") pod "dns-default-c7tsd" (UID: "d2703893-5d20-4d4f-88d0-a6f5e28da54b") : secret "dns-default-metrics-tls" not found
Sep 17 17:31:50.930489 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.930453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-97vgb" event={"ID":"83175e6e-f6e0-49dc-986b-b05ebe54fbef","Type":"ContainerStarted","Data":"a259588c2b5a89757147b061887177ee02e89d023f87f2565a59d0ed9d55af24"}
Sep 17 17:31:50.933713 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.933673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t8mv" event={"ID":"5fe498d7-a0fc-4320-8898-5f3161cf97f0","Type":"ContainerStarted","Data":"09766d163d94a607db8e46a1679c90cba2af56f06b33dbbe53c1ae1ca4d5e8da"}
Sep 17 17:31:50.961271 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:50.961232    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6t8mv" podStartSLOduration=8.954792724 podStartE2EDuration="35.961209594s" totalImagesPullingTime="27.00641687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:50.960079988 +0000 UTC m=+37.610985980" watchObservedRunningTime="2026-09-17 17:31:50.961209594 +0000 UTC m=+37.612115585"
Sep 17 17:31:51.607558 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:51.607523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:31:51.607558 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:51.607561    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:31:51.607814 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:51.607529    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:31:51.610108 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:51.610076    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-js6ht\""
Sep 17 17:31:51.610243 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:51.610183    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 17:31:51.610858 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:51.610839    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 17:31:51.610955 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:51.610878    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gjh79\""
Sep 17 17:31:51.610955 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:51.610879    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 17:31:51.610955 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:51.610906    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 17:31:51.687920 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:51.687887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:51.688095 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:51.688067    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:31:51.688166 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:51.688152    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls podName:d2703893-5d20-4d4f-88d0-a6f5e28da54b nodeName:}" failed. No retries permitted until 2026-09-17 17:31:53.6881294 +0000 UTC m=+40.339035383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls") pod "dns-default-c7tsd" (UID: "d2703893-5d20-4d4f-88d0-a6f5e28da54b") : secret "dns-default-metrics-tls" not found
Sep 17 17:31:53.705122 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:53.705099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:53.705426 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:53.705198    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:31:53.705426 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:53.705247    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls podName:d2703893-5d20-4d4f-88d0-a6f5e28da54b nodeName:}" failed. No retries permitted until 2026-09-17 17:31:57.705234593 +0000 UTC m=+44.356140563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls") pod "dns-default-c7tsd" (UID: "d2703893-5d20-4d4f-88d0-a6f5e28da54b") : secret "dns-default-metrics-tls" not found
Sep 17 17:31:53.941356 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:53.941284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-97vgb" event={"ID":"83175e6e-f6e0-49dc-986b-b05ebe54fbef","Type":"ContainerStarted","Data":"ea70a2fe066972abacba61b7dd62fc02db601025d1134db305e4f76637d57db6"}
Sep 17 17:31:53.972992 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:53.972949    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-97vgb" podStartSLOduration=2.520477857 podStartE2EDuration="4.972935788s" totalImagesPullingTime="2.452457931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:53.972485066 +0000 UTC m=+40.623391058" watchObservedRunningTime="2026-09-17 17:31:53.972935788 +0000 UTC m=+40.623841780"
Sep 17 17:31:57.732983 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:31:57.732943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:31:57.733392 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:57.733084    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:31:57.733392 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:31:57.733151    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls podName:d2703893-5d20-4d4f-88d0-a6f5e28da54b nodeName:}" failed. No retries permitted until 2026-09-17 17:32:05.733137414 +0000 UTC m=+52.384043384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls") pod "dns-default-c7tsd" (UID: "d2703893-5d20-4d4f-88d0-a6f5e28da54b") : secret "dns-default-metrics-tls" not found
Sep 17 17:32:05.785590 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:05.785556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:32:05.786119 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:32:05.785770    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:32:05.786119 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:32:05.785868    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls podName:d2703893-5d20-4d4f-88d0-a6f5e28da54b nodeName:}" failed. No retries permitted until 2026-09-17 17:32:21.785845069 +0000 UTC m=+68.436751062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls") pod "dns-default-c7tsd" (UID: "d2703893-5d20-4d4f-88d0-a6f5e28da54b") : secret "dns-default-metrics-tls" not found
Sep 17 17:32:13.918280 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:13.918251    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2fxq"
Sep 17 17:32:21.388942 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.388898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:32:21.388942 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.388956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr89\" (UniqueName: \"kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89\") pod \"network-check-target-zmnd2\" (UID: \"cd07b5db-1573-4198-bc08-54d45e2ed720\") " pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:32:21.389569 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.389006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:32:21.392806 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.392781    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 17:32:21.392916 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.392815    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 17:32:21.392916 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.392781    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 17:32:21.399919 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:32:21.399901    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 17:32:21.399975 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:32:21.399955    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs podName:adef32ee-aef3-4bdd-a6df-62f66b8b7466 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:25.39993977 +0000 UTC m=+132.050845739 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs") pod "network-metrics-daemon-xhm5z" (UID: "adef32ee-aef3-4bdd-a6df-62f66b8b7466") : secret "metrics-daemon-secret" not found
Sep 17 17:32:21.402716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.402681    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 17:32:21.402969 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.402951    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/124f3ca2-a7c1-4341-9057-cbdee0290438-original-pull-secret\") pod \"global-pull-secret-syncer-5fvs6\" (UID: \"124f3ca2-a7c1-4341-9057-cbdee0290438\") " pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:32:21.412566 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.412548    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zr89\" (UniqueName: \"kubernetes.io/projected/cd07b5db-1573-4198-bc08-54d45e2ed720-kube-api-access-9zr89\") pod \"network-check-target-zmnd2\" (UID: \"cd07b5db-1573-4198-bc08-54d45e2ed720\") " pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:32:21.623467 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.623438    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gjh79\""
Sep 17 17:32:21.630978 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.630957    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:32:21.633241 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.633227    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fvs6"
Sep 17 17:32:21.792259 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.792222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:32:21.792392 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:32:21.792374    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:32:21.792453 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:32:21.792443    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls podName:d2703893-5d20-4d4f-88d0-a6f5e28da54b nodeName:}" failed. No retries permitted until 2026-09-17 17:32:53.792423839 +0000 UTC m=+100.443329813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls") pod "dns-default-c7tsd" (UID: "d2703893-5d20-4d4f-88d0-a6f5e28da54b") : secret "dns-default-metrics-tls" not found
Sep 17 17:32:21.939555 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.939488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zmnd2"]
Sep 17 17:32:21.943226 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:32:21.943181    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd07b5db_1573_4198_bc08_54d45e2ed720.slice/crio-b59e7a3b9305e80c0198bd0f9878f7a823ef534b46f4aff7d403c2adaa0f2109 WatchSource:0}: Error finding container b59e7a3b9305e80c0198bd0f9878f7a823ef534b46f4aff7d403c2adaa0f2109: Status 404 returned error can't find the container with id b59e7a3b9305e80c0198bd0f9878f7a823ef534b46f4aff7d403c2adaa0f2109
Sep 17 17:32:21.958289 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:21.958268    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5fvs6"]
Sep 17 17:32:21.960953 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:32:21.960928    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124f3ca2_a7c1_4341_9057_cbdee0290438.slice/crio-68d6455173f9dd91b645a88db54540422347a66166967803591bc9a4063a5563 WatchSource:0}: Error finding container 68d6455173f9dd91b645a88db54540422347a66166967803591bc9a4063a5563: Status 404 returned error can't find the container with id 68d6455173f9dd91b645a88db54540422347a66166967803591bc9a4063a5563
Sep 17 17:32:22.009888 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:22.009859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5fvs6" event={"ID":"124f3ca2-a7c1-4341-9057-cbdee0290438","Type":"ContainerStarted","Data":"68d6455173f9dd91b645a88db54540422347a66166967803591bc9a4063a5563"}
Sep 17 17:32:22.010955 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:22.010926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zmnd2" event={"ID":"cd07b5db-1573-4198-bc08-54d45e2ed720","Type":"ContainerStarted","Data":"b59e7a3b9305e80c0198bd0f9878f7a823ef534b46f4aff7d403c2adaa0f2109"}
Sep 17 17:32:27.025885 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:27.025849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5fvs6" event={"ID":"124f3ca2-a7c1-4341-9057-cbdee0290438","Type":"ContainerStarted","Data":"87ac7a0f010c41ce0352592629d8f8675a159ff32c7cf0799be0d517d4648627"}
Sep 17 17:32:27.027372 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:27.027339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zmnd2" event={"ID":"cd07b5db-1573-4198-bc08-54d45e2ed720","Type":"ContainerStarted","Data":"8866e633e873c2e9799f6fb28df4ddb6059f2b27cd7f378e494d3fb3fb022b32"}
Sep 17 17:32:27.027503 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:27.027461    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:32:27.043462 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:27.043417    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5fvs6" podStartSLOduration=66.423983649 podStartE2EDuration="1m11.043401571s" totalImagesPullingTime="4.619417922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:32:27.042710668 +0000 UTC m=+73.693616650" watchObservedRunningTime="2026-09-17 17:32:27.043401571 +0000 UTC m=+73.694307562"
Sep 17 17:32:27.060138 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:27.060104    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zmnd2" podStartSLOduration=67.428002204 podStartE2EDuration="1m12.060091571s" totalImagesPullingTime="4.632089367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:32:27.059459531 +0000 UTC m=+73.710365522" watchObservedRunningTime="2026-09-17 17:32:27.060091571 +0000 UTC m=+73.710997541"
Sep 17 17:32:53.808836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:53.808804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:32:53.809229 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:32:53.808914    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:32:53.809229 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:32:53.808968    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls podName:d2703893-5d20-4d4f-88d0-a6f5e28da54b nodeName:}" failed. No retries permitted until 2026-09-17 17:33:57.808953675 +0000 UTC m=+164.459859659 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls") pod "dns-default-c7tsd" (UID: "d2703893-5d20-4d4f-88d0-a6f5e28da54b") : secret "dns-default-metrics-tls" not found
Sep 17 17:32:58.033244 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:32:58.033212    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zmnd2"
Sep 17 17:33:05.404299 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.404265    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"]
Sep 17 17:33:05.406231 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.406208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:05.408767 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.408741    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 17 17:33:05.408878 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.408761    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 17 17:33:05.408998 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.408986    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rg7kr\""
Sep 17 17:33:05.409038 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.409006    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:33:05.418585 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.418566    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"]
Sep 17 17:33:05.481870 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.481844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-l848w\" (UID: \"77cc2621-437b-4b77-aed3-eb773214999f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:05.482020 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.481897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfwn8\" (UniqueName: \"kubernetes.io/projected/77cc2621-437b-4b77-aed3-eb773214999f-kube-api-access-xfwn8\") pod \"cluster-samples-operator-685d7d68b5-l848w\" (UID: \"77cc2621-437b-4b77-aed3-eb773214999f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:05.511524 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.511499    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-8b7rf"]
Sep 17 17:33:05.513363 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.513341    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-8jsfv"]
Sep 17 17:33:05.513475 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.513460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-8b7rf"
Sep 17 17:33:05.515164 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.515138    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.515666 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.515650    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xrmbl\""
Sep 17 17:33:05.518805 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.518786    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 17 17:33:05.518901 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.518817    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:33:05.518901 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.518790    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 17 17:33:05.519123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.519106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 17 17:33:05.519489 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.519475    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-t87ws\""
Sep 17 17:33:05.525220 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.525202    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 17 17:33:05.526928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.526912    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c6974dbd8-qcjzq"]
Sep 17 17:33:05.528455 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.528443    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.531065 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.531047    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b7bq9\""
Sep 17 17:33:05.531736 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.531718    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 17:33:05.531837 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.531760    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 17:33:05.533383 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.533365    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-8b7rf"]
Sep 17 17:33:05.533468 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.533391    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 17:33:05.535747 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.535726    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-8jsfv"]
Sep 17 17:33:05.537330 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.537311    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 17:33:05.553099 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.553073    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c6974dbd8-qcjzq"]
Sep 17 17:33:05.582359 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-l848w\" (UID: \"77cc2621-437b-4b77-aed3-eb773214999f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:05.582517 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c886341-40f2-463a-b622-8ba2cbab30ab-ca-trust-extracted\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.582517 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-trusted-ca\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.582517 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44bdd433-c035-4a3a-998c-989c92d5bb50-config\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.582517 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-installation-pull-secrets\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.582517 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-image-registry-private-configuration\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.582517 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-certificates\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.582814 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z6m5\" (UniqueName: \"kubernetes.io/projected/f6a7ed77-c7a4-4183-87fa-0dd6fc25bdc0-kube-api-access-8z6m5\") pod \"network-check-source-7cbc45fddc-8b7rf\" (UID: \"f6a7ed77-c7a4-4183-87fa-0dd6fc25bdc0\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-8b7rf"
Sep 17 17:33:05.582814 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:05.582478    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 17:33:05.582814 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sql5\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-kube-api-access-4sql5\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.582814 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.582814 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:05.582637    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls podName:77cc2621-437b-4b77-aed3-eb773214999f nodeName:}" failed. No retries permitted until 2026-09-17 17:33:06.082620445 +0000 UTC m=+112.733526439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-l848w" (UID: "77cc2621-437b-4b77-aed3-eb773214999f") : secret "samples-operator-tls" not found
Sep 17 17:33:05.582814 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44bdd433-c035-4a3a-998c-989c92d5bb50-trusted-ca\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.582814 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfwn8\" (UniqueName: \"kubernetes.io/projected/77cc2621-437b-4b77-aed3-eb773214999f-kube-api-access-xfwn8\") pod \"cluster-samples-operator-685d7d68b5-l848w\" (UID: \"77cc2621-437b-4b77-aed3-eb773214999f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:05.582814 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cqjq\" (UniqueName: \"kubernetes.io/projected/44bdd433-c035-4a3a-998c-989c92d5bb50-kube-api-access-7cqjq\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.583113 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-bound-sa-token\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.583113 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.582853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44bdd433-c035-4a3a-998c-989c92d5bb50-serving-cert\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.598216 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.598189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfwn8\" (UniqueName: \"kubernetes.io/projected/77cc2621-437b-4b77-aed3-eb773214999f-kube-api-access-xfwn8\") pod \"cluster-samples-operator-685d7d68b5-l848w\" (UID: \"77cc2621-437b-4b77-aed3-eb773214999f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:05.604038 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.604018    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-c4xqf"]
Sep 17 17:33:05.605755 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.605742    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-c4xqf"
Sep 17 17:33:05.608219 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.608198    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wmzd8\""
Sep 17 17:33:05.608345 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.608227    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:33:05.608505 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.608489    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 17 17:33:05.618209 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.618190    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-c4xqf"]
Sep 17 17:33:05.683626 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.683540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44bdd433-c035-4a3a-998c-989c92d5bb50-trusted-ca\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.683626 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.683601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqjq\" (UniqueName: \"kubernetes.io/projected/44bdd433-c035-4a3a-998c-989c92d5bb50-kube-api-access-7cqjq\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.683626 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.683621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-bound-sa-token\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.683932 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.683649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44bdd433-c035-4a3a-998c-989c92d5bb50-serving-cert\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.683932 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.683692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c886341-40f2-463a-b622-8ba2cbab30ab-ca-trust-extracted\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.683932 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.683736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-trusted-ca\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.684082 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.683929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44bdd433-c035-4a3a-998c-989c92d5bb50-config\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.684082 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.683965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-installation-pull-secrets\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.684082 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.683998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbvvz\" (UniqueName: \"kubernetes.io/projected/d5989aee-c598-43e3-a028-6338582bfa6e-kube-api-access-hbvvz\") pod \"volume-data-source-validator-5c4db8bdf9-c4xqf\" (UID: \"d5989aee-c598-43e3-a028-6338582bfa6e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-c4xqf"
Sep 17 17:33:05.684082 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.684038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-image-registry-private-configuration\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.684082 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.684065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-certificates\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.684323 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.684122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z6m5\" (UniqueName: \"kubernetes.io/projected/f6a7ed77-c7a4-4183-87fa-0dd6fc25bdc0-kube-api-access-8z6m5\") pod \"network-check-source-7cbc45fddc-8b7rf\" (UID: \"f6a7ed77-c7a4-4183-87fa-0dd6fc25bdc0\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-8b7rf"
Sep 17 17:33:05.684323 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.684154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sql5\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-kube-api-access-4sql5\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.684323 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.684191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.684323 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.684128    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c886341-40f2-463a-b622-8ba2cbab30ab-ca-trust-extracted\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.684323 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:05.684307    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:33:05.684323 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:05.684323    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c6974dbd8-qcjzq: secret "image-registry-tls" not found
Sep 17 17:33:05.684607 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:05.684385    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls podName:8c886341-40f2-463a-b622-8ba2cbab30ab nodeName:}" failed. No retries permitted until 2026-09-17 17:33:06.184368882 +0000 UTC m=+112.835274852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls") pod "image-registry-7c6974dbd8-qcjzq" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab") : secret "image-registry-tls" not found
Sep 17 17:33:05.684607 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.684580    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-certificates\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.684748 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.684676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44bdd433-c035-4a3a-998c-989c92d5bb50-trusted-ca\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.684962 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.684937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-trusted-ca\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.685095 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.684989    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44bdd433-c035-4a3a-998c-989c92d5bb50-config\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.686548 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.686517    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-installation-pull-secrets\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.686667 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.686646    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44bdd433-c035-4a3a-998c-989c92d5bb50-serving-cert\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.686729 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.686675    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-image-registry-private-configuration\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.694679 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.694652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-bound-sa-token\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.694887 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.694867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cqjq\" (UniqueName: \"kubernetes.io/projected/44bdd433-c035-4a3a-998c-989c92d5bb50-kube-api-access-7cqjq\") pod \"console-operator-fd4bb46c-8jsfv\" (UID: \"44bdd433-c035-4a3a-998c-989c92d5bb50\") " pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.695106 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.695090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sql5\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-kube-api-access-4sql5\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:05.695675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.695659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z6m5\" (UniqueName: \"kubernetes.io/projected/f6a7ed77-c7a4-4183-87fa-0dd6fc25bdc0-kube-api-access-8z6m5\") pod \"network-check-source-7cbc45fddc-8b7rf\" (UID: \"f6a7ed77-c7a4-4183-87fa-0dd6fc25bdc0\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-8b7rf"
Sep 17 17:33:05.785487 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.785454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbvvz\" (UniqueName: \"kubernetes.io/projected/d5989aee-c598-43e3-a028-6338582bfa6e-kube-api-access-hbvvz\") pod \"volume-data-source-validator-5c4db8bdf9-c4xqf\" (UID: \"d5989aee-c598-43e3-a028-6338582bfa6e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-c4xqf"
Sep 17 17:33:05.794097 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.794070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbvvz\" (UniqueName: \"kubernetes.io/projected/d5989aee-c598-43e3-a028-6338582bfa6e-kube-api-access-hbvvz\") pod \"volume-data-source-validator-5c4db8bdf9-c4xqf\" (UID: \"d5989aee-c598-43e3-a028-6338582bfa6e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-c4xqf"
Sep 17 17:33:05.823927 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.823899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-8b7rf"
Sep 17 17:33:05.828421 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.828401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:05.913978 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:05.913949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-c4xqf"
Sep 17 17:33:06.088410 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:06.088379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-l848w\" (UID: \"77cc2621-437b-4b77-aed3-eb773214999f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:06.088564 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:06.088529    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 17:33:06.088610 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:06.088594    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls podName:77cc2621-437b-4b77-aed3-eb773214999f nodeName:}" failed. No retries permitted until 2026-09-17 17:33:07.088578337 +0000 UTC m=+113.739484312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-l848w" (UID: "77cc2621-437b-4b77-aed3-eb773214999f") : secret "samples-operator-tls" not found
Sep 17 17:33:06.094178 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:06.094153    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-8b7rf"]
Sep 17 17:33:06.096856 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:06.096828    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a7ed77_c7a4_4183_87fa_0dd6fc25bdc0.slice/crio-8f1acb3f5463b76a97ac413516cedd604ca881ef6e854314c72fcec078cb0d9b WatchSource:0}: Error finding container 8f1acb3f5463b76a97ac413516cedd604ca881ef6e854314c72fcec078cb0d9b: Status 404 returned error can't find the container with id 8f1acb3f5463b76a97ac413516cedd604ca881ef6e854314c72fcec078cb0d9b
Sep 17 17:33:06.100745 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:06.100721    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-8jsfv"]
Sep 17 17:33:06.103881 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:06.103842    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44bdd433_c035_4a3a_998c_989c92d5bb50.slice/crio-7ca36ce3cb9cd06133a5ccff1bfb313a25533f43cc4b63669e45d4bf10dc2336 WatchSource:0}: Error finding container 7ca36ce3cb9cd06133a5ccff1bfb313a25533f43cc4b63669e45d4bf10dc2336: Status 404 returned error can't find the container with id 7ca36ce3cb9cd06133a5ccff1bfb313a25533f43cc4b63669e45d4bf10dc2336
Sep 17 17:33:06.124083 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:06.124058    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv" event={"ID":"44bdd433-c035-4a3a-998c-989c92d5bb50","Type":"ContainerStarted","Data":"7ca36ce3cb9cd06133a5ccff1bfb313a25533f43cc4b63669e45d4bf10dc2336"}
Sep 17 17:33:06.125135 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:06.125113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-8b7rf" event={"ID":"f6a7ed77-c7a4-4183-87fa-0dd6fc25bdc0","Type":"ContainerStarted","Data":"8f1acb3f5463b76a97ac413516cedd604ca881ef6e854314c72fcec078cb0d9b"}
Sep 17 17:33:06.186159 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:06.186015    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-c4xqf"]
Sep 17 17:33:06.188362 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:06.188337    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5989aee_c598_43e3_a028_6338582bfa6e.slice/crio-4f943aa442d5f87be73edd8a05f5a98b607d65f223573c93fdf784dc99448080 WatchSource:0}: Error finding container 4f943aa442d5f87be73edd8a05f5a98b607d65f223573c93fdf784dc99448080: Status 404 returned error can't find the container with id 4f943aa442d5f87be73edd8a05f5a98b607d65f223573c93fdf784dc99448080
Sep 17 17:33:06.189316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:06.189295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:06.189462 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:06.189447    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:33:06.189506 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:06.189464    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c6974dbd8-qcjzq: secret "image-registry-tls" not found
Sep 17 17:33:06.189560 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:06.189534    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls podName:8c886341-40f2-463a-b622-8ba2cbab30ab nodeName:}" failed. No retries permitted until 2026-09-17 17:33:07.189512651 +0000 UTC m=+113.840418622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls") pod "image-registry-7c6974dbd8-qcjzq" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab") : secret "image-registry-tls" not found
Sep 17 17:33:07.098500 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:07.098465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-l848w\" (UID: \"77cc2621-437b-4b77-aed3-eb773214999f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:07.098921 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:07.098639    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 17:33:07.098921 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:07.098735    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls podName:77cc2621-437b-4b77-aed3-eb773214999f nodeName:}" failed. No retries permitted until 2026-09-17 17:33:09.098715431 +0000 UTC m=+115.749621415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-l848w" (UID: "77cc2621-437b-4b77-aed3-eb773214999f") : secret "samples-operator-tls" not found
Sep 17 17:33:07.130118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:07.130081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-8b7rf" event={"ID":"f6a7ed77-c7a4-4183-87fa-0dd6fc25bdc0","Type":"ContainerStarted","Data":"25365cbb7909f489d68616df9278722d74575cf24ed0dbf883c9d2d49697f241"}
Sep 17 17:33:07.131422 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:07.131389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-c4xqf" event={"ID":"d5989aee-c598-43e3-a028-6338582bfa6e","Type":"ContainerStarted","Data":"4f943aa442d5f87be73edd8a05f5a98b607d65f223573c93fdf784dc99448080"}
Sep 17 17:33:07.153289 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:07.153239    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-8b7rf" podStartSLOduration=2.153218808 podStartE2EDuration="2.153218808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:07.152634689 +0000 UTC m=+113.803540681" watchObservedRunningTime="2026-09-17 17:33:07.153218808 +0000 UTC m=+113.804124802"
Sep 17 17:33:07.199366 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:07.199340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:07.199523 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:07.199507    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:33:07.199523 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:07.199524    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c6974dbd8-qcjzq: secret "image-registry-tls" not found
Sep 17 17:33:07.199661 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:07.199571    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls podName:8c886341-40f2-463a-b622-8ba2cbab30ab nodeName:}" failed. No retries permitted until 2026-09-17 17:33:09.199558009 +0000 UTC m=+115.850463979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls") pod "image-registry-7c6974dbd8-qcjzq" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab") : secret "image-registry-tls" not found
Sep 17 17:33:08.141500 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:08.141455    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-c4xqf" event={"ID":"d5989aee-c598-43e3-a028-6338582bfa6e","Type":"ContainerStarted","Data":"07e070970ae173c8ca039f0aa2fe698e1738b26de6a3543f0c2da52127aee54c"}
Sep 17 17:33:08.165993 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:08.165936    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-c4xqf" podStartSLOduration=2.218629746 podStartE2EDuration="3.165919843s" totalImagesPullingTime="947.290097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:08.165299209 +0000 UTC m=+114.816205205" watchObservedRunningTime="2026-09-17 17:33:08.165919843 +0000 UTC m=+114.816825874"
Sep 17 17:33:09.113601 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:09.113550    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-l848w\" (UID: \"77cc2621-437b-4b77-aed3-eb773214999f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:09.113839 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:09.113756    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 17:33:09.113914 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:09.113845    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls podName:77cc2621-437b-4b77-aed3-eb773214999f nodeName:}" failed. No retries permitted until 2026-09-17 17:33:13.113824215 +0000 UTC m=+119.764730198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-l848w" (UID: "77cc2621-437b-4b77-aed3-eb773214999f") : secret "samples-operator-tls" not found
Sep 17 17:33:09.145863 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:09.145836    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/0.log"
Sep 17 17:33:09.146191 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:09.145871    2563 generic.go:356] "Generic (PLEG): container finished" podID="44bdd433-c035-4a3a-998c-989c92d5bb50" containerID="6c52bc8cc91a7aaee0c033de09b5c0104b138668d4d64f86533bd4f50140548f" exitCode=255
Sep 17 17:33:09.146191 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:09.145901    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv" event={"ID":"44bdd433-c035-4a3a-998c-989c92d5bb50","Type":"ContainerDied","Data":"6c52bc8cc91a7aaee0c033de09b5c0104b138668d4d64f86533bd4f50140548f"}
Sep 17 17:33:09.146288 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:09.146224    2563 scope.go:117] "RemoveContainer" containerID="6c52bc8cc91a7aaee0c033de09b5c0104b138668d4d64f86533bd4f50140548f"
Sep 17 17:33:09.214011 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:09.213988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:09.214160 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:09.214129    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:33:09.214160 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:09.214151    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c6974dbd8-qcjzq: secret "image-registry-tls" not found
Sep 17 17:33:09.214311 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:09.214211    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls podName:8c886341-40f2-463a-b622-8ba2cbab30ab nodeName:}" failed. No retries permitted until 2026-09-17 17:33:13.214194039 +0000 UTC m=+119.865100028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls") pod "image-registry-7c6974dbd8-qcjzq" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab") : secret "image-registry-tls" not found
Sep 17 17:33:10.140915 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.140882    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-npr75"]
Sep 17 17:33:10.142948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.142928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.145495 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.145475    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 17:33:10.145606 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.145479    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 17:33:10.145923 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.145906    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tztbm\""
Sep 17 17:33:10.146246 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.146237    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 17:33:10.146310 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.146255    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 17:33:10.150881 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.150866    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:33:10.151323 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.151296    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/0.log"
Sep 17 17:33:10.151412 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.151340    2563 generic.go:356] "Generic (PLEG): container finished" podID="44bdd433-c035-4a3a-998c-989c92d5bb50" containerID="506fed00b94ab9705169e721c377579000c068b6f4424993697f77a3531a0225" exitCode=255
Sep 17 17:33:10.151412 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.151368    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv" event={"ID":"44bdd433-c035-4a3a-998c-989c92d5bb50","Type":"ContainerDied","Data":"506fed00b94ab9705169e721c377579000c068b6f4424993697f77a3531a0225"}
Sep 17 17:33:10.151517 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.151424    2563 scope.go:117] "RemoveContainer" containerID="6c52bc8cc91a7aaee0c033de09b5c0104b138668d4d64f86533bd4f50140548f"
Sep 17 17:33:10.151633 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.151618    2563 scope.go:117] "RemoveContainer" containerID="506fed00b94ab9705169e721c377579000c068b6f4424993697f77a3531a0225"
Sep 17 17:33:10.151823 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:10.151801    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-8jsfv_openshift-console-operator(44bdd433-c035-4a3a-998c-989c92d5bb50)\"" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv" podUID="44bdd433-c035-4a3a-998c-989c92d5bb50"
Sep 17 17:33:10.163371 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.163298    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-npr75"]
Sep 17 17:33:10.220404 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.220380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/badc9616-73e0-4ec8-a359-cd87b537e4f0-data-volume\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.220500 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.220438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.220560 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.220497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/badc9616-73e0-4ec8-a359-cd87b537e4f0-crio-socket\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.220560 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.220523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.220624 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.220597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrtdb\" (UniqueName: \"kubernetes.io/projected/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-api-access-rrtdb\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.321771 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.321727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.321929 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.321795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/badc9616-73e0-4ec8-a359-cd87b537e4f0-crio-socket\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.321929 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.321814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.321929 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.321858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrtdb\" (UniqueName: \"kubernetes.io/projected/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-api-access-rrtdb\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.321929 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:10.321872    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:10.321929 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.321916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/badc9616-73e0-4ec8-a359-cd87b537e4f0-crio-socket\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.322108 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:10.321935    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:33:10.322108 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.321919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/badc9616-73e0-4ec8-a359-cd87b537e4f0-data-volume\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.322108 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:10.321938    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls podName:badc9616-73e0-4ec8-a359-cd87b537e4f0 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:10.821919795 +0000 UTC m=+117.472825782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npr75" (UID: "badc9616-73e0-4ec8-a359-cd87b537e4f0") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:10.322108 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:10.322010    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm podName:badc9616-73e0-4ec8-a359-cd87b537e4f0 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:10.821995776 +0000 UTC m=+117.472901750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-npr75" (UID: "badc9616-73e0-4ec8-a359-cd87b537e4f0") : configmap "kube-rbac-proxy" not found
Sep 17 17:33:10.322276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.322261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/badc9616-73e0-4ec8-a359-cd87b537e4f0-data-volume\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.333163 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.333142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrtdb\" (UniqueName: \"kubernetes.io/projected/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-api-access-rrtdb\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.826502 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.826459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.826789 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:10.826523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:10.826789 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:10.826594    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:10.826789 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:10.826609    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:33:10.826789 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:10.826669    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls podName:badc9616-73e0-4ec8-a359-cd87b537e4f0 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:11.826651832 +0000 UTC m=+118.477557810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npr75" (UID: "badc9616-73e0-4ec8-a359-cd87b537e4f0") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:10.826789 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:10.826687    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm podName:badc9616-73e0-4ec8-a359-cd87b537e4f0 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:11.826678868 +0000 UTC m=+118.477584843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-npr75" (UID: "badc9616-73e0-4ec8-a359-cd87b537e4f0") : configmap "kube-rbac-proxy" not found
Sep 17 17:33:11.155948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:11.155874    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:33:11.156297 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:11.156202    2563 scope.go:117] "RemoveContainer" containerID="506fed00b94ab9705169e721c377579000c068b6f4424993697f77a3531a0225"
Sep 17 17:33:11.156355 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:11.156337    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-8jsfv_openshift-console-operator(44bdd433-c035-4a3a-998c-989c92d5bb50)\"" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv" podUID="44bdd433-c035-4a3a-998c-989c92d5bb50"
Sep 17 17:33:11.834017 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:11.833981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:11.834186 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:11.834034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:11.834186 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:11.834128    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:11.834186 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:11.834159    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:33:11.834293 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:11.834197    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls podName:badc9616-73e0-4ec8-a359-cd87b537e4f0 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:13.834182135 +0000 UTC m=+120.485088104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npr75" (UID: "badc9616-73e0-4ec8-a359-cd87b537e4f0") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:11.834293 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:11.834211    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm podName:badc9616-73e0-4ec8-a359-cd87b537e4f0 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:13.834204631 +0000 UTC m=+120.485110601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-npr75" (UID: "badc9616-73e0-4ec8-a359-cd87b537e4f0") : configmap "kube-rbac-proxy" not found
Sep 17 17:33:12.636571 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:12.636545    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8dcd2_45dcbf30-6c5f-44a5-a37c-74825385a0de/dns-node-resolver/0.log"
Sep 17 17:33:12.920428 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:12.920351    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-zpdtp"]
Sep 17 17:33:12.923174 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:12.923159    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp"
Sep 17 17:33:12.925927 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:12.925908    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 17:33:12.925927 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:12.925917    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 17:33:12.926073 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:12.925987    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 17:33:12.927050 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:12.927037    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 17:33:12.927159 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:12.927140    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kt9d5\""
Sep 17 17:33:12.933628 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:12.933608    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-zpdtp"]
Sep 17 17:33:13.043164 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.043133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35ce2cc9-4232-4bab-b309-e970ecf2843d-signing-cabundle\") pod \"service-ca-55f6fc7b86-zpdtp\" (UID: \"35ce2cc9-4232-4bab-b309-e970ecf2843d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp"
Sep 17 17:33:13.043329 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.043200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35ce2cc9-4232-4bab-b309-e970ecf2843d-signing-key\") pod \"service-ca-55f6fc7b86-zpdtp\" (UID: \"35ce2cc9-4232-4bab-b309-e970ecf2843d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp"
Sep 17 17:33:13.043329 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.043247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2257s\" (UniqueName: \"kubernetes.io/projected/35ce2cc9-4232-4bab-b309-e970ecf2843d-kube-api-access-2257s\") pod \"service-ca-55f6fc7b86-zpdtp\" (UID: \"35ce2cc9-4232-4bab-b309-e970ecf2843d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp"
Sep 17 17:33:13.144461 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.144429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2257s\" (UniqueName: \"kubernetes.io/projected/35ce2cc9-4232-4bab-b309-e970ecf2843d-kube-api-access-2257s\") pod \"service-ca-55f6fc7b86-zpdtp\" (UID: \"35ce2cc9-4232-4bab-b309-e970ecf2843d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp"
Sep 17 17:33:13.144597 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.144473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35ce2cc9-4232-4bab-b309-e970ecf2843d-signing-cabundle\") pod \"service-ca-55f6fc7b86-zpdtp\" (UID: \"35ce2cc9-4232-4bab-b309-e970ecf2843d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp"
Sep 17 17:33:13.144597 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.144529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35ce2cc9-4232-4bab-b309-e970ecf2843d-signing-key\") pod \"service-ca-55f6fc7b86-zpdtp\" (UID: \"35ce2cc9-4232-4bab-b309-e970ecf2843d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp"
Sep 17 17:33:13.144597 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.144568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-l848w\" (UID: \"77cc2621-437b-4b77-aed3-eb773214999f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:13.144696 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:13.144652    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 17:33:13.144751 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:13.144720    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls podName:77cc2621-437b-4b77-aed3-eb773214999f nodeName:}" failed. No retries permitted until 2026-09-17 17:33:21.14468808 +0000 UTC m=+127.795594050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-l848w" (UID: "77cc2621-437b-4b77-aed3-eb773214999f") : secret "samples-operator-tls" not found
Sep 17 17:33:13.145260 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.145242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35ce2cc9-4232-4bab-b309-e970ecf2843d-signing-cabundle\") pod \"service-ca-55f6fc7b86-zpdtp\" (UID: \"35ce2cc9-4232-4bab-b309-e970ecf2843d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp"
Sep 17 17:33:13.146938 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.146922    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35ce2cc9-4232-4bab-b309-e970ecf2843d-signing-key\") pod \"service-ca-55f6fc7b86-zpdtp\" (UID: \"35ce2cc9-4232-4bab-b309-e970ecf2843d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp"
Sep 17 17:33:13.153490 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.153472    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2257s\" (UniqueName: \"kubernetes.io/projected/35ce2cc9-4232-4bab-b309-e970ecf2843d-kube-api-access-2257s\") pod \"service-ca-55f6fc7b86-zpdtp\" (UID: \"35ce2cc9-4232-4bab-b309-e970ecf2843d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp"
Sep 17 17:33:13.231896 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.231820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp"
Sep 17 17:33:13.245891 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.245861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:13.246062 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:13.246037    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:33:13.246156 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:13.246080    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c6974dbd8-qcjzq: secret "image-registry-tls" not found
Sep 17 17:33:13.246156 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:13.246151    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls podName:8c886341-40f2-463a-b622-8ba2cbab30ab nodeName:}" failed. No retries permitted until 2026-09-17 17:33:21.246129485 +0000 UTC m=+127.897035475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls") pod "image-registry-7c6974dbd8-qcjzq" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab") : secret "image-registry-tls" not found
Sep 17 17:33:13.506892 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.506806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-zpdtp"]
Sep 17 17:33:13.510410 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:13.510377    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ce2cc9_4232_4bab_b309_e970ecf2843d.slice/crio-95b8526d5c39d492cb13fe3771ded0d0320d8f7a4ddc21899327723f9f82455b WatchSource:0}: Error finding container 95b8526d5c39d492cb13fe3771ded0d0320d8f7a4ddc21899327723f9f82455b: Status 404 returned error can't find the container with id 95b8526d5c39d492cb13fe3771ded0d0320d8f7a4ddc21899327723f9f82455b
Sep 17 17:33:13.836546 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.836520    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-96rtm_72664012-dccc-49e5-b790-333fd5db999f/node-ca/0.log"
Sep 17 17:33:13.850844 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.850819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:13.850972 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:13.850857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:13.850972 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:13.850957    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:33:13.851047 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:13.850975    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:13.851047 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:13.851014    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm podName:badc9616-73e0-4ec8-a359-cd87b537e4f0 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:17.851000633 +0000 UTC m=+124.501906604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-npr75" (UID: "badc9616-73e0-4ec8-a359-cd87b537e4f0") : configmap "kube-rbac-proxy" not found
Sep 17 17:33:13.851047 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:13.851026    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls podName:badc9616-73e0-4ec8-a359-cd87b537e4f0 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:17.851020692 +0000 UTC m=+124.501926662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npr75" (UID: "badc9616-73e0-4ec8-a359-cd87b537e4f0") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:14.166247 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:14.166164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp" event={"ID":"35ce2cc9-4232-4bab-b309-e970ecf2843d","Type":"ContainerStarted","Data":"95b8526d5c39d492cb13fe3771ded0d0320d8f7a4ddc21899327723f9f82455b"}
Sep 17 17:33:14.436511 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:14.436428    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-97vgb_83175e6e-f6e0-49dc-986b-b05ebe54fbef/serve-healthcheck-canary/0.log"
Sep 17 17:33:15.829188 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:15.829141    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:15.829515 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:15.829209    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:15.829515 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:15.829496    2563 scope.go:117] "RemoveContainer" containerID="506fed00b94ab9705169e721c377579000c068b6f4424993697f77a3531a0225"
Sep 17 17:33:15.829653 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:15.829633    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-8jsfv_openshift-console-operator(44bdd433-c035-4a3a-998c-989c92d5bb50)\"" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv" podUID="44bdd433-c035-4a3a-998c-989c92d5bb50"
Sep 17 17:33:16.175967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:16.175877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp" event={"ID":"35ce2cc9-4232-4bab-b309-e970ecf2843d","Type":"ContainerStarted","Data":"eef488d71974efb195cf9d81d035e03b8dfa315820ff34faa97869d9c2abc2e6"}
Sep 17 17:33:16.203983 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:16.203930    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-zpdtp" podStartSLOduration=2.486237627 podStartE2EDuration="4.203909909s" totalImagesPullingTime="1.717672282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:16.202378175 +0000 UTC m=+122.853284170" watchObservedRunningTime="2026-09-17 17:33:16.203909909 +0000 UTC m=+122.854815902"
Sep 17 17:33:17.881764 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:17.881734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:17.882130 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:17.881774    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:17.882130 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:17.881846    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:33:17.882130 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:17.881871    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:17.882130 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:17.881898    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm podName:badc9616-73e0-4ec8-a359-cd87b537e4f0 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:25.881884766 +0000 UTC m=+132.532790748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-npr75" (UID: "badc9616-73e0-4ec8-a359-cd87b537e4f0") : configmap "kube-rbac-proxy" not found
Sep 17 17:33:17.882130 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:17.881926    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls podName:badc9616-73e0-4ec8-a359-cd87b537e4f0 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:25.881913285 +0000 UTC m=+132.532819255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npr75" (UID: "badc9616-73e0-4ec8-a359-cd87b537e4f0") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:21.209591 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:21.209557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-l848w\" (UID: \"77cc2621-437b-4b77-aed3-eb773214999f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:21.212078 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:21.212054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77cc2621-437b-4b77-aed3-eb773214999f-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-l848w\" (UID: \"77cc2621-437b-4b77-aed3-eb773214999f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:21.310645 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:21.310621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:21.312920 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:21.312897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls\") pod \"image-registry-7c6974dbd8-qcjzq\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") " pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:21.317737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:21.317712    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rg7kr\""
Sep 17 17:33:21.325812 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:21.325795    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"
Sep 17 17:33:21.440236 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:21.440207    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b7bq9\""
Sep 17 17:33:21.448247 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:21.448216    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:21.612172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:21.612147    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w"]
Sep 17 17:33:21.722492 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:21.722461    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c6974dbd8-qcjzq"]
Sep 17 17:33:21.725896 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:21.725875    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c886341_40f2_463a_b622_8ba2cbab30ab.slice/crio-86242d879f1d5def72ba2d6730ec7cf227a4b1332fd3cc7b5c873238b4d0c0dc WatchSource:0}: Error finding container 86242d879f1d5def72ba2d6730ec7cf227a4b1332fd3cc7b5c873238b4d0c0dc: Status 404 returned error can't find the container with id 86242d879f1d5def72ba2d6730ec7cf227a4b1332fd3cc7b5c873238b4d0c0dc
Sep 17 17:33:22.198306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:22.197853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w" event={"ID":"77cc2621-437b-4b77-aed3-eb773214999f","Type":"ContainerStarted","Data":"6408aa1ad53fb23dfbbfbfa0c4958b2437afc62f3547884c60a0aff21774d260"}
Sep 17 17:33:22.199885 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:22.199850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq" event={"ID":"8c886341-40f2-463a-b622-8ba2cbab30ab","Type":"ContainerStarted","Data":"aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e"}
Sep 17 17:33:22.200010 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:22.199908    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq" event={"ID":"8c886341-40f2-463a-b622-8ba2cbab30ab","Type":"ContainerStarted","Data":"86242d879f1d5def72ba2d6730ec7cf227a4b1332fd3cc7b5c873238b4d0c0dc"}
Sep 17 17:33:22.200075 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:22.200036    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:33:22.222509 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:22.222459    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq" podStartSLOduration=17.222445216 podStartE2EDuration="17.222445216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:22.220930676 +0000 UTC m=+128.871836670" watchObservedRunningTime="2026-09-17 17:33:22.222445216 +0000 UTC m=+128.873351221"
Sep 17 17:33:23.204882 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:23.204851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w" event={"ID":"77cc2621-437b-4b77-aed3-eb773214999f","Type":"ContainerStarted","Data":"03b2a0f46775acc45fcde5663cd00782dcef9a130cc33b40ff64a41118075a53"}
Sep 17 17:33:24.214415 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:24.214376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w" event={"ID":"77cc2621-437b-4b77-aed3-eb773214999f","Type":"ContainerStarted","Data":"6302ea03d2535bfb09767fe14c52aa0989dca89f23476dbcd82e79b50fa2683f"}
Sep 17 17:33:24.239426 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:24.239375    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-l848w" podStartSLOduration=17.766758718 podStartE2EDuration="19.239359788s" totalImagesPullingTime="1.47260107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:24.238880392 +0000 UTC m=+130.889786387" watchObservedRunningTime="2026-09-17 17:33:24.239359788 +0000 UTC m=+130.890265780"
Sep 17 17:33:25.447970 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:25.447933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:33:25.450245 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:25.450216    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adef32ee-aef3-4bdd-a6df-62f66b8b7466-metrics-certs\") pod \"network-metrics-daemon-xhm5z\" (UID: \"adef32ee-aef3-4bdd-a6df-62f66b8b7466\") " pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:33:25.529817 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:25.529786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-js6ht\""
Sep 17 17:33:25.537944 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:25.537926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xhm5z"
Sep 17 17:33:25.808949 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:25.808923    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xhm5z"]
Sep 17 17:33:25.811925 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:25.811898    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadef32ee_aef3_4bdd_a6df_62f66b8b7466.slice/crio-bdce35c09a5fe088fd71039f3435cfc226653614a77b978e01b6f934bcb7650d WatchSource:0}: Error finding container bdce35c09a5fe088fd71039f3435cfc226653614a77b978e01b6f934bcb7650d: Status 404 returned error can't find the container with id bdce35c09a5fe088fd71039f3435cfc226653614a77b978e01b6f934bcb7650d
Sep 17 17:33:25.952040 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:25.952013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:25.952188 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:25.952052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:25.952188 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:25.952163    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:25.952257 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:25.952237    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls podName:badc9616-73e0-4ec8-a359-cd87b537e4f0 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:41.952219706 +0000 UTC m=+148.603125695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npr75" (UID: "badc9616-73e0-4ec8-a359-cd87b537e4f0") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:25.952519 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:25.952502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/badc9616-73e0-4ec8-a359-cd87b537e4f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:26.221046 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:26.220971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xhm5z" event={"ID":"adef32ee-aef3-4bdd-a6df-62f66b8b7466","Type":"ContainerStarted","Data":"bdce35c09a5fe088fd71039f3435cfc226653614a77b978e01b6f934bcb7650d"}
Sep 17 17:33:27.226165 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:27.226078    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xhm5z" event={"ID":"adef32ee-aef3-4bdd-a6df-62f66b8b7466","Type":"ContainerStarted","Data":"0ee294a73765261b914cefdcf43e9bfe0d56e46ecaa19199fd0587283a936d50"}
Sep 17 17:33:27.226165 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:27.226138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xhm5z" event={"ID":"adef32ee-aef3-4bdd-a6df-62f66b8b7466","Type":"ContainerStarted","Data":"09f287d6ea0269a255851dede977b65f94b14b9452fdc73086f56bd82d1fe281"}
Sep 17 17:33:27.247778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:27.247725    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xhm5z" podStartSLOduration=131.224949444 podStartE2EDuration="2m12.247670798s" totalImagesPullingTime="1.022721354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:27.246644521 +0000 UTC m=+133.897550515" watchObservedRunningTime="2026-09-17 17:33:27.247670798 +0000 UTC m=+133.898576790"
Sep 17 17:33:30.608354 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:30.608315    2563 scope.go:117] "RemoveContainer" containerID="506fed00b94ab9705169e721c377579000c068b6f4424993697f77a3531a0225"
Sep 17 17:33:31.241126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:31.241098    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:33:31.241307 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:31.241174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv" event={"ID":"44bdd433-c035-4a3a-998c-989c92d5bb50","Type":"ContainerStarted","Data":"97b09d8fb83cf4c9a0425f0d446f8d1be1060ec93ec3802db7b2f02dc1e82a61"}
Sep 17 17:33:31.241576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:31.241536    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:31.246129 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:31.246097    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv"
Sep 17 17:33:31.276754 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:31.276696    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-8jsfv" podStartSLOduration=24.178927532 podStartE2EDuration="26.276678557s" totalImagesPullingTime="2.097751025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:31.274733504 +0000 UTC m=+137.925639498" watchObservedRunningTime="2026-09-17 17:33:31.276678557 +0000 UTC m=+137.927584550"
Sep 17 17:33:35.061055 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.061018    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c6974dbd8-qcjzq"]
Sep 17 17:33:35.079377 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.079349    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-b5g8t"]
Sep 17 17:33:35.082392 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.082375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-b5g8t"
Sep 17 17:33:35.084573 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.084549    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 17:33:35.084764 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.084736    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5nrgz\""
Sep 17 17:33:35.084886 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.084788    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 17:33:35.103455 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.103431    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-b5g8t"]
Sep 17 17:33:35.113978 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.113952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpb5h\" (UniqueName: \"kubernetes.io/projected/0ba03747-7a71-4e16-9a60-c7ce6e487a35-kube-api-access-mpb5h\") pod \"downloads-6594f4c75-b5g8t\" (UID: \"0ba03747-7a71-4e16-9a60-c7ce6e487a35\") " pod="openshift-console/downloads-6594f4c75-b5g8t"
Sep 17 17:33:35.214714 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.214672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpb5h\" (UniqueName: \"kubernetes.io/projected/0ba03747-7a71-4e16-9a60-c7ce6e487a35-kube-api-access-mpb5h\") pod \"downloads-6594f4c75-b5g8t\" (UID: \"0ba03747-7a71-4e16-9a60-c7ce6e487a35\") " pod="openshift-console/downloads-6594f4c75-b5g8t"
Sep 17 17:33:35.224093 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.224069    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpb5h\" (UniqueName: \"kubernetes.io/projected/0ba03747-7a71-4e16-9a60-c7ce6e487a35-kube-api-access-mpb5h\") pod \"downloads-6594f4c75-b5g8t\" (UID: \"0ba03747-7a71-4e16-9a60-c7ce6e487a35\") " pod="openshift-console/downloads-6594f4c75-b5g8t"
Sep 17 17:33:35.392947 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.392866    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-b5g8t"
Sep 17 17:33:35.663764 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:35.663678    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-b5g8t"]
Sep 17 17:33:35.666135 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:35.666107    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba03747_7a71_4e16_9a60_c7ce6e487a35.slice/crio-b26967fe2f191c056fbd10c5286ba825926811f1a610bcba9a16f8e573d6c368 WatchSource:0}: Error finding container b26967fe2f191c056fbd10c5286ba825926811f1a610bcba9a16f8e573d6c368: Status 404 returned error can't find the container with id b26967fe2f191c056fbd10c5286ba825926811f1a610bcba9a16f8e573d6c368
Sep 17 17:33:36.261986 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:36.261947    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-b5g8t" event={"ID":"0ba03747-7a71-4e16-9a60-c7ce6e487a35","Type":"ContainerStarted","Data":"b26967fe2f191c056fbd10c5286ba825926811f1a610bcba9a16f8e573d6c368"}
Sep 17 17:33:39.422425 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.422382    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58bc487546-qr2jw"]
Sep 17 17:33:39.425825 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.425799    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.428257 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.428222    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 17:33:39.429334 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.429307    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 17:33:39.429611 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.429586    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 17:33:39.429998 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.429975    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 17:33:39.430293 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.430275    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5wqgz\""
Sep 17 17:33:39.430380 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.430356    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 17:33:39.441767 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.441744    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58bc487546-qr2jw"]
Sep 17 17:33:39.445545 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.445518    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-oauth-config\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.445650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.445560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-config\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.445650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.445586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxqrb\" (UniqueName: \"kubernetes.io/projected/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-kube-api-access-gxqrb\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.445796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.445679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-serving-cert\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.445796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.445777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-service-ca\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.445891 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.445821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-oauth-serving-cert\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.546996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.546962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-oauth-config\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.546996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.546996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-config\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.546996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.547013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqrb\" (UniqueName: \"kubernetes.io/projected/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-kube-api-access-gxqrb\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.547285 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.547246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-serving-cert\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.547386 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.547360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-service-ca\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.547523 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.547416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-oauth-serving-cert\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.547911 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.547866    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-config\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.548143 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.548079    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-service-ca\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.548453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.548429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-oauth-serving-cert\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.550047 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.550017    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-oauth-config\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.550144 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.550126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-serving-cert\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.556478 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.556432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxqrb\" (UniqueName: \"kubernetes.io/projected/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-kube-api-access-gxqrb\") pod \"console-58bc487546-qr2jw\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") " pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.740090 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.740016    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:39.777859 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.777817    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk"]
Sep 17 17:33:39.782214 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.782183    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk"
Sep 17 17:33:39.784924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.784751    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 17 17:33:39.784924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.784847    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v8tqg\""
Sep 17 17:33:39.793317 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.792972    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk"]
Sep 17 17:33:39.849893 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.849862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5cfe22e0-8a35-4f49-9a18-a009adf23c4d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-wzmsk\" (UID: \"5cfe22e0-8a35-4f49-9a18-a009adf23c4d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk"
Sep 17 17:33:39.951075 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.951035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5cfe22e0-8a35-4f49-9a18-a009adf23c4d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-wzmsk\" (UID: \"5cfe22e0-8a35-4f49-9a18-a009adf23c4d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk"
Sep 17 17:33:39.953813 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:39.953781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5cfe22e0-8a35-4f49-9a18-a009adf23c4d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-wzmsk\" (UID: \"5cfe22e0-8a35-4f49-9a18-a009adf23c4d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk"
Sep 17 17:33:40.023770 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:40.023742    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58bc487546-qr2jw"]
Sep 17 17:33:40.028394 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:40.028364    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2c9223_9d59_408a_bc8c_3e5195fa7b0b.slice/crio-1e69fd4240d61a26b8ac61407516c5e6218f8172700e017d2893e3c12dc8261c WatchSource:0}: Error finding container 1e69fd4240d61a26b8ac61407516c5e6218f8172700e017d2893e3c12dc8261c: Status 404 returned error can't find the container with id 1e69fd4240d61a26b8ac61407516c5e6218f8172700e017d2893e3c12dc8261c
Sep 17 17:33:40.095000 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:40.094966    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk"
Sep 17 17:33:40.277026 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:40.276953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bc487546-qr2jw" event={"ID":"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b","Type":"ContainerStarted","Data":"1e69fd4240d61a26b8ac61407516c5e6218f8172700e017d2893e3c12dc8261c"}
Sep 17 17:33:40.370110 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:40.369972    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk"]
Sep 17 17:33:40.372367 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:40.372345    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfe22e0_8a35_4f49_9a18_a009adf23c4d.slice/crio-fab744d491aaf8588fe5450929f1dca5f14341a054a18d80379be8485199e9c4 WatchSource:0}: Error finding container fab744d491aaf8588fe5450929f1dca5f14341a054a18d80379be8485199e9c4: Status 404 returned error can't find the container with id fab744d491aaf8588fe5450929f1dca5f14341a054a18d80379be8485199e9c4
Sep 17 17:33:41.284377 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:41.284302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk" event={"ID":"5cfe22e0-8a35-4f49-9a18-a009adf23c4d","Type":"ContainerStarted","Data":"fab744d491aaf8588fe5450929f1dca5f14341a054a18d80379be8485199e9c4"}
Sep 17 17:33:41.971089 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:41.970492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:41.975332 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:41.975304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/badc9616-73e0-4ec8-a359-cd87b537e4f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npr75\" (UID: \"badc9616-73e0-4ec8-a359-cd87b537e4f0\") " pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:42.254428 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.254355    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tztbm\""
Sep 17 17:33:42.262343 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.262322    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-npr75"
Sep 17 17:33:42.289774 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.289742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk" event={"ID":"5cfe22e0-8a35-4f49-9a18-a009adf23c4d","Type":"ContainerStarted","Data":"eb1c29206169c7a8451b651d14e04e0a3afdb93eff184a9842627812a429683f"}
Sep 17 17:33:42.290117 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.289917    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk"
Sep 17 17:33:42.295000 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.294978    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk"
Sep 17 17:33:42.306798 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.306753    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-wzmsk" podStartSLOduration=2.041427079 podStartE2EDuration="3.306737538s" totalImagesPullingTime="1.265310459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:42.30604605 +0000 UTC m=+148.956952042" watchObservedRunningTime="2026-09-17 17:33:42.306737538 +0000 UTC m=+148.957643530"
Sep 17 17:33:42.832687 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.832609    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"]
Sep 17 17:33:42.839724 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.839423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:42.842126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.841889    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 17 17:33:42.842126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.841916    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 17:33:42.842126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.841943    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 17 17:33:42.842126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.841991    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 17:33:42.842930 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.842865    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 17:33:42.842930 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.842865    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hx5x4\""
Sep 17 17:33:42.846131 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.846069    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"]
Sep 17 17:33:42.878686 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.878655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0ca7a25-2717-45be-bcbb-3184cf094aa1-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:42.878831 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.878741    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0ca7a25-2717-45be-bcbb-3184cf094aa1-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:42.878831 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.878769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhplh\" (UniqueName: \"kubernetes.io/projected/e0ca7a25-2717-45be-bcbb-3184cf094aa1-kube-api-access-lhplh\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:42.878831 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.878823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0ca7a25-2717-45be-bcbb-3184cf094aa1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:42.979672 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.979456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0ca7a25-2717-45be-bcbb-3184cf094aa1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:42.979672 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.979523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0ca7a25-2717-45be-bcbb-3184cf094aa1-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:42.979672 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.979570    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0ca7a25-2717-45be-bcbb-3184cf094aa1-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:42.979672 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.979594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhplh\" (UniqueName: \"kubernetes.io/projected/e0ca7a25-2717-45be-bcbb-3184cf094aa1-kube-api-access-lhplh\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:42.980106 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:42.979768    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 17 17:33:42.980106 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:42.979845    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ca7a25-2717-45be-bcbb-3184cf094aa1-prometheus-operator-tls podName:e0ca7a25-2717-45be-bcbb-3184cf094aa1 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:43.479823396 +0000 UTC m=+150.130729369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e0ca7a25-2717-45be-bcbb-3184cf094aa1-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-6cq72" (UID: "e0ca7a25-2717-45be-bcbb-3184cf094aa1") : secret "prometheus-operator-tls" not found
Sep 17 17:33:42.980616 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.980592    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0ca7a25-2717-45be-bcbb-3184cf094aa1-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:42.983655 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.983617    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0ca7a25-2717-45be-bcbb-3184cf094aa1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:42.989299 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:42.989251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhplh\" (UniqueName: \"kubernetes.io/projected/e0ca7a25-2717-45be-bcbb-3184cf094aa1-kube-api-access-lhplh\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:43.483316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:43.483272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0ca7a25-2717-45be-bcbb-3184cf094aa1-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:43.485916 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:43.485869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0ca7a25-2717-45be-bcbb-3184cf094aa1-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-6cq72\" (UID: \"e0ca7a25-2717-45be-bcbb-3184cf094aa1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:43.753018 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:43.752936    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"
Sep 17 17:33:44.993142 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:44.993114    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72"]
Sep 17 17:33:44.995864 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:44.995840    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-npr75"]
Sep 17 17:33:44.996348 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:44.996310    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ca7a25_2717_45be_bcbb_3184cf094aa1.slice/crio-0c9e6285d4ee2d198157b7dc9d29e4c0b6a3d18c3118640471370f33196bee91 WatchSource:0}: Error finding container 0c9e6285d4ee2d198157b7dc9d29e4c0b6a3d18c3118640471370f33196bee91: Status 404 returned error can't find the container with id 0c9e6285d4ee2d198157b7dc9d29e4c0b6a3d18c3118640471370f33196bee91
Sep 17 17:33:44.998606 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:44.998517    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbadc9616_73e0_4ec8_a359_cd87b537e4f0.slice/crio-d6e45e281cb133a2afd05b84f262738fea68a3a5c7d1bd8b802a89332788c383 WatchSource:0}: Error finding container d6e45e281cb133a2afd05b84f262738fea68a3a5c7d1bd8b802a89332788c383: Status 404 returned error can't find the container with id d6e45e281cb133a2afd05b84f262738fea68a3a5c7d1bd8b802a89332788c383
Sep 17 17:33:45.067415 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:45.067388    2563 patch_prober.go:28] interesting pod/image-registry-7c6974dbd8-qcjzq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 17:33:45.067507 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:45.067440    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq" podUID="8c886341-40f2-463a-b622-8ba2cbab30ab" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:33:45.304336 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:45.304296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72" event={"ID":"e0ca7a25-2717-45be-bcbb-3184cf094aa1","Type":"ContainerStarted","Data":"0c9e6285d4ee2d198157b7dc9d29e4c0b6a3d18c3118640471370f33196bee91"}
Sep 17 17:33:45.306102 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:45.306072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npr75" event={"ID":"badc9616-73e0-4ec8-a359-cd87b537e4f0","Type":"ContainerStarted","Data":"a7b224855e8e521a7048c248fe5d0ae5657c3b120dbcac5ee9d5478836078cf9"}
Sep 17 17:33:45.306242 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:45.306135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npr75" event={"ID":"badc9616-73e0-4ec8-a359-cd87b537e4f0","Type":"ContainerStarted","Data":"d6e45e281cb133a2afd05b84f262738fea68a3a5c7d1bd8b802a89332788c383"}
Sep 17 17:33:45.307927 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:45.307901    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bc487546-qr2jw" event={"ID":"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b","Type":"ContainerStarted","Data":"e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb"}
Sep 17 17:33:45.335406 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:45.335362    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58bc487546-qr2jw" podStartSLOduration=1.578785902 podStartE2EDuration="6.335349018s" totalImagesPullingTime="4.756563116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:45.333224062 +0000 UTC m=+151.984130057" watchObservedRunningTime="2026-09-17 17:33:45.335349018 +0000 UTC m=+151.986255080"
Sep 17 17:33:46.314752 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:46.314718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npr75" event={"ID":"badc9616-73e0-4ec8-a359-cd87b537e4f0","Type":"ContainerStarted","Data":"111f16cf29572744c42f88a3796303e5f8e698dfa1d7f037ca07a675004334a7"}
Sep 17 17:33:48.881149 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:48.881115    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-648dfbc974-xh5bm"]
Sep 17 17:33:48.885823 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:48.885800    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:48.902199 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:48.902174    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 17:33:48.928753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:48.928723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7gwc\" (UniqueName: \"kubernetes.io/projected/7715e00e-07b1-47c9-95be-632625798991-kube-api-access-k7gwc\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:48.928866 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:48.928768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-oauth-config\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:48.928866 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:48.928830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-serving-cert\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:48.928964 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:48.928933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-trusted-ca-bundle\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:48.928964 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:48.928960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-oauth-serving-cert\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:48.929073 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:48.929046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-console-config\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:48.929123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:48.929111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-service-ca\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:48.958402 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:48.958374    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648dfbc974-xh5bm"]
Sep 17 17:33:49.029617 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.029582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7gwc\" (UniqueName: \"kubernetes.io/projected/7715e00e-07b1-47c9-95be-632625798991-kube-api-access-k7gwc\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.029801 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.029627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-oauth-config\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.029801 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.029654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-serving-cert\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.029801 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.029686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-trusted-ca-bundle\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.029801 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.029729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-oauth-serving-cert\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.029801 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.029797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-console-config\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.030059 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.029818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-service-ca\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.030732 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.030686    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-service-ca\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.030841 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.030734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-oauth-serving-cert\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.030841 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.030786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-trusted-ca-bundle\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.030841 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.030801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-console-config\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.032455 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.032436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-oauth-config\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.033149 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.033123    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-serving-cert\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.039536 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.039514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7gwc\" (UniqueName: \"kubernetes.io/projected/7715e00e-07b1-47c9-95be-632625798991-kube-api-access-k7gwc\") pod \"console-648dfbc974-xh5bm\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") " pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.196263 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.196163    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:49.740589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.740559    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:49.740789 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.740622    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:33:49.742130 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.742106    2563 patch_prober.go:28] interesting pod/console-58bc487546-qr2jw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body=
Sep 17 17:33:49.742234 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:49.742156    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-58bc487546-qr2jw" podUID="8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused"
Sep 17 17:33:52.911252 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:52.911196    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-c7tsd" podUID="d2703893-5d20-4d4f-88d0-a6f5e28da54b"
Sep 17 17:33:53.347519 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:53.347488    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:33:53.842348 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:53.842216    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648dfbc974-xh5bm"]
Sep 17 17:33:53.845920 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:53.845886    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7715e00e_07b1_47c9_95be_632625798991.slice/crio-8ad0bd43822b207f221b070c0da192a0899f14384107dfe3c32e889404d303df WatchSource:0}: Error finding container 8ad0bd43822b207f221b070c0da192a0899f14384107dfe3c32e889404d303df: Status 404 returned error can't find the container with id 8ad0bd43822b207f221b070c0da192a0899f14384107dfe3c32e889404d303df
Sep 17 17:33:54.353591 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.353558    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-b5g8t" event={"ID":"0ba03747-7a71-4e16-9a60-c7ce6e487a35","Type":"ContainerStarted","Data":"24cb6adab110e63d42b2465d9ea3f0a0bad95567a4b0c1dcfedb41b5c6f4759e"}
Sep 17 17:33:54.354109 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.353739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-b5g8t"
Sep 17 17:33:54.356338 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.356302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72" event={"ID":"e0ca7a25-2717-45be-bcbb-3184cf094aa1","Type":"ContainerStarted","Data":"566ed557726afbc2fa8b5e798595186ef294363a5538002586feaced8d5f8c82"}
Sep 17 17:33:54.356468 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.356360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72" event={"ID":"e0ca7a25-2717-45be-bcbb-3184cf094aa1","Type":"ContainerStarted","Data":"af8e40bee4c17c4717e234d5589dc5debc3929d1f81f52bd73692dc48ea29e76"}
Sep 17 17:33:54.358848 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.358823    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npr75" event={"ID":"badc9616-73e0-4ec8-a359-cd87b537e4f0","Type":"ContainerStarted","Data":"c5b00bce976435770e686b8e6b6d69bb4c723c3e441fb59bcfa771b24b3655ea"}
Sep 17 17:33:54.360681 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.360652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648dfbc974-xh5bm" event={"ID":"7715e00e-07b1-47c9-95be-632625798991","Type":"ContainerStarted","Data":"80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135"}
Sep 17 17:33:54.360793 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.360723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648dfbc974-xh5bm" event={"ID":"7715e00e-07b1-47c9-95be-632625798991","Type":"ContainerStarted","Data":"8ad0bd43822b207f221b070c0da192a0899f14384107dfe3c32e889404d303df"}
Sep 17 17:33:54.365928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.365908    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-b5g8t"
Sep 17 17:33:54.374906 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.374866    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-b5g8t" podStartSLOduration=1.411709762 podStartE2EDuration="19.374848541s" totalImagesPullingTime="17.963138779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:54.373787083 +0000 UTC m=+161.024693075" watchObservedRunningTime="2026-09-17 17:33:54.374848541 +0000 UTC m=+161.025754584"
Sep 17 17:33:54.392902 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.392851    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6cq72" podStartSLOduration=3.827201172 podStartE2EDuration="12.392834588s" totalImagesPullingTime="8.565633416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:54.391634 +0000 UTC m=+161.042539993" watchObservedRunningTime="2026-09-17 17:33:54.392834588 +0000 UTC m=+161.043740581"
Sep 17 17:33:54.432664 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.432603    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-npr75" podStartSLOduration=36.007343772 podStartE2EDuration="44.432573581s" totalImagesPullingTime="8.425229809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:33:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:54.431045495 +0000 UTC m=+161.081951485" watchObservedRunningTime="2026-09-17 17:33:54.432573581 +0000 UTC m=+161.083479574"
Sep 17 17:33:54.448794 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:54.448473    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-648dfbc974-xh5bm" podStartSLOduration=6.448453551 podStartE2EDuration="6.448453551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:54.44812494 +0000 UTC m=+161.099030943" watchObservedRunningTime="2026-09-17 17:33:54.448453551 +0000 UTC m=+161.099359545"
Sep 17 17:33:55.067046 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:55.067006    2563 patch_prober.go:28] interesting pod/image-registry-7c6974dbd8-qcjzq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 17:33:55.067218 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:55.067069    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq" podUID="8c886341-40f2-463a-b622-8ba2cbab30ab" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:33:56.197224 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.197185    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"]
Sep 17 17:33:56.212405 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.212379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.215820 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.215794    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"]
Sep 17 17:33:56.217097 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.216492    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bqqd9\""
Sep 17 17:33:56.217097 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.216759    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 17 17:33:56.217097 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.216932    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 17 17:33:56.228425 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.228402    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wnxgl"]
Sep 17 17:33:56.241439 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.241419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.246335 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.246313    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 17:33:56.246467 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.246443    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 17:33:56.246666 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.246646    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xkwcs\""
Sep 17 17:33:56.246974 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.246590    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 17:33:56.295195 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-textfile\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.295333 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9651fa47-3e0a-4b86-a331-f5cedc9978af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.295333 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa2c310-216c-4556-b5b7-777a436ce594-metrics-client-ca\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.295333 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkghz\" (UniqueName: \"kubernetes.io/projected/5aa2c310-216c-4556-b5b7-777a436ce594-kube-api-access-tkghz\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.295333 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-tls\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.295539 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-wtmp\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.295539 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9651fa47-3e0a-4b86-a331-f5cedc9978af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.295539 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-accelerators-collector-config\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.295685 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5aa2c310-216c-4556-b5b7-777a436ce594-sys\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.295685 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5aa2c310-216c-4556-b5b7-777a436ce594-root\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.295685 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.295685 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g56q\" (UniqueName: \"kubernetes.io/projected/9651fa47-3e0a-4b86-a331-f5cedc9978af-kube-api-access-8g56q\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.295913 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.295762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9651fa47-3e0a-4b86-a331-f5cedc9978af-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.396925 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.396885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5aa2c310-216c-4556-b5b7-777a436ce594-sys\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.397096 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.396932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5aa2c310-216c-4556-b5b7-777a436ce594-root\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.397096 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.396961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.397096 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.396987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g56q\" (UniqueName: \"kubernetes.io/projected/9651fa47-3e0a-4b86-a331-f5cedc9978af-kube-api-access-8g56q\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.397096 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9651fa47-3e0a-4b86-a331-f5cedc9978af-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.397096 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-textfile\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.397096 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9651fa47-3e0a-4b86-a331-f5cedc9978af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.397414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa2c310-216c-4556-b5b7-777a436ce594-metrics-client-ca\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.397414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkghz\" (UniqueName: \"kubernetes.io/projected/5aa2c310-216c-4556-b5b7-777a436ce594-kube-api-access-tkghz\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.397414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-tls\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.397414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-wtmp\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.397414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9651fa47-3e0a-4b86-a331-f5cedc9978af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.397414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-accelerators-collector-config\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.397960 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-accelerators-collector-config\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.398065 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397995    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5aa2c310-216c-4556-b5b7-777a436ce594-root\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.398065 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.397999    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5aa2c310-216c-4556-b5b7-777a436ce594-sys\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.398154 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:56.398090    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 17:33:56.398154 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:56.398151    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-tls podName:5aa2c310-216c-4556-b5b7-777a436ce594 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:56.898134551 +0000 UTC m=+163.549040535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-tls") pod "node-exporter-wnxgl" (UID: "5aa2c310-216c-4556-b5b7-777a436ce594") : secret "node-exporter-tls" not found
Sep 17 17:33:56.398275 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.398161    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-wtmp\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.398724 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.398677    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa2c310-216c-4556-b5b7-777a436ce594-metrics-client-ca\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.399187 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.399164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-textfile\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.399325 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.399199    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9651fa47-3e0a-4b86-a331-f5cedc9978af-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.401658 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.401444    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.402782 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.402758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9651fa47-3e0a-4b86-a331-f5cedc9978af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.403681 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.403655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9651fa47-3e0a-4b86-a331-f5cedc9978af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.407237 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.407000    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkghz\" (UniqueName: \"kubernetes.io/projected/5aa2c310-216c-4556-b5b7-777a436ce594-kube-api-access-tkghz\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.408496 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.408456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g56q\" (UniqueName: \"kubernetes.io/projected/9651fa47-3e0a-4b86-a331-f5cedc9978af-kube-api-access-8g56q\") pod \"openshift-state-metrics-86c5bc79d6-tbk7j\" (UID: \"9651fa47-3e0a-4b86-a331-f5cedc9978af\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.531592 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.531556    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"
Sep 17 17:33:56.883187 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.883111    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j"]
Sep 17 17:33:56.887902 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:56.887859    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9651fa47_3e0a_4b86_a331_f5cedc9978af.slice/crio-b06205bb1d796b504a2877bd655a7281a5d168ce0112c7ef15cbdaf359b3177b WatchSource:0}: Error finding container b06205bb1d796b504a2877bd655a7281a5d168ce0112c7ef15cbdaf359b3177b: Status 404 returned error can't find the container with id b06205bb1d796b504a2877bd655a7281a5d168ce0112c7ef15cbdaf359b3177b
Sep 17 17:33:56.901815 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:56.901782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-tls\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:56.901968 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:56.901941    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 17:33:56.902060 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:33:56.902021    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-tls podName:5aa2c310-216c-4556-b5b7-777a436ce594 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:57.902002097 +0000 UTC m=+164.552908087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-tls") pod "node-exporter-wnxgl" (UID: "5aa2c310-216c-4556-b5b7-777a436ce594") : secret "node-exporter-tls" not found
Sep 17 17:33:57.377140 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:57.377051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j" event={"ID":"9651fa47-3e0a-4b86-a331-f5cedc9978af","Type":"ContainerStarted","Data":"e5ed6842bf6ac04f18232788e27495fe9d0569ddf39da8bac1e4556a43099ec1"}
Sep 17 17:33:57.377140 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:57.377123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j" event={"ID":"9651fa47-3e0a-4b86-a331-f5cedc9978af","Type":"ContainerStarted","Data":"7956a772756640581eeaa30fbfca8e5efb504ef7a2b6588dadda671e3fce6b33"}
Sep 17 17:33:57.377648 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:57.377151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j" event={"ID":"9651fa47-3e0a-4b86-a331-f5cedc9978af","Type":"ContainerStarted","Data":"b06205bb1d796b504a2877bd655a7281a5d168ce0112c7ef15cbdaf359b3177b"}
Sep 17 17:33:57.812722 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:57.812360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:33:57.815440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:57.815412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2703893-5d20-4d4f-88d0-a6f5e28da54b-metrics-tls\") pod \"dns-default-c7tsd\" (UID: \"d2703893-5d20-4d4f-88d0-a6f5e28da54b\") " pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:33:57.851006 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:57.850982    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fv9xq\""
Sep 17 17:33:57.859040 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:57.859007    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:33:57.914334 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:57.913810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-tls\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:57.918296 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:57.918232    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5aa2c310-216c-4556-b5b7-777a436ce594-node-exporter-tls\") pod \"node-exporter-wnxgl\" (UID: \"5aa2c310-216c-4556-b5b7-777a436ce594\") " pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:58.053727 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.053231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wnxgl"
Sep 17 17:33:58.172937 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.172901    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c7tsd"]
Sep 17 17:33:58.236185 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.236143    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"]
Sep 17 17:33:58.251965 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.251936    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.255793 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.255764    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2gcos9pppdtgl\""
Sep 17 17:33:58.256429 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.256005    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 17 17:33:58.256429 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.256262    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 17 17:33:58.256429 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.256291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 17 17:33:58.256429 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.256364    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 17 17:33:58.256862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.256760    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 17 17:33:58.257001 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.256977    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5k2xp\""
Sep 17 17:33:58.258530 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.258510    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"]
Sep 17 17:33:58.307209 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:58.307175    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2703893_5d20_4d4f_88d0_a6f5e28da54b.slice/crio-aa406840aa4ee860034d4324cbd8e0042d9e50776c3d2616765495b4a29ff928 WatchSource:0}: Error finding container aa406840aa4ee860034d4324cbd8e0042d9e50776c3d2616765495b4a29ff928: Status 404 returned error can't find the container with id aa406840aa4ee860034d4324cbd8e0042d9e50776c3d2616765495b4a29ff928
Sep 17 17:33:58.314582 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:58.314557    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa2c310_216c_4556_b5b7_777a436ce594.slice/crio-3f85f357df84439e588dee330c966d1956538574ad54daf93dcf0dc49a94d7ff WatchSource:0}: Error finding container 3f85f357df84439e588dee330c966d1956538574ad54daf93dcf0dc49a94d7ff: Status 404 returned error can't find the container with id 3f85f357df84439e588dee330c966d1956538574ad54daf93dcf0dc49a94d7ff
Sep 17 17:33:58.316875 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.316842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.316936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.316880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-tls\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.316936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.316908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.317024 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.316959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-grpc-tls\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.317024 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.317001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x25f\" (UniqueName: \"kubernetes.io/projected/4e0af69b-0c53-4681-810f-20d2f1202428-kube-api-access-9x25f\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.317108 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.317040    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e0af69b-0c53-4681-810f-20d2f1202428-metrics-client-ca\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.317108 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.317099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.317200 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.317130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.381924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.381859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wnxgl" event={"ID":"5aa2c310-216c-4556-b5b7-777a436ce594","Type":"ContainerStarted","Data":"3f85f357df84439e588dee330c966d1956538574ad54daf93dcf0dc49a94d7ff"}
Sep 17 17:33:58.383290 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.383266    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c7tsd" event={"ID":"d2703893-5d20-4d4f-88d0-a6f5e28da54b","Type":"ContainerStarted","Data":"aa406840aa4ee860034d4324cbd8e0042d9e50776c3d2616765495b4a29ff928"}
Sep 17 17:33:58.417629 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.417605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.417629 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.417637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-tls\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.417828 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.417657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.417828 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.417680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-grpc-tls\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.417828 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.417736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x25f\" (UniqueName: \"kubernetes.io/projected/4e0af69b-0c53-4681-810f-20d2f1202428-kube-api-access-9x25f\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.417828 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.417762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e0af69b-0c53-4681-810f-20d2f1202428-metrics-client-ca\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.417828 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.417794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.418054 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.417823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.418673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.418621    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e0af69b-0c53-4681-810f-20d2f1202428-metrics-client-ca\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.420864 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.420782    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.420961 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.420860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.421032 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.421016    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-grpc-tls\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.421453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.421430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-tls\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.421752 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.421730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.421844 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.421794    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e0af69b-0c53-4681-810f-20d2f1202428-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.432349 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.432326    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x25f\" (UniqueName: \"kubernetes.io/projected/4e0af69b-0c53-4681-810f-20d2f1202428-kube-api-access-9x25f\") pod \"thanos-querier-774c75bcc5-8xxqk\" (UID: \"4e0af69b-0c53-4681-810f-20d2f1202428\") " pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.565300 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.565264    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:33:58.936602 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:58.936451    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"]
Sep 17 17:33:58.941930 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:33:58.941896    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0af69b_0c53_4681_810f_20d2f1202428.slice/crio-cb41e1dfd75183f47260686deee691b6738b2afdf770f76484a3f077d95265ac WatchSource:0}: Error finding container cb41e1dfd75183f47260686deee691b6738b2afdf770f76484a3f077d95265ac: Status 404 returned error can't find the container with id cb41e1dfd75183f47260686deee691b6738b2afdf770f76484a3f077d95265ac
Sep 17 17:33:59.196367 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:59.196278    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:59.197821 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:59.197759    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:59.206664 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:59.206383    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:59.393765 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:59.392985    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j" event={"ID":"9651fa47-3e0a-4b86-a331-f5cedc9978af","Type":"ContainerStarted","Data":"aafde6cd8903a22eccc8099e8d5d03918148e2c30a23490dc8fc7afded940fe4"}
Sep 17 17:33:59.397767 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:59.397419    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk" event={"ID":"4e0af69b-0c53-4681-810f-20d2f1202428","Type":"ContainerStarted","Data":"cb41e1dfd75183f47260686deee691b6738b2afdf770f76484a3f077d95265ac"}
Sep 17 17:33:59.403361 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:59.403317    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:33:59.419203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:59.417939    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-tbk7j" podStartSLOduration=1.922032065 podStartE2EDuration="3.417918652s" totalImagesPullingTime="1.495886587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:59.415898571 +0000 UTC m=+166.066804563" watchObservedRunningTime="2026-09-17 17:33:59.417918652 +0000 UTC m=+166.068824646"
Sep 17 17:33:59.479356 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:33:59.479187    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58bc487546-qr2jw"]
Sep 17 17:34:00.080088 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:00.080043    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq" podUID="8c886341-40f2-463a-b622-8ba2cbab30ab" containerName="registry" containerID="cri-o://aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e" gracePeriod=30
Sep 17 17:34:01.294272 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.294237    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:34:01.349283 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.349248    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls\") pod \"8c886341-40f2-463a-b622-8ba2cbab30ab\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") "
Sep 17 17:34:01.349456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.349343    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-image-registry-private-configuration\") pod \"8c886341-40f2-463a-b622-8ba2cbab30ab\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") "
Sep 17 17:34:01.349456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.349368    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-installation-pull-secrets\") pod \"8c886341-40f2-463a-b622-8ba2cbab30ab\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") "
Sep 17 17:34:01.349456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.349397    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-certificates\") pod \"8c886341-40f2-463a-b622-8ba2cbab30ab\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") "
Sep 17 17:34:01.349456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.349434    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c886341-40f2-463a-b622-8ba2cbab30ab-ca-trust-extracted\") pod \"8c886341-40f2-463a-b622-8ba2cbab30ab\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") "
Sep 17 17:34:01.349671 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.349476    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-trusted-ca\") pod \"8c886341-40f2-463a-b622-8ba2cbab30ab\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") "
Sep 17 17:34:01.349671 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.349537    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sql5\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-kube-api-access-4sql5\") pod \"8c886341-40f2-463a-b622-8ba2cbab30ab\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") "
Sep 17 17:34:01.349671 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.349565    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-bound-sa-token\") pod \"8c886341-40f2-463a-b622-8ba2cbab30ab\" (UID: \"8c886341-40f2-463a-b622-8ba2cbab30ab\") "
Sep 17 17:34:01.349887 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.349857    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8c886341-40f2-463a-b622-8ba2cbab30ab" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:01.350360 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.350317    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8c886341-40f2-463a-b622-8ba2cbab30ab" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:01.360792 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.360734    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8c886341-40f2-463a-b622-8ba2cbab30ab" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:34:01.361632 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.361564    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8c886341-40f2-463a-b622-8ba2cbab30ab" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:34:01.361855 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.361815    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-kube-api-access-4sql5" (OuterVolumeSpecName: "kube-api-access-4sql5") pod "8c886341-40f2-463a-b622-8ba2cbab30ab" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab"). InnerVolumeSpecName "kube-api-access-4sql5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:34:01.362380 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.362289    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c886341-40f2-463a-b622-8ba2cbab30ab-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8c886341-40f2-463a-b622-8ba2cbab30ab" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:34:01.363061 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.363028    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8c886341-40f2-463a-b622-8ba2cbab30ab" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:34:01.363160 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.363093    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8c886341-40f2-463a-b622-8ba2cbab30ab" (UID: "8c886341-40f2-463a-b622-8ba2cbab30ab"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:34:01.410184 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.410143    2563 generic.go:356] "Generic (PLEG): container finished" podID="8c886341-40f2-463a-b622-8ba2cbab30ab" containerID="aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e" exitCode=0
Sep 17 17:34:01.410473 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.410211    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq"
Sep 17 17:34:01.410473 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.410245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq" event={"ID":"8c886341-40f2-463a-b622-8ba2cbab30ab","Type":"ContainerDied","Data":"aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e"}
Sep 17 17:34:01.410473 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.410347    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6974dbd8-qcjzq" event={"ID":"8c886341-40f2-463a-b622-8ba2cbab30ab","Type":"ContainerDied","Data":"86242d879f1d5def72ba2d6730ec7cf227a4b1332fd3cc7b5c873238b4d0c0dc"}
Sep 17 17:34:01.410473 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.410373    2563 scope.go:117] "RemoveContainer" containerID="aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e"
Sep 17 17:34:01.413683 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.413659    2563 generic.go:356] "Generic (PLEG): container finished" podID="5aa2c310-216c-4556-b5b7-777a436ce594" containerID="176afcdd2a6675a905fa6fc613983777ce079d4614252d1cef6e10752d6db708" exitCode=0
Sep 17 17:34:01.413813 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.413791    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wnxgl" event={"ID":"5aa2c310-216c-4556-b5b7-777a436ce594","Type":"ContainerDied","Data":"176afcdd2a6675a905fa6fc613983777ce079d4614252d1cef6e10752d6db708"}
Sep 17 17:34:01.451572 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.451541    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-trusted-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:01.451572 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.451574    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sql5\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-kube-api-access-4sql5\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:01.451827 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.451602    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-bound-sa-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:01.451827 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.451616    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-tls\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:01.451827 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.451629    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-image-registry-private-configuration\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:01.451827 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.451643    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c886341-40f2-463a-b622-8ba2cbab30ab-installation-pull-secrets\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:01.451827 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.451656    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c886341-40f2-463a-b622-8ba2cbab30ab-registry-certificates\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:01.451827 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.451668    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c886341-40f2-463a-b622-8ba2cbab30ab-ca-trust-extracted\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:01.452242 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.452215    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c6974dbd8-qcjzq"]
Sep 17 17:34:01.454882 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.454848    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c6974dbd8-qcjzq"]
Sep 17 17:34:01.503122 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.503044    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fd79995c4-824hq"]
Sep 17 17:34:01.503453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.503432    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c886341-40f2-463a-b622-8ba2cbab30ab" containerName="registry"
Sep 17 17:34:01.503453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.503455    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c886341-40f2-463a-b622-8ba2cbab30ab" containerName="registry"
Sep 17 17:34:01.503608 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.503532    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c886341-40f2-463a-b622-8ba2cbab30ab" containerName="registry"
Sep 17 17:34:01.537364 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.536212    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fd79995c4-824hq"]
Sep 17 17:34:01.537364 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.536360    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.539061 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.538863    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 17 17:34:01.540521 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.540028    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 17 17:34:01.540656 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.540556    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 17 17:34:01.540656 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.540567    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 17 17:34:01.540656 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.540623    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tdxlw\""
Sep 17 17:34:01.541100 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.540917    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 17 17:34:01.549044 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.549016    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 17 17:34:01.615125 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.615091    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c886341-40f2-463a-b622-8ba2cbab30ab" path="/var/lib/kubelet/pods/8c886341-40f2-463a-b622-8ba2cbab30ab/volumes"
Sep 17 17:34:01.654094 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.654045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.654311 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.654224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f1ae65-f7f4-40b4-956e-1fd6c251baac-metrics-client-ca\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.654584 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.654408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-federate-client-tls\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.654584 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.654457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-secret-telemeter-client\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.654584 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.654502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1ae65-f7f4-40b4-956e-1fd6c251baac-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.654584 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.654539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1ae65-f7f4-40b4-956e-1fd6c251baac-serving-certs-ca-bundle\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.654897 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.654598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-telemeter-client-tls\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.654897 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.654638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99gnr\" (UniqueName: \"kubernetes.io/projected/05f1ae65-f7f4-40b4-956e-1fd6c251baac-kube-api-access-99gnr\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.755463 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.755375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-secret-telemeter-client\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.755463 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.755436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1ae65-f7f4-40b4-956e-1fd6c251baac-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.755694 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.755471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1ae65-f7f4-40b4-956e-1fd6c251baac-serving-certs-ca-bundle\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.755694 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.755502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-telemeter-client-tls\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.755694 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.755527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99gnr\" (UniqueName: \"kubernetes.io/projected/05f1ae65-f7f4-40b4-956e-1fd6c251baac-kube-api-access-99gnr\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.755694 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.755569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.755694 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.755627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f1ae65-f7f4-40b4-956e-1fd6c251baac-metrics-client-ca\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.755694 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.755695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-federate-client-tls\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.756543 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.756485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f1ae65-f7f4-40b4-956e-1fd6c251baac-metrics-client-ca\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.757036 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.756979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1ae65-f7f4-40b4-956e-1fd6c251baac-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.757394 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.757357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1ae65-f7f4-40b4-956e-1fd6c251baac-serving-certs-ca-bundle\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.759223 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.759176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-secret-telemeter-client\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.760024 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.759984    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-telemeter-client-tls\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.760516 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.760491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.761062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.761041    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/05f1ae65-f7f4-40b4-956e-1fd6c251baac-federate-client-tls\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.766615 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.766595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99gnr\" (UniqueName: \"kubernetes.io/projected/05f1ae65-f7f4-40b4-956e-1fd6c251baac-kube-api-access-99gnr\") pod \"telemeter-client-5fd79995c4-824hq\" (UID: \"05f1ae65-f7f4-40b4-956e-1fd6c251baac\") " pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.851230 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.851182    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq"
Sep 17 17:34:01.962118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.962088    2563 scope.go:117] "RemoveContainer" containerID="aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e"
Sep 17 17:34:01.962639 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:34:01.962608    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e\": container with ID starting with aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e not found: ID does not exist" containerID="aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e"
Sep 17 17:34:01.962777 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:01.962656    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e"} err="failed to get container status \"aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e\": rpc error: code = NotFound desc = could not find container \"aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e\": container with ID starting with aef5955655148b713d239a8ac65d988b65f550a13f597446a05f5f408dc0263e not found: ID does not exist"
Sep 17 17:34:02.243802 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.243758    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6955f6b9d7-pcdqc"]
Sep 17 17:34:02.258544 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.258169    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.263897 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.263868    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6955f6b9d7-pcdqc"]
Sep 17 17:34:02.292045 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.292023    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fd79995c4-824hq"]
Sep 17 17:34:02.333491 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:34:02.333443    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f1ae65_f7f4_40b4_956e_1fd6c251baac.slice/crio-e63d9cab22ae63bb3b4e8297edfcd529f5090e4956c33f8aeebbc06f64a51770 WatchSource:0}: Error finding container e63d9cab22ae63bb3b4e8297edfcd529f5090e4956c33f8aeebbc06f64a51770: Status 404 returned error can't find the container with id e63d9cab22ae63bb3b4e8297edfcd529f5090e4956c33f8aeebbc06f64a51770
Sep 17 17:34:02.361552 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.361517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-oauth-serving-cert\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.361667 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.361572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsl7p\" (UniqueName: \"kubernetes.io/projected/48689e0d-afbd-4632-a343-3e93c1e6e6e8-kube-api-access-wsl7p\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.361667 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.361648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-service-ca\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.361790 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.361713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-config\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.361790 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.361779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-serving-cert\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.361903 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.361811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-oauth-config\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.361903 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.361850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-trusted-ca-bundle\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.423388 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.423244    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wnxgl" event={"ID":"5aa2c310-216c-4556-b5b7-777a436ce594","Type":"ContainerStarted","Data":"46ff21cc0e0faeaf37d68d5209e3bf5e371f18593cb8deecaacaa13fc718c6af"}
Sep 17 17:34:02.423388 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.423353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wnxgl" event={"ID":"5aa2c310-216c-4556-b5b7-777a436ce594","Type":"ContainerStarted","Data":"dcec6f922c717bb1fba34b997d62cd722f77e853bdcdd0f93fda7d97ff419e43"}
Sep 17 17:34:02.425980 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.425909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c7tsd" event={"ID":"d2703893-5d20-4d4f-88d0-a6f5e28da54b","Type":"ContainerStarted","Data":"b418a269a375b7139e5a785d521516080662bcc0f4d358725776fb8a245be5ce"}
Sep 17 17:34:02.430663 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.430584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq" event={"ID":"05f1ae65-f7f4-40b4-956e-1fd6c251baac","Type":"ContainerStarted","Data":"e63d9cab22ae63bb3b4e8297edfcd529f5090e4956c33f8aeebbc06f64a51770"}
Sep 17 17:34:02.459982 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.459447    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wnxgl" podStartSLOduration=3.723681564 podStartE2EDuration="6.459424221s" totalImagesPullingTime="2.660218763s" totalInitContainerRuntime="75.523894ms" isStatefulPod=true podCreationTimestamp="2026-09-17 17:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:02.455792449 +0000 UTC m=+169.106698442" watchObservedRunningTime="2026-09-17 17:34:02.459424221 +0000 UTC m=+169.110330217"
Sep 17 17:34:02.462961 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.462936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-trusted-ca-bundle\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.463080 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.462989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-oauth-serving-cert\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.463080 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.463017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsl7p\" (UniqueName: \"kubernetes.io/projected/48689e0d-afbd-4632-a343-3e93c1e6e6e8-kube-api-access-wsl7p\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.463080 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.463053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-service-ca\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.463262 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.463091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-config\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.463262 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.463135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-serving-cert\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.463262 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.463165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-oauth-config\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.463965 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.463888    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-trusted-ca-bundle\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.464716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.464167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-service-ca\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.464716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.464357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-oauth-serving-cert\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.464873 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.464807    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-config\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.466391 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.466347    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-oauth-config\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.467475 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.467456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-serving-cert\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.500388 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.500334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsl7p\" (UniqueName: \"kubernetes.io/projected/48689e0d-afbd-4632-a343-3e93c1e6e6e8-kube-api-access-wsl7p\") pod \"console-6955f6b9d7-pcdqc\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") " pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.571313 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.571289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:02.885178 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.885096    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 17:34:02.908554 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:34:02.908525    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48689e0d_afbd_4632_a343_3e93c1e6e6e8.slice/crio-d5ccb9344a276934df67e8ece758be578c0f5224448d6bde90033702de0e3949 WatchSource:0}: Error finding container d5ccb9344a276934df67e8ece758be578c0f5224448d6bde90033702de0e3949: Status 404 returned error can't find the container with id d5ccb9344a276934df67e8ece758be578c0f5224448d6bde90033702de0e3949
Sep 17 17:34:02.910306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.910279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6955f6b9d7-pcdqc"]
Sep 17 17:34:02.910469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.910442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.917063 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.916854    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 17:34:02.917490 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.917427    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 17:34:02.918020 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.917819    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 17:34:02.918110 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.918042    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 17:34:02.919187 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.919107    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 17:34:02.922520 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.922490    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 17:34:02.922621 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.922561    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 17:34:02.923807 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.923578    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 17:34:02.926567 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.926268    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-88shp94v56tut\""
Sep 17 17:34:02.926567 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.926338    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 17:34:02.926567 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.926397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jl2ht\""
Sep 17 17:34:02.926567 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.926437    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 17:34:02.926567 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.926487    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 17:34:02.926567 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.926342    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 17:34:02.927224 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.927194    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 17:34:02.928478 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.928456    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 17:34:02.937856 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.937826    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 17:34:02.938356 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.938338    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 17:34:02.966770 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.966745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecd11254-7aca-42ce-a040-1f4f7f665757-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.966928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.966787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.966928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.966810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.966928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.966834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecd11254-7aca-42ce-a040-1f4f7f665757-config-out\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.966928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.966914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967124 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.966953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967124 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.966983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967124 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967124 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-config\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967124 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967441 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967441 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-web-config\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967441 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz4hc\" (UniqueName: \"kubernetes.io/projected/ecd11254-7aca-42ce-a040-1f4f7f665757-kube-api-access-qz4hc\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967441 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:02.967441 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:02.967385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.068836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz4hc\" (UniqueName: \"kubernetes.io/projected/ecd11254-7aca-42ce-a040-1f4f7f665757-kube-api-access-qz4hc\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.068836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.068836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.068836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecd11254-7aca-42ce-a040-1f4f7f665757-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.068836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.068836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068785    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.068836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecd11254-7aca-42ce-a040-1f4f7f665757-config-out\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.068836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068841    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-config\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.068993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.069022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.069063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.069090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.069123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.069166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.069204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.069370 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.069229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-web-config\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.075637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.070065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.075637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.071348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.075637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.073111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.075637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.073738    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.075637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.073764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.075637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.074023    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.075637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.074331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.075637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.074431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.075637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.075560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecd11254-7aca-42ce-a040-1f4f7f665757-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.081767 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.081723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-config\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.082199 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.082172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.083338 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.083272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-web-config\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.083450 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.083371    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.083512 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.083475    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.083512 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.083481    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.083977 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.083921    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecd11254-7aca-42ce-a040-1f4f7f665757-config-out\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.085026 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.084994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.086163 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.086141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecd11254-7aca-42ce-a040-1f4f7f665757-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.086294 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.086270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecd11254-7aca-42ce-a040-1f4f7f665757-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.088102 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.088055    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz4hc\" (UniqueName: \"kubernetes.io/projected/ecd11254-7aca-42ce-a040-1f4f7f665757-kube-api-access-qz4hc\") pod \"prometheus-k8s-0\" (UID: \"ecd11254-7aca-42ce-a040-1f4f7f665757\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.223160 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.223074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:03.445324 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.445134    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6955f6b9d7-pcdqc" event={"ID":"48689e0d-afbd-4632-a343-3e93c1e6e6e8","Type":"ContainerStarted","Data":"0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce"}
Sep 17 17:34:03.445324 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.445226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6955f6b9d7-pcdqc" event={"ID":"48689e0d-afbd-4632-a343-3e93c1e6e6e8","Type":"ContainerStarted","Data":"d5ccb9344a276934df67e8ece758be578c0f5224448d6bde90033702de0e3949"}
Sep 17 17:34:03.447746 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.447716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c7tsd" event={"ID":"d2703893-5d20-4d4f-88d0-a6f5e28da54b","Type":"ContainerStarted","Data":"dd3302d589fd53d3993418f4498aee3b528c951dd9f41149251cbc93b3e8ba4f"}
Sep 17 17:34:03.448142 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.448123    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:34:03.451441 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.451413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk" event={"ID":"4e0af69b-0c53-4681-810f-20d2f1202428","Type":"ContainerStarted","Data":"8994274445a99c3ee7ae17f49ba3292b2433de9b1912913793d68d718e46f7cd"}
Sep 17 17:34:03.451552 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.451492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk" event={"ID":"4e0af69b-0c53-4681-810f-20d2f1202428","Type":"ContainerStarted","Data":"77e7096d3bb3316760a4758177f1c23edaabbe747241b3ac49d62b264e09e4bb"}
Sep 17 17:34:03.451616 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.451536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk" event={"ID":"4e0af69b-0c53-4681-810f-20d2f1202428","Type":"ContainerStarted","Data":"112b204e1d6240f17a36c8f7b3dbce1e002e82d1c6fb99cf38153a017740083b"}
Sep 17 17:34:03.472577 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.472536    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6955f6b9d7-pcdqc" podStartSLOduration=1.472522629 podStartE2EDuration="1.472522629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:03.470321154 +0000 UTC m=+170.121227148" watchObservedRunningTime="2026-09-17 17:34:03.472522629 +0000 UTC m=+170.123428621"
Sep 17 17:34:03.500738 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.500637    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c7tsd" podStartSLOduration=130.843055109 podStartE2EDuration="2m14.500620703s" totalImagesPullingTime="3.657565594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:03.499832173 +0000 UTC m=+170.150738168" watchObservedRunningTime="2026-09-17 17:34:03.500620703 +0000 UTC m=+170.151526732"
Sep 17 17:34:03.550089 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:03.550057    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 17:34:03.804661 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:34:03.804631    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd11254_7aca_42ce_a040_1f4f7f665757.slice/crio-455db801713928dcb50d0c2566094746f3ee2a199ba89e1e8f289d922f3040e3 WatchSource:0}: Error finding container 455db801713928dcb50d0c2566094746f3ee2a199ba89e1e8f289d922f3040e3: Status 404 returned error can't find the container with id 455db801713928dcb50d0c2566094746f3ee2a199ba89e1e8f289d922f3040e3
Sep 17 17:34:04.456244 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:04.456208    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ecd11254-7aca-42ce-a040-1f4f7f665757","Type":"ContainerStarted","Data":"455db801713928dcb50d0c2566094746f3ee2a199ba89e1e8f289d922f3040e3"}
Sep 17 17:34:05.469769 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:05.469737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk" event={"ID":"4e0af69b-0c53-4681-810f-20d2f1202428","Type":"ContainerStarted","Data":"38dc69b2378bede4c90cf28c1ec96d7eccdba84e2d6fd652539a91c5f3ad6340"}
Sep 17 17:34:05.470160 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:05.469855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk" event={"ID":"4e0af69b-0c53-4681-810f-20d2f1202428","Type":"ContainerStarted","Data":"13b9f48d306531ed1487f8507906ba6af7e2dc350feade6586e669b67800db7f"}
Sep 17 17:34:05.471244 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:05.471219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq" event={"ID":"05f1ae65-f7f4-40b4-956e-1fd6c251baac","Type":"ContainerStarted","Data":"95612a567db12307247029e6ee0c3256118eedcd8cde0a21056dceada0b93107"}
Sep 17 17:34:06.477413 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.477380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq" event={"ID":"05f1ae65-f7f4-40b4-956e-1fd6c251baac","Type":"ContainerStarted","Data":"a543992699bceebd8cd1b2c128862a633fe6e2ea752d42ea281f70b0ebdd390a"}
Sep 17 17:34:06.477908 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.477434    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq" event={"ID":"05f1ae65-f7f4-40b4-956e-1fd6c251baac","Type":"ContainerStarted","Data":"d2c5b97072511f56bf96c2b3afadb1a39bfbeb8807a971ddce99c6100aadb876"}
Sep 17 17:34:06.479066 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.479039    2563 generic.go:356] "Generic (PLEG): container finished" podID="ecd11254-7aca-42ce-a040-1f4f7f665757" containerID="ba55b2b84858a07153c907c5f898beed9a3ed014da6f11fdc05adec80f0faafd" exitCode=0
Sep 17 17:34:06.479224 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.479130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ecd11254-7aca-42ce-a040-1f4f7f665757","Type":"ContainerDied","Data":"ba55b2b84858a07153c907c5f898beed9a3ed014da6f11fdc05adec80f0faafd"}
Sep 17 17:34:06.482668 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.482647    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk" event={"ID":"4e0af69b-0c53-4681-810f-20d2f1202428","Type":"ContainerStarted","Data":"650349529e46455ba51d20822ca5e71841e3650106bab4759f42d9c6fa7ad8f2"}
Sep 17 17:34:06.482852 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.482836    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:34:06.504330 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.504283    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fd79995c4-824hq" podStartSLOduration=2.139615399 podStartE2EDuration="5.504269468s" totalImagesPullingTime="3.364654069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:06.502410659 +0000 UTC m=+173.153316651" watchObservedRunningTime="2026-09-17 17:34:06.504269468 +0000 UTC m=+173.155175459"
Sep 17 17:34:06.572268 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.572223    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk" podStartSLOduration=3.042965851 podStartE2EDuration="8.572207202s" totalImagesPullingTime="5.529241351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:06.570532129 +0000 UTC m=+173.221438121" watchObservedRunningTime="2026-09-17 17:34:06.572207202 +0000 UTC m=+173.223113193"
Sep 17 17:34:06.624103 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.624069    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6955f6b9d7-pcdqc"]
Sep 17 17:34:06.659422 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.659396    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b99cdcb85-lshfq"]
Sep 17 17:34:06.685641 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.685609    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b99cdcb85-lshfq"]
Sep 17 17:34:06.685815 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.685737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.804839 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.804808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-trusted-ca-bundle\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.804993 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.804860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpnds\" (UniqueName: \"kubernetes.io/projected/11a1376b-f268-4940-88cb-132d89bbd294-kube-api-access-hpnds\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.804993 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.804928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-oauth-serving-cert\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.804993 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.804970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-serving-cert\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.805139 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.805003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-console-config\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.805139 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.805069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-oauth-config\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.805139 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.805087    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-service-ca\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.906212 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.906180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-oauth-config\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.906212 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.906211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-service-ca\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.906466 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.906252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-trusted-ca-bundle\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.906466 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.906286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpnds\" (UniqueName: \"kubernetes.io/projected/11a1376b-f268-4940-88cb-132d89bbd294-kube-api-access-hpnds\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.906466 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.906307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-oauth-serving-cert\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.906466 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.906331    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-serving-cert\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.906466 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.906406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-console-config\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.907137 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.907106    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-oauth-serving-cert\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.907243 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.907157    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-console-config\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.907243 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.907205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-service-ca\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.907243 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.907225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-trusted-ca-bundle\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.909137 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.909112    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-serving-cert\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.909224 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.909151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-oauth-config\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.919415 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.919384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpnds\" (UniqueName: \"kubernetes.io/projected/11a1376b-f268-4940-88cb-132d89bbd294-kube-api-access-hpnds\") pod \"console-5b99cdcb85-lshfq\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") " pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:06.994482 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:06.994447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:07.301425 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:07.301393    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b99cdcb85-lshfq"]
Sep 17 17:34:07.305981 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:34:07.305950    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a1376b_f268_4940_88cb_132d89bbd294.slice/crio-87a183f739ff6df174cb06cdb82cfb4be555c3178885ce1bc9b2f7fcc127508f WatchSource:0}: Error finding container 87a183f739ff6df174cb06cdb82cfb4be555c3178885ce1bc9b2f7fcc127508f: Status 404 returned error can't find the container with id 87a183f739ff6df174cb06cdb82cfb4be555c3178885ce1bc9b2f7fcc127508f
Sep 17 17:34:07.493403 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:07.493031    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b99cdcb85-lshfq" event={"ID":"11a1376b-f268-4940-88cb-132d89bbd294","Type":"ContainerStarted","Data":"e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c"}
Sep 17 17:34:07.493403 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:07.493110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b99cdcb85-lshfq" event={"ID":"11a1376b-f268-4940-88cb-132d89bbd294","Type":"ContainerStarted","Data":"87a183f739ff6df174cb06cdb82cfb4be555c3178885ce1bc9b2f7fcc127508f"}
Sep 17 17:34:07.503258 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:07.503230    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-774c75bcc5-8xxqk"
Sep 17 17:34:07.515652 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:07.515599    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b99cdcb85-lshfq" podStartSLOduration=1.515578091 podStartE2EDuration="1.515578091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:07.5133205 +0000 UTC m=+174.164226505" watchObservedRunningTime="2026-09-17 17:34:07.515578091 +0000 UTC m=+174.166484083"
Sep 17 17:34:10.512597 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:10.512559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ecd11254-7aca-42ce-a040-1f4f7f665757","Type":"ContainerStarted","Data":"77a0054cd44912c5ce70e33bbcd421f9766264bffc7f1a0cc661bfeea278de82"}
Sep 17 17:34:10.513037 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:10.512682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ecd11254-7aca-42ce-a040-1f4f7f665757","Type":"ContainerStarted","Data":"de10b137cf2f0e72b00d8caf3cada8d9bb3c2a0927d8c6f1f37c32d16257dbd3"}
Sep 17 17:34:10.513037 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:10.512756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ecd11254-7aca-42ce-a040-1f4f7f665757","Type":"ContainerStarted","Data":"738290ef30d9c975d242ad7704e7200512c879672dc217271c14f203d0dfce2c"}
Sep 17 17:34:11.523864 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:11.523829    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ecd11254-7aca-42ce-a040-1f4f7f665757","Type":"ContainerStarted","Data":"8306e8834f532873223cfce94cc956ef14ef6079828c42aa14fe09a1f862fbfe"}
Sep 17 17:34:11.524328 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:11.523894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ecd11254-7aca-42ce-a040-1f4f7f665757","Type":"ContainerStarted","Data":"b41104b8c6db2d702c0f66aff9e768ee07b2e8a16d939c5b89d434302a82f19a"}
Sep 17 17:34:11.524328 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:11.523924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ecd11254-7aca-42ce-a040-1f4f7f665757","Type":"ContainerStarted","Data":"afdebb7f3e86665f860282527344743e5142178b50703130b45ae34bc5f665fe"}
Sep 17 17:34:11.562520 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:11.562457    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.889418121 podStartE2EDuration="9.562433776s" totalImagesPullingTime="5.650265534s" totalInitContainerRuntime="22.750121ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:11.55924466 +0000 UTC m=+178.210150652" watchObservedRunningTime="2026-09-17 17:34:11.562433776 +0000 UTC m=+178.213339771"
Sep 17 17:34:12.572453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:12.572419    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:13.223683 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:13.223650    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:34:13.458617 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:13.458586    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c7tsd"
Sep 17 17:34:16.995141 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:16.995106    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:16.995601 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:16.995165    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:17.000029 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:17.000004    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:17.555366 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:17.555339    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:34:17.614907 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:17.614875    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648dfbc974-xh5bm"]
Sep 17 17:34:24.508178 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.508136    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58bc487546-qr2jw" podUID="8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" containerName="console" containerID="cri-o://e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb" gracePeriod=15
Sep 17 17:34:24.757060 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.757036    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:34:24.769086 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769030    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-oauth-serving-cert\") pod \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") "
Sep 17 17:34:24.769192 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769154    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-oauth-config\") pod \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") "
Sep 17 17:34:24.769192 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769179    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxqrb\" (UniqueName: \"kubernetes.io/projected/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-kube-api-access-gxqrb\") pod \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") "
Sep 17 17:34:24.769310 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769219    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-config\") pod \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") "
Sep 17 17:34:24.769365 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769345    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-service-ca\") pod \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") "
Sep 17 17:34:24.769417 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769386    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-serving-cert\") pod \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\" (UID: \"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b\") "
Sep 17 17:34:24.769468 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769451    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" (UID: "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:24.769648 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769626    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-config" (OuterVolumeSpecName: "console-config") pod "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" (UID: "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:24.769741 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769653    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-service-ca" (OuterVolumeSpecName: "service-ca") pod "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" (UID: "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:24.769800 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769767    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-config\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:24.769800 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769787    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:24.769890 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.769802    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-oauth-serving-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:24.771327 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.771297    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" (UID: "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:34:24.771471 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.771453    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" (UID: "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:34:24.771688 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.771674    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-kube-api-access-gxqrb" (OuterVolumeSpecName: "kube-api-access-gxqrb") pod "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" (UID: "8f2c9223-9d59-408a-bc8c-3e5195fa7b0b"). InnerVolumeSpecName "kube-api-access-gxqrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:34:24.870210 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.870176    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-oauth-config\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:24.870210 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.870206    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxqrb\" (UniqueName: \"kubernetes.io/projected/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-kube-api-access-gxqrb\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:24.870210 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:24.870215    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b-console-serving-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:25.589517 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:25.589483    2563 generic.go:356] "Generic (PLEG): container finished" podID="8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" containerID="e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb" exitCode=0
Sep 17 17:34:25.589975 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:25.589531    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bc487546-qr2jw"
Sep 17 17:34:25.589975 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:25.589569    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bc487546-qr2jw" event={"ID":"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b","Type":"ContainerDied","Data":"e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb"}
Sep 17 17:34:25.589975 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:25.589625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bc487546-qr2jw" event={"ID":"8f2c9223-9d59-408a-bc8c-3e5195fa7b0b","Type":"ContainerDied","Data":"1e69fd4240d61a26b8ac61407516c5e6218f8172700e017d2893e3c12dc8261c"}
Sep 17 17:34:25.589975 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:25.589654    2563 scope.go:117] "RemoveContainer" containerID="e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb"
Sep 17 17:34:25.601056 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:25.601039    2563 scope.go:117] "RemoveContainer" containerID="e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb"
Sep 17 17:34:25.601336 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:34:25.601312    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb\": container with ID starting with e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb not found: ID does not exist" containerID="e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb"
Sep 17 17:34:25.601390 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:25.601349    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb"} err="failed to get container status \"e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb\": rpc error: code = NotFound desc = could not find container \"e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb\": container with ID starting with e4377d14f60d8af8643e2eb0da102ffbb6e1934ca95903c0b41f5a66fb7306cb not found: ID does not exist"
Sep 17 17:34:25.617531 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:25.617510    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58bc487546-qr2jw"]
Sep 17 17:34:25.620812 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:25.620790    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58bc487546-qr2jw"]
Sep 17 17:34:27.612988 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:27.612957    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" path="/var/lib/kubelet/pods/8f2c9223-9d59-408a-bc8c-3e5195fa7b0b/volumes"
Sep 17 17:34:31.642756 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:31.642713    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6955f6b9d7-pcdqc" podUID="48689e0d-afbd-4632-a343-3e93c1e6e6e8" containerName="console" containerID="cri-o://0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce" gracePeriod=15
Sep 17 17:34:31.919873 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:31.919808    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:32.022394 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.022364    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-service-ca\") pod \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") "
Sep 17 17:34:32.022540 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.022409    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-serving-cert\") pod \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") "
Sep 17 17:34:32.022540 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.022451    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-oauth-serving-cert\") pod \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") "
Sep 17 17:34:32.022540 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.022505    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-trusted-ca-bundle\") pod \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") "
Sep 17 17:34:32.022540 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.022535    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-oauth-config\") pod \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") "
Sep 17 17:34:32.022753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.022568    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-config\") pod \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") "
Sep 17 17:34:32.022753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.022597    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsl7p\" (UniqueName: \"kubernetes.io/projected/48689e0d-afbd-4632-a343-3e93c1e6e6e8-kube-api-access-wsl7p\") pod \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\" (UID: \"48689e0d-afbd-4632-a343-3e93c1e6e6e8\") "
Sep 17 17:34:32.022871 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.022850    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "48689e0d-afbd-4632-a343-3e93c1e6e6e8" (UID: "48689e0d-afbd-4632-a343-3e93c1e6e6e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:32.022928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.022899    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "48689e0d-afbd-4632-a343-3e93c1e6e6e8" (UID: "48689e0d-afbd-4632-a343-3e93c1e6e6e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:32.023033 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.022998    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-config" (OuterVolumeSpecName: "console-config") pod "48689e0d-afbd-4632-a343-3e93c1e6e6e8" (UID: "48689e0d-afbd-4632-a343-3e93c1e6e6e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:32.023033 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.023009    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "48689e0d-afbd-4632-a343-3e93c1e6e6e8" (UID: "48689e0d-afbd-4632-a343-3e93c1e6e6e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:32.024757 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.024677    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "48689e0d-afbd-4632-a343-3e93c1e6e6e8" (UID: "48689e0d-afbd-4632-a343-3e93c1e6e6e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:34:32.024757 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.024696    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "48689e0d-afbd-4632-a343-3e93c1e6e6e8" (UID: "48689e0d-afbd-4632-a343-3e93c1e6e6e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:34:32.024757 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.024742    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48689e0d-afbd-4632-a343-3e93c1e6e6e8-kube-api-access-wsl7p" (OuterVolumeSpecName: "kube-api-access-wsl7p") pod "48689e0d-afbd-4632-a343-3e93c1e6e6e8" (UID: "48689e0d-afbd-4632-a343-3e93c1e6e6e8"). InnerVolumeSpecName "kube-api-access-wsl7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:34:32.123545 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.123515    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-trusted-ca-bundle\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:32.123545 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.123540    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-oauth-config\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:32.123545 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.123550    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-config\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:32.123778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.123559    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsl7p\" (UniqueName: \"kubernetes.io/projected/48689e0d-afbd-4632-a343-3e93c1e6e6e8-kube-api-access-wsl7p\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:32.123778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.123568    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:32.123778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.123577    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48689e0d-afbd-4632-a343-3e93c1e6e6e8-console-serving-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:32.123778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.123585    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48689e0d-afbd-4632-a343-3e93c1e6e6e8-oauth-serving-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:32.621826 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.621792    2563 generic.go:356] "Generic (PLEG): container finished" podID="48689e0d-afbd-4632-a343-3e93c1e6e6e8" containerID="0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce" exitCode=0
Sep 17 17:34:32.622014 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.621838    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6955f6b9d7-pcdqc"
Sep 17 17:34:32.622014 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.621879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6955f6b9d7-pcdqc" event={"ID":"48689e0d-afbd-4632-a343-3e93c1e6e6e8","Type":"ContainerDied","Data":"0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce"}
Sep 17 17:34:32.622014 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.621934    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6955f6b9d7-pcdqc" event={"ID":"48689e0d-afbd-4632-a343-3e93c1e6e6e8","Type":"ContainerDied","Data":"d5ccb9344a276934df67e8ece758be578c0f5224448d6bde90033702de0e3949"}
Sep 17 17:34:32.622014 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.621961    2563 scope.go:117] "RemoveContainer" containerID="0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce"
Sep 17 17:34:32.630487 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.630470    2563 scope.go:117] "RemoveContainer" containerID="0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce"
Sep 17 17:34:32.630758 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:34:32.630740    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce\": container with ID starting with 0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce not found: ID does not exist" containerID="0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce"
Sep 17 17:34:32.630806 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.630767    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce"} err="failed to get container status \"0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce\": rpc error: code = NotFound desc = could not find container \"0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce\": container with ID starting with 0eebc6bbfb577fb0c634e27d26d8d14b99d85915b721d10af2f188f68821e4ce not found: ID does not exist"
Sep 17 17:34:32.643833 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.643809    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6955f6b9d7-pcdqc"]
Sep 17 17:34:32.649102 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:32.649082    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6955f6b9d7-pcdqc"]
Sep 17 17:34:33.613069 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:33.613040    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48689e0d-afbd-4632-a343-3e93c1e6e6e8" path="/var/lib/kubelet/pods/48689e0d-afbd-4632-a343-3e93c1e6e6e8/volumes"
Sep 17 17:34:42.640064 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:42.640011    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-648dfbc974-xh5bm" podUID="7715e00e-07b1-47c9-95be-632625798991" containerName="console" containerID="cri-o://80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135" gracePeriod=15
Sep 17 17:34:42.918150 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:42.918090    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:34:43.018081 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.018050    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-oauth-config\") pod \"7715e00e-07b1-47c9-95be-632625798991\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") "
Sep 17 17:34:43.018081 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.018080    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-trusted-ca-bundle\") pod \"7715e00e-07b1-47c9-95be-632625798991\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") "
Sep 17 17:34:43.018305 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.018130    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-serving-cert\") pod \"7715e00e-07b1-47c9-95be-632625798991\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") "
Sep 17 17:34:43.018305 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.018234    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7gwc\" (UniqueName: \"kubernetes.io/projected/7715e00e-07b1-47c9-95be-632625798991-kube-api-access-k7gwc\") pod \"7715e00e-07b1-47c9-95be-632625798991\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") "
Sep 17 17:34:43.018305 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.018266    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-oauth-serving-cert\") pod \"7715e00e-07b1-47c9-95be-632625798991\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") "
Sep 17 17:34:43.018472 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.018305    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-console-config\") pod \"7715e00e-07b1-47c9-95be-632625798991\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") "
Sep 17 17:34:43.018472 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.018328    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-service-ca\") pod \"7715e00e-07b1-47c9-95be-632625798991\" (UID: \"7715e00e-07b1-47c9-95be-632625798991\") "
Sep 17 17:34:43.018632 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.018607    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7715e00e-07b1-47c9-95be-632625798991" (UID: "7715e00e-07b1-47c9-95be-632625798991"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:43.018717 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.018634    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7715e00e-07b1-47c9-95be-632625798991" (UID: "7715e00e-07b1-47c9-95be-632625798991"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:43.018896 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.018868    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-service-ca" (OuterVolumeSpecName: "service-ca") pod "7715e00e-07b1-47c9-95be-632625798991" (UID: "7715e00e-07b1-47c9-95be-632625798991"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:43.019047 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.019027    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-console-config" (OuterVolumeSpecName: "console-config") pod "7715e00e-07b1-47c9-95be-632625798991" (UID: "7715e00e-07b1-47c9-95be-632625798991"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:34:43.020272 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.020254    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7715e00e-07b1-47c9-95be-632625798991" (UID: "7715e00e-07b1-47c9-95be-632625798991"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:34:43.020673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.020652    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7715e00e-07b1-47c9-95be-632625798991" (UID: "7715e00e-07b1-47c9-95be-632625798991"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:34:43.020757 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.020652    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7715e00e-07b1-47c9-95be-632625798991-kube-api-access-k7gwc" (OuterVolumeSpecName: "kube-api-access-k7gwc") pod "7715e00e-07b1-47c9-95be-632625798991" (UID: "7715e00e-07b1-47c9-95be-632625798991"). InnerVolumeSpecName "kube-api-access-k7gwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:34:43.119341 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.119312    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-serving-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:43.119341 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.119340    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7gwc\" (UniqueName: \"kubernetes.io/projected/7715e00e-07b1-47c9-95be-632625798991-kube-api-access-k7gwc\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:43.119495 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.119354    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-oauth-serving-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:43.119495 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.119366    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-console-config\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:43.119495 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.119377    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:43.119495 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.119388    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7715e00e-07b1-47c9-95be-632625798991-console-oauth-config\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:43.119495 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.119400    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7715e00e-07b1-47c9-95be-632625798991-trusted-ca-bundle\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:34:43.688490 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.688460    2563 generic.go:356] "Generic (PLEG): container finished" podID="7715e00e-07b1-47c9-95be-632625798991" containerID="80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135" exitCode=0
Sep 17 17:34:43.688874 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.688501    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648dfbc974-xh5bm"
Sep 17 17:34:43.688874 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.688549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648dfbc974-xh5bm" event={"ID":"7715e00e-07b1-47c9-95be-632625798991","Type":"ContainerDied","Data":"80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135"}
Sep 17 17:34:43.688874 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.688596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648dfbc974-xh5bm" event={"ID":"7715e00e-07b1-47c9-95be-632625798991","Type":"ContainerDied","Data":"8ad0bd43822b207f221b070c0da192a0899f14384107dfe3c32e889404d303df"}
Sep 17 17:34:43.688874 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.688622    2563 scope.go:117] "RemoveContainer" containerID="80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135"
Sep 17 17:34:43.696941 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.696924    2563 scope.go:117] "RemoveContainer" containerID="80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135"
Sep 17 17:34:43.697239 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:34:43.697218    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135\": container with ID starting with 80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135 not found: ID does not exist" containerID="80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135"
Sep 17 17:34:43.697313 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.697247    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135"} err="failed to get container status \"80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135\": rpc error: code = NotFound desc = could not find container \"80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135\": container with ID starting with 80e27c62347f1f53375b60e7d8cd01cfbf82e35f22cc91b4be1e8032adda8135 not found: ID does not exist"
Sep 17 17:34:43.705214 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.705193    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648dfbc974-xh5bm"]
Sep 17 17:34:43.708558 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:43.708536    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-648dfbc974-xh5bm"]
Sep 17 17:34:45.612915 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:34:45.612885    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7715e00e-07b1-47c9-95be-632625798991" path="/var/lib/kubelet/pods/7715e00e-07b1-47c9-95be-632625798991/volumes"
Sep 17 17:35:03.223965 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:03.223925    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:35:03.243432 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:03.243407    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:35:03.793894 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:03.793867    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 17:35:31.315457 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.315372    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-674477c4d8-97nkb"]
Sep 17 17:35:31.316172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.315873    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" containerName="console"
Sep 17 17:35:31.316172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.315892    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" containerName="console"
Sep 17 17:35:31.316172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.315904    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48689e0d-afbd-4632-a343-3e93c1e6e6e8" containerName="console"
Sep 17 17:35:31.316172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.315914    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="48689e0d-afbd-4632-a343-3e93c1e6e6e8" containerName="console"
Sep 17 17:35:31.316172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.315939    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7715e00e-07b1-47c9-95be-632625798991" containerName="console"
Sep 17 17:35:31.316172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.315948    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7715e00e-07b1-47c9-95be-632625798991" containerName="console"
Sep 17 17:35:31.316172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.316050    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="48689e0d-afbd-4632-a343-3e93c1e6e6e8" containerName="console"
Sep 17 17:35:31.316172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.316063    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f2c9223-9d59-408a-bc8c-3e5195fa7b0b" containerName="console"
Sep 17 17:35:31.316172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.316076    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7715e00e-07b1-47c9-95be-632625798991" containerName="console"
Sep 17 17:35:31.318345 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.318313    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.332634 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.332615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674477c4d8-97nkb"]
Sep 17 17:35:31.418333 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.418288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-serving-cert\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.418529 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.418351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-oauth-config\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.418529 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.418393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-trusted-ca-bundle\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.418529 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.418420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-oauth-serving-cert\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.418529 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.418454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-console-config\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.418529 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.418484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k869\" (UniqueName: \"kubernetes.io/projected/aabded83-0bf5-444c-9be5-9e880e5431ea-kube-api-access-5k869\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.418529 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.418508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-service-ca\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.518917 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.518886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k869\" (UniqueName: \"kubernetes.io/projected/aabded83-0bf5-444c-9be5-9e880e5431ea-kube-api-access-5k869\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.518917 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.518919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-service-ca\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.519139 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.518978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-serving-cert\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.519139 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.519019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-oauth-config\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.519139 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.519067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-trusted-ca-bundle\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.519139 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.519095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-oauth-serving-cert\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.519139 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.519121    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-console-config\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.519813 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.519774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-service-ca\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.519953 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.519814    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-oauth-serving-cert\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.519953 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.519885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-console-config\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.519953 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.519924    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-trusted-ca-bundle\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.521479 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.521456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-serving-cert\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.521552 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.521495    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-oauth-config\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.526906 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.526888    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k869\" (UniqueName: \"kubernetes.io/projected/aabded83-0bf5-444c-9be5-9e880e5431ea-kube-api-access-5k869\") pod \"console-674477c4d8-97nkb\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") " pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.628076 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.627986    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:31.901634 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:31.901612    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674477c4d8-97nkb"]
Sep 17 17:35:31.904276 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:35:31.904238    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaabded83_0bf5_444c_9be5_9e880e5431ea.slice/crio-a63757766caa4339083b4e78e1b62963efe0390fcf20e57ee7440ed9f3ee29b8 WatchSource:0}: Error finding container a63757766caa4339083b4e78e1b62963efe0390fcf20e57ee7440ed9f3ee29b8: Status 404 returned error can't find the container with id a63757766caa4339083b4e78e1b62963efe0390fcf20e57ee7440ed9f3ee29b8
Sep 17 17:35:32.899821 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:32.899778    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674477c4d8-97nkb" event={"ID":"aabded83-0bf5-444c-9be5-9e880e5431ea","Type":"ContainerStarted","Data":"0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c"}
Sep 17 17:35:32.900206 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:32.899864    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674477c4d8-97nkb" event={"ID":"aabded83-0bf5-444c-9be5-9e880e5431ea","Type":"ContainerStarted","Data":"a63757766caa4339083b4e78e1b62963efe0390fcf20e57ee7440ed9f3ee29b8"}
Sep 17 17:35:32.924383 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:32.924329    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-674477c4d8-97nkb" podStartSLOduration=1.924290494 podStartE2EDuration="1.924290494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:32.92399083 +0000 UTC m=+259.574896823" watchObservedRunningTime="2026-09-17 17:35:32.924290494 +0000 UTC m=+259.575196484"
Sep 17 17:35:41.628233 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:41.628200    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:41.628723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:41.628250    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:41.633112 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:41.633089    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:41.943755 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:41.943664    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:35:41.991970 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:35:41.991930    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b99cdcb85-lshfq"]
Sep 17 17:36:07.012123 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.012056    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b99cdcb85-lshfq" podUID="11a1376b-f268-4940-88cb-132d89bbd294" containerName="console" containerID="cri-o://e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c" gracePeriod=15
Sep 17 17:36:07.258478 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.258451    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:36:07.420998 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.420966    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-oauth-serving-cert\") pod \"11a1376b-f268-4940-88cb-132d89bbd294\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") "
Sep 17 17:36:07.420998 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpnds\" (UniqueName: \"kubernetes.io/projected/11a1376b-f268-4940-88cb-132d89bbd294-kube-api-access-hpnds\") pod \"11a1376b-f268-4940-88cb-132d89bbd294\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") "
Sep 17 17:36:07.421211 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421016    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-service-ca\") pod \"11a1376b-f268-4940-88cb-132d89bbd294\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") "
Sep 17 17:36:07.421211 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421052    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-serving-cert\") pod \"11a1376b-f268-4940-88cb-132d89bbd294\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") "
Sep 17 17:36:07.421211 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-console-config\") pod \"11a1376b-f268-4940-88cb-132d89bbd294\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") "
Sep 17 17:36:07.421351 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421220    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-trusted-ca-bundle\") pod \"11a1376b-f268-4940-88cb-132d89bbd294\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") "
Sep 17 17:36:07.421351 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421248    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-oauth-config\") pod \"11a1376b-f268-4940-88cb-132d89bbd294\" (UID: \"11a1376b-f268-4940-88cb-132d89bbd294\") "
Sep 17 17:36:07.421458 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421344    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-service-ca" (OuterVolumeSpecName: "service-ca") pod "11a1376b-f268-4940-88cb-132d89bbd294" (UID: "11a1376b-f268-4940-88cb-132d89bbd294"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:36:07.421513 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421469    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11a1376b-f268-4940-88cb-132d89bbd294" (UID: "11a1376b-f268-4940-88cb-132d89bbd294"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:36:07.421579 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421553    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-oauth-serving-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:36:07.421579 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421568    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:36:07.421756 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421584    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-console-config" (OuterVolumeSpecName: "console-config") pod "11a1376b-f268-4940-88cb-132d89bbd294" (UID: "11a1376b-f268-4940-88cb-132d89bbd294"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:36:07.421756 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.421613    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11a1376b-f268-4940-88cb-132d89bbd294" (UID: "11a1376b-f268-4940-88cb-132d89bbd294"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:36:07.423291 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.423263    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11a1376b-f268-4940-88cb-132d89bbd294" (UID: "11a1376b-f268-4940-88cb-132d89bbd294"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:36:07.423291 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.423272    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a1376b-f268-4940-88cb-132d89bbd294-kube-api-access-hpnds" (OuterVolumeSpecName: "kube-api-access-hpnds") pod "11a1376b-f268-4940-88cb-132d89bbd294" (UID: "11a1376b-f268-4940-88cb-132d89bbd294"). InnerVolumeSpecName "kube-api-access-hpnds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:36:07.423614 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.423590    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11a1376b-f268-4940-88cb-132d89bbd294" (UID: "11a1376b-f268-4940-88cb-132d89bbd294"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:36:07.522000 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.521971    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-serving-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:36:07.522000 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.521996    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-console-config\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:36:07.522000 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.522005    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11a1376b-f268-4940-88cb-132d89bbd294-trusted-ca-bundle\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:36:07.522214 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.522013    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11a1376b-f268-4940-88cb-132d89bbd294-console-oauth-config\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:36:07.522214 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:07.522023    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpnds\" (UniqueName: \"kubernetes.io/projected/11a1376b-f268-4940-88cb-132d89bbd294-kube-api-access-hpnds\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:36:08.042348 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:08.042302    2563 generic.go:356] "Generic (PLEG): container finished" podID="11a1376b-f268-4940-88cb-132d89bbd294" containerID="e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c" exitCode=0
Sep 17 17:36:08.042762 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:08.042358    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b99cdcb85-lshfq"
Sep 17 17:36:08.042762 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:08.042389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b99cdcb85-lshfq" event={"ID":"11a1376b-f268-4940-88cb-132d89bbd294","Type":"ContainerDied","Data":"e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c"}
Sep 17 17:36:08.042762 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:08.042446    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b99cdcb85-lshfq" event={"ID":"11a1376b-f268-4940-88cb-132d89bbd294","Type":"ContainerDied","Data":"87a183f739ff6df174cb06cdb82cfb4be555c3178885ce1bc9b2f7fcc127508f"}
Sep 17 17:36:08.042762 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:08.042467    2563 scope.go:117] "RemoveContainer" containerID="e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c"
Sep 17 17:36:08.050639 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:08.050622    2563 scope.go:117] "RemoveContainer" containerID="e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c"
Sep 17 17:36:08.050933 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:36:08.050911    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c\": container with ID starting with e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c not found: ID does not exist" containerID="e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c"
Sep 17 17:36:08.050979 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:08.050943    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c"} err="failed to get container status \"e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c\": rpc error: code = NotFound desc = could not find container \"e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c\": container with ID starting with e7a952f66ec95450d353a021c9c5178c5808c9d388cd66c8ba627983c5f0a58c not found: ID does not exist"
Sep 17 17:36:08.059639 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:08.059618    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b99cdcb85-lshfq"]
Sep 17 17:36:08.063410 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:08.063389    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b99cdcb85-lshfq"]
Sep 17 17:36:09.613234 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:09.613202    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11a1376b-f268-4940-88cb-132d89bbd294" path="/var/lib/kubelet/pods/11a1376b-f268-4940-88cb-132d89bbd294/volumes"
Sep 17 17:36:15.518156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:15.518127    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:36:15.520222 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:15.520197    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:36:15.522063 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:15.522042    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:36:15.524360 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:15.524341    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:36:15.529421 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:15.529393    2563 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 17:36:54.930766 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:54.930725    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47"]
Sep 17 17:36:54.931302 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:54.931282    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a1376b-f268-4940-88cb-132d89bbd294" containerName="console"
Sep 17 17:36:54.931381 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:54.931306    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a1376b-f268-4940-88cb-132d89bbd294" containerName="console"
Sep 17 17:36:54.931431 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:54.931388    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="11a1376b-f268-4940-88cb-132d89bbd294" containerName="console"
Sep 17 17:36:54.933378 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:54.933359    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47"
Sep 17 17:36:54.935774 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:54.935753    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:36:54.935873 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:54.935755    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 17 17:36:54.936459 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:54.936444    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rdjjx\""
Sep 17 17:36:54.945676 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:54.945655    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47"]
Sep 17 17:36:54.994074 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:54.994049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f22677f5-11fa-4785-a6c0-8ce74d16a008-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2vk47\" (UID: \"f22677f5-11fa-4785-a6c0-8ce74d16a008\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47"
Sep 17 17:36:54.994208 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:54.994083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgvzr\" (UniqueName: \"kubernetes.io/projected/f22677f5-11fa-4785-a6c0-8ce74d16a008-kube-api-access-tgvzr\") pod \"openshift-lws-operator-fd8ccff4c-2vk47\" (UID: \"f22677f5-11fa-4785-a6c0-8ce74d16a008\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47"
Sep 17 17:36:55.094987 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:55.094953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f22677f5-11fa-4785-a6c0-8ce74d16a008-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2vk47\" (UID: \"f22677f5-11fa-4785-a6c0-8ce74d16a008\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47"
Sep 17 17:36:55.095145 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:55.095001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgvzr\" (UniqueName: \"kubernetes.io/projected/f22677f5-11fa-4785-a6c0-8ce74d16a008-kube-api-access-tgvzr\") pod \"openshift-lws-operator-fd8ccff4c-2vk47\" (UID: \"f22677f5-11fa-4785-a6c0-8ce74d16a008\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47"
Sep 17 17:36:55.095335 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:55.095314    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f22677f5-11fa-4785-a6c0-8ce74d16a008-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2vk47\" (UID: \"f22677f5-11fa-4785-a6c0-8ce74d16a008\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47"
Sep 17 17:36:55.107606 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:55.107584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgvzr\" (UniqueName: \"kubernetes.io/projected/f22677f5-11fa-4785-a6c0-8ce74d16a008-kube-api-access-tgvzr\") pod \"openshift-lws-operator-fd8ccff4c-2vk47\" (UID: \"f22677f5-11fa-4785-a6c0-8ce74d16a008\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47"
Sep 17 17:36:55.260316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:55.260246    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47"
Sep 17 17:36:55.531667 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:55.531642    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47"]
Sep 17 17:36:55.534404 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:36:55.534381    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf22677f5_11fa_4785_a6c0_8ce74d16a008.slice/crio-64a651f2b365e82dfa78289f73f5257dd926faf382a8ff2e5516e524c09e081f WatchSource:0}: Error finding container 64a651f2b365e82dfa78289f73f5257dd926faf382a8ff2e5516e524c09e081f: Status 404 returned error can't find the container with id 64a651f2b365e82dfa78289f73f5257dd926faf382a8ff2e5516e524c09e081f
Sep 17 17:36:55.535931 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:55.535913    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:36:56.237199 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:56.237164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47" event={"ID":"f22677f5-11fa-4785-a6c0-8ce74d16a008","Type":"ContainerStarted","Data":"64a651f2b365e82dfa78289f73f5257dd926faf382a8ff2e5516e524c09e081f"}
Sep 17 17:36:58.249129 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:58.249086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47" event={"ID":"f22677f5-11fa-4785-a6c0-8ce74d16a008","Type":"ContainerStarted","Data":"004011a446895e13dfd317129e1bed7d3cb095fc6e1ca9630d49694cf6089fb2"}
Sep 17 17:36:58.268336 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:36:58.268288    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vk47" podStartSLOduration=1.644365379 podStartE2EDuration="4.268271344s" totalImagesPullingTime="2.623905965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:58.266170155 +0000 UTC m=+344.917076147" watchObservedRunningTime="2026-09-17 17:36:58.268271344 +0000 UTC m=+344.919177335"
Sep 17 17:37:15.082004 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.081968    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"]
Sep 17 17:37:15.084553 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.084535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.104434 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.104398    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 17:37:15.104649 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.104632    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jt585\""
Sep 17 17:37:15.107261 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.107245    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 17:37:15.107533 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.107520    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 17:37:15.108307 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.108285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 17:37:15.135286 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.135247    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"]
Sep 17 17:37:15.161147 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.161119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c8f8652-a87c-4124-868c-9123ebc11e6d-manifests\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.161283 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.161168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c8f8652-a87c-4124-868c-9123ebc11e6d-tmp\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.161283 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.161189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c8f8652-a87c-4124-868c-9123ebc11e6d-webhook-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.161283 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.161271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c8f8652-a87c-4124-868c-9123ebc11e6d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.161415 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.161351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7dd2\" (UniqueName: \"kubernetes.io/projected/8c8f8652-a87c-4124-868c-9123ebc11e6d-kube-api-access-s7dd2\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.262063 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.262033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7dd2\" (UniqueName: \"kubernetes.io/projected/8c8f8652-a87c-4124-868c-9123ebc11e6d-kube-api-access-s7dd2\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.262063 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.262068    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c8f8652-a87c-4124-868c-9123ebc11e6d-manifests\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.262275 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.262092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c8f8652-a87c-4124-868c-9123ebc11e6d-tmp\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.262275 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.262221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c8f8652-a87c-4124-868c-9123ebc11e6d-webhook-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.262387 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.262315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c8f8652-a87c-4124-868c-9123ebc11e6d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.262536 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.262500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c8f8652-a87c-4124-868c-9123ebc11e6d-manifests\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.264351 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.264325    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c8f8652-a87c-4124-868c-9123ebc11e6d-tmp\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.264629 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.264611    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c8f8652-a87c-4124-868c-9123ebc11e6d-webhook-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.264670 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.264617    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c8f8652-a87c-4124-868c-9123ebc11e6d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.273500 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.273480    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7dd2\" (UniqueName: \"kubernetes.io/projected/8c8f8652-a87c-4124-868c-9123ebc11e6d-kube-api-access-s7dd2\") pod \"opendatahub-operator-controller-manager-584f5b8894-jp4sp\" (UID: \"8c8f8652-a87c-4124-868c-9123ebc11e6d\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.394195 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.394123    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:15.674770 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:15.674671    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"]
Sep 17 17:37:15.677025 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:37:15.676994    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8f8652_a87c_4124_868c_9123ebc11e6d.slice/crio-e82d17a9efc4d6a762a3422e0503deffe9c527647f40d3d667f7fdb5f27a0b91 WatchSource:0}: Error finding container e82d17a9efc4d6a762a3422e0503deffe9c527647f40d3d667f7fdb5f27a0b91: Status 404 returned error can't find the container with id e82d17a9efc4d6a762a3422e0503deffe9c527647f40d3d667f7fdb5f27a0b91
Sep 17 17:37:16.323695 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:16.323661    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp" event={"ID":"8c8f8652-a87c-4124-868c-9123ebc11e6d","Type":"ContainerStarted","Data":"e82d17a9efc4d6a762a3422e0503deffe9c527647f40d3d667f7fdb5f27a0b91"}
Sep 17 17:37:19.342688 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:19.342652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp" event={"ID":"8c8f8652-a87c-4124-868c-9123ebc11e6d","Type":"ContainerStarted","Data":"68d4331ab034d335095b329de2f113a3d7252629319e5b3940aa211085b0eb78"}
Sep 17 17:37:20.349140 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:20.349102    2563 generic.go:356] "Generic (PLEG): container finished" podID="8c8f8652-a87c-4124-868c-9123ebc11e6d" containerID="68d4331ab034d335095b329de2f113a3d7252629319e5b3940aa211085b0eb78" exitCode=0
Sep 17 17:37:20.349540 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:20.349141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp" event={"ID":"8c8f8652-a87c-4124-868c-9123ebc11e6d","Type":"ContainerDied","Data":"68d4331ab034d335095b329de2f113a3d7252629319e5b3940aa211085b0eb78"}
Sep 17 17:37:21.355333 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:21.355299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp" event={"ID":"8c8f8652-a87c-4124-868c-9123ebc11e6d","Type":"ContainerStarted","Data":"11a4be1c1f1a30afab11508306b2266ab2dd3ed6083fa88f4b0dd1ff38737c1b"}
Sep 17 17:37:21.355875 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:21.355424    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:21.382319 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:21.382269    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp" podStartSLOduration=1.895157078 podStartE2EDuration="6.382250399s" totalImagesPullingTime="3.410813449s" totalInitContainerRuntime="1.076279872s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:21.380487237 +0000 UTC m=+368.031393228" watchObservedRunningTime="2026-09-17 17:37:21.382250399 +0000 UTC m=+368.033156391"
Sep 17 17:37:32.363310 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:32.363277    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-jp4sp"
Sep 17 17:37:37.606818 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.606787    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"]
Sep 17 17:37:37.616094 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.616066    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.620304 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.620274    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xd4hn\""
Sep 17 17:37:37.620450 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.620433    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 17 17:37:37.620599 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.620275    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 17 17:37:37.620864 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.620846    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 17 17:37:37.622689 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.622665    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"]
Sep 17 17:37:37.655154 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.655123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/891ec8f4-0be7-4d97-935a-be700d9b0dd7-metrics-cert\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.655316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.655169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxrmq\" (UniqueName: \"kubernetes.io/projected/891ec8f4-0be7-4d97-935a-be700d9b0dd7-kube-api-access-bxrmq\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.655398 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.655310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/891ec8f4-0be7-4d97-935a-be700d9b0dd7-manager-config\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.655456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.655434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/891ec8f4-0be7-4d97-935a-be700d9b0dd7-cert\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.756239 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.756214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/891ec8f4-0be7-4d97-935a-be700d9b0dd7-metrics-cert\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.756376 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.756246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxrmq\" (UniqueName: \"kubernetes.io/projected/891ec8f4-0be7-4d97-935a-be700d9b0dd7-kube-api-access-bxrmq\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.756376 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.756277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/891ec8f4-0be7-4d97-935a-be700d9b0dd7-manager-config\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.756376 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.756322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/891ec8f4-0be7-4d97-935a-be700d9b0dd7-cert\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.757003 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.756979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/891ec8f4-0be7-4d97-935a-be700d9b0dd7-manager-config\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.758794 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.758768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/891ec8f4-0be7-4d97-935a-be700d9b0dd7-metrics-cert\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.758876 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.758831    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/891ec8f4-0be7-4d97-935a-be700d9b0dd7-cert\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.768783 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.768759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxrmq\" (UniqueName: \"kubernetes.io/projected/891ec8f4-0be7-4d97-935a-be700d9b0dd7-kube-api-access-bxrmq\") pod \"lws-controller-manager-79bc5f98c4-smrdx\" (UID: \"891ec8f4-0be7-4d97-935a-be700d9b0dd7\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:37.926637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:37.926557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:38.195439 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:38.195415    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"]
Sep 17 17:37:38.197931 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:37:38.197905    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891ec8f4_0be7_4d97_935a_be700d9b0dd7.slice/crio-dd42417e8e1ddb0ca90e8e6677e5d9be37787beb6d35cce6ccac983cce5b7300 WatchSource:0}: Error finding container dd42417e8e1ddb0ca90e8e6677e5d9be37787beb6d35cce6ccac983cce5b7300: Status 404 returned error can't find the container with id dd42417e8e1ddb0ca90e8e6677e5d9be37787beb6d35cce6ccac983cce5b7300
Sep 17 17:37:38.432582 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:38.432548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx" event={"ID":"891ec8f4-0be7-4d97-935a-be700d9b0dd7","Type":"ContainerStarted","Data":"dd42417e8e1ddb0ca90e8e6677e5d9be37787beb6d35cce6ccac983cce5b7300"}
Sep 17 17:37:40.443016 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:40.442981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx" event={"ID":"891ec8f4-0be7-4d97-935a-be700d9b0dd7","Type":"ContainerStarted","Data":"33eee43e3e51298cadf5dbd5472e65455414f270f7ee649e7ccb3c602b2d406b"}
Sep 17 17:37:40.443386 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:40.443091    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:40.465464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:40.465414    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx" podStartSLOduration=1.918604024 podStartE2EDuration="3.465398302s" totalImagesPullingTime="1.546794278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:40.464263928 +0000 UTC m=+387.115169924" watchObservedRunningTime="2026-09-17 17:37:40.465398302 +0000 UTC m=+387.116304339"
Sep 17 17:37:41.399127 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.399099    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"]
Sep 17 17:37:41.401379 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.401362    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.403830 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.403812    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hqps6\""
Sep 17 17:37:41.404158 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.404069    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 17:37:41.404295 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.404277    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 17:37:41.404556 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.404540    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 17:37:41.424050 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.424022    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"]
Sep 17 17:37:41.473602 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.473575    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"]
Sep 17 17:37:41.475696 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.475680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.485354 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.485329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.485457 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.485368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.485535 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.485477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.485535 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.485502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.485640 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.485535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.485640 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.485613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.485733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.485676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.485733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.485714    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.485800 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.485755    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khrjf\" (UniqueName: \"kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-kube-api-access-khrjf\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.497236 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.497214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"]
Sep 17 17:37:41.586992 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.586962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.587153 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.586999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.587153 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.587153 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.587153 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.587153 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.587153 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.587464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.587464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.587464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.587464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khrjf\" (UniqueName: \"kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-kube-api-access-khrjf\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.587464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.587464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.587464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.587464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587401    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.587464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.587464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.587464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.588007 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ce9be34-3680-42d5-8821-55f2e003bba4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.588007 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kgph\" (UniqueName: \"kubernetes.io/projected/0ce9be34-3680-42d5-8821-55f2e003bba4-kube-api-access-6kgph\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.588007 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.588007 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.587860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.588007 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.588000    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.589477 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.589457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.589793 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.589773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.606772 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.606747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.607083 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.607062    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khrjf\" (UniqueName: \"kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-kube-api-access-khrjf\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.688768 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.688676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.688768 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.688755    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.688974 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.688790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.688974 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.688821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ce9be34-3680-42d5-8821-55f2e003bba4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.688974 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.688845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kgph\" (UniqueName: \"kubernetes.io/projected/0ce9be34-3680-42d5-8821-55f2e003bba4-kube-api-access-6kgph\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.688974 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.688916    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.688974 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.688962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.689235 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.688986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.689235 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.689012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.689340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.689233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.689340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.689326    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.689442 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.689363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.689442 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.689416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.689601 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.689583    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ce9be34-3680-42d5-8821-55f2e003bba4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.691266 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.691240    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.691359 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.691328    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.706489 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.706467    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kgph\" (UniqueName: \"kubernetes.io/projected/0ce9be34-3680-42d5-8821-55f2e003bba4-kube-api-access-6kgph\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.713318 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.713301    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:41.724180 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.724156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ce9be34-3680-42d5-8821-55f2e003bba4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl\" (UID: \"0ce9be34-3680-42d5-8821-55f2e003bba4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.786019 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.785991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:41.986621 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:41.986591    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"]
Sep 17 17:37:41.988619 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:37:41.988597    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527b6752_2564_4f4e_bbfb_eb8d7a39c667.slice/crio-0193a99695444a6838df50bbddcf4a16259697ff8ec80db827fd72309bbbaf2a WatchSource:0}: Error finding container 0193a99695444a6838df50bbddcf4a16259697ff8ec80db827fd72309bbbaf2a: Status 404 returned error can't find the container with id 0193a99695444a6838df50bbddcf4a16259697ff8ec80db827fd72309bbbaf2a
Sep 17 17:37:42.063549 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:42.063526    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"]
Sep 17 17:37:42.064776 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:37:42.064753    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce9be34_3680_42d5_8821_55f2e003bba4.slice/crio-be685062a329e1ec16af01dcaa584a7cb54fb4139a671f47cd04700c329f14f7 WatchSource:0}: Error finding container be685062a329e1ec16af01dcaa584a7cb54fb4139a671f47cd04700c329f14f7: Status 404 returned error can't find the container with id be685062a329e1ec16af01dcaa584a7cb54fb4139a671f47cd04700c329f14f7
Sep 17 17:37:42.457512 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:42.457389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl" event={"ID":"0ce9be34-3680-42d5-8821-55f2e003bba4","Type":"ContainerStarted","Data":"be685062a329e1ec16af01dcaa584a7cb54fb4139a671f47cd04700c329f14f7"}
Sep 17 17:37:42.461171 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:42.461141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5" event={"ID":"527b6752-2564-4f4e-bbfb-eb8d7a39c667","Type":"ContainerStarted","Data":"0193a99695444a6838df50bbddcf4a16259697ff8ec80db827fd72309bbbaf2a"}
Sep 17 17:37:44.527972 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:44.527927    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:37:44.528262 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:44.528010    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:37:44.528262 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:44.528040    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:37:44.536648 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:44.536616    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:37:44.536756 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:44.536675    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:37:44.536756 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:44.536720    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:37:45.354371 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.354341    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wzc29"]
Sep 17 17:37:45.356720 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.356688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wzc29"
Sep 17 17:37:45.359059 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.359040    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kntdg\""
Sep 17 17:37:45.359179 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.359042    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 17 17:37:45.369414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.369393    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wzc29"]
Sep 17 17:37:45.423116 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.423082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3649c3a-4c63-4b7d-b0ad-2a062722e10c-cert\") pod \"odh-model-controller-7998c67dc4-wzc29\" (UID: \"f3649c3a-4c63-4b7d-b0ad-2a062722e10c\") " pod="opendatahub/odh-model-controller-7998c67dc4-wzc29"
Sep 17 17:37:45.423264 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.423158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2kdn\" (UniqueName: \"kubernetes.io/projected/f3649c3a-4c63-4b7d-b0ad-2a062722e10c-kube-api-access-l2kdn\") pod \"odh-model-controller-7998c67dc4-wzc29\" (UID: \"f3649c3a-4c63-4b7d-b0ad-2a062722e10c\") " pod="opendatahub/odh-model-controller-7998c67dc4-wzc29"
Sep 17 17:37:45.477810 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.477775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl" event={"ID":"0ce9be34-3680-42d5-8821-55f2e003bba4","Type":"ContainerStarted","Data":"8504a82b7c1707f969359566dec827f5417e1a2df7f0dff401bd3fcaeb7ff1c3"}
Sep 17 17:37:45.479766 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.479736    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5" event={"ID":"527b6752-2564-4f4e-bbfb-eb8d7a39c667","Type":"ContainerStarted","Data":"f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c"}
Sep 17 17:37:45.505040 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.504989    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl" podStartSLOduration=2.035449983 podStartE2EDuration="4.504973198s" totalImagesPullingTime="2.469523215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:45.504109744 +0000 UTC m=+392.155015740" watchObservedRunningTime="2026-09-17 17:37:45.504973198 +0000 UTC m=+392.155879190"
Sep 17 17:37:45.524066 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.524034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3649c3a-4c63-4b7d-b0ad-2a062722e10c-cert\") pod \"odh-model-controller-7998c67dc4-wzc29\" (UID: \"f3649c3a-4c63-4b7d-b0ad-2a062722e10c\") " pod="opendatahub/odh-model-controller-7998c67dc4-wzc29"
Sep 17 17:37:45.524190 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.524110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2kdn\" (UniqueName: \"kubernetes.io/projected/f3649c3a-4c63-4b7d-b0ad-2a062722e10c-kube-api-access-l2kdn\") pod \"odh-model-controller-7998c67dc4-wzc29\" (UID: \"f3649c3a-4c63-4b7d-b0ad-2a062722e10c\") " pod="opendatahub/odh-model-controller-7998c67dc4-wzc29"
Sep 17 17:37:45.524190 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:37:45.524164    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 17 17:37:45.524298 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:37:45.524225    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3649c3a-4c63-4b7d-b0ad-2a062722e10c-cert podName:f3649c3a-4c63-4b7d-b0ad-2a062722e10c nodeName:}" failed. No retries permitted until 2026-09-17 17:37:46.024207054 +0000 UTC m=+392.675113041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3649c3a-4c63-4b7d-b0ad-2a062722e10c-cert") pod "odh-model-controller-7998c67dc4-wzc29" (UID: "f3649c3a-4c63-4b7d-b0ad-2a062722e10c") : secret "odh-model-controller-webhook-cert" not found
Sep 17 17:37:45.529238 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.529195    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5" podStartSLOduration=1.9923992510000001 podStartE2EDuration="4.52918128s" totalImagesPullingTime="2.536782029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:45.527993579 +0000 UTC m=+392.178899571" watchObservedRunningTime="2026-09-17 17:37:45.52918128 +0000 UTC m=+392.180087272"
Sep 17 17:37:45.532642 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.532623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2kdn\" (UniqueName: \"kubernetes.io/projected/f3649c3a-4c63-4b7d-b0ad-2a062722e10c-kube-api-access-l2kdn\") pod \"odh-model-controller-7998c67dc4-wzc29\" (UID: \"f3649c3a-4c63-4b7d-b0ad-2a062722e10c\") " pod="opendatahub/odh-model-controller-7998c67dc4-wzc29"
Sep 17 17:37:45.714012 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.713932    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:45.715332 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.715307    2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 17 17:37:45.715451 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.715354    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5" podUID="527b6752-2564-4f4e-bbfb-eb8d7a39c667" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 17 17:37:45.786524 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.786492    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:45.790776 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:45.790753    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:46.028165 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:46.028137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3649c3a-4c63-4b7d-b0ad-2a062722e10c-cert\") pod \"odh-model-controller-7998c67dc4-wzc29\" (UID: \"f3649c3a-4c63-4b7d-b0ad-2a062722e10c\") " pod="opendatahub/odh-model-controller-7998c67dc4-wzc29"
Sep 17 17:37:46.030692 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:46.030659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3649c3a-4c63-4b7d-b0ad-2a062722e10c-cert\") pod \"odh-model-controller-7998c67dc4-wzc29\" (UID: \"f3649c3a-4c63-4b7d-b0ad-2a062722e10c\") " pod="opendatahub/odh-model-controller-7998c67dc4-wzc29"
Sep 17 17:37:46.266561 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:46.266521    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wzc29"
Sep 17 17:37:46.485374 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:46.485333    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:46.486277 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:46.486256    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl"
Sep 17 17:37:46.540742 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:46.540720    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wzc29"]
Sep 17 17:37:46.543520 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:37:46.543488    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3649c3a_4c63_4b7d_b0ad_2a062722e10c.slice/crio-b5bdf45ffdc0714d56c06d3abf5e80501667723a3ce8c6a05b43bd570181ad73 WatchSource:0}: Error finding container b5bdf45ffdc0714d56c06d3abf5e80501667723a3ce8c6a05b43bd570181ad73: Status 404 returned error can't find the container with id b5bdf45ffdc0714d56c06d3abf5e80501667723a3ce8c6a05b43bd570181ad73
Sep 17 17:37:46.546469 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:46.546448    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"]
Sep 17 17:37:46.714609 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:46.714575    2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 17 17:37:46.714784 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:46.714625    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5" podUID="527b6752-2564-4f4e-bbfb-eb8d7a39c667" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 17 17:37:47.491673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:47.491636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wzc29" event={"ID":"f3649c3a-4c63-4b7d-b0ad-2a062722e10c","Type":"ContainerStarted","Data":"b5bdf45ffdc0714d56c06d3abf5e80501667723a3ce8c6a05b43bd570181ad73"}
Sep 17 17:37:47.714576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:47.714528    2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 17 17:37:47.715049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:47.714599    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5" podUID="527b6752-2564-4f4e-bbfb-eb8d7a39c667" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 17 17:37:48.498496 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:48.498374    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5" podUID="527b6752-2564-4f4e-bbfb-eb8d7a39c667" containerName="istio-proxy" containerID="cri-o://f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c" gracePeriod=30
Sep 17 17:37:49.505397 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:49.505308    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wzc29" event={"ID":"f3649c3a-4c63-4b7d-b0ad-2a062722e10c","Type":"ContainerStarted","Data":"f17c465172f57b2d0a1e4fc9be7aca9bf6776b01ddf0ea339602ab843b2c2ef5"}
Sep 17 17:37:49.505839 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:49.505533    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wzc29"
Sep 17 17:37:49.523577 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:49.523530    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wzc29" podStartSLOduration=1.838836035 podStartE2EDuration="4.523514945s" totalImagesPullingTime="2.68467891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:49.522060464 +0000 UTC m=+396.172966458" watchObservedRunningTime="2026-09-17 17:37:49.523514945 +0000 UTC m=+396.174420937"
Sep 17 17:37:51.448948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:51.448920    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-smrdx"
Sep 17 17:37:52.277928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.277894    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"]
Sep 17 17:37:52.280416 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.280400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.284162 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.284142    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 17:37:52.284428 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.284410    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7dllt\""
Sep 17 17:37:52.285325 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.285311    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 17:37:52.285753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.285740    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 17:37:52.299803 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.299783    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"]
Sep 17 17:37:52.389907 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.389878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb2c40fe-3483-4da9-a529-9676c8394b23-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.390054 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.389975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.390054 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.390009    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fb2c40fe-3483-4da9-a529-9676c8394b23-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.390054 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.390035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.390183 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.390071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.390183 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.390121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7vmw\" (UniqueName: \"kubernetes.io/projected/fb2c40fe-3483-4da9-a529-9676c8394b23-kube-api-access-b7vmw\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.390183 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.390142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.490923 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.490880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.490923 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.490929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fb2c40fe-3483-4da9-a529-9676c8394b23-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.491440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.490948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.491440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.490973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.491440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.491008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vmw\" (UniqueName: \"kubernetes.io/projected/fb2c40fe-3483-4da9-a529-9676c8394b23-kube-api-access-b7vmw\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.491440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.491035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.491440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.491238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb2c40fe-3483-4da9-a529-9676c8394b23-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.491807 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.491784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.493456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.493419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.493816 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.493792    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb2c40fe-3483-4da9-a529-9676c8394b23-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.494020 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.493997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.494259 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.494241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fb2c40fe-3483-4da9-a529-9676c8394b23-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.503363 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.503341    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7vmw\" (UniqueName: \"kubernetes.io/projected/fb2c40fe-3483-4da9-a529-9676c8394b23-kube-api-access-b7vmw\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.503475 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.503441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb2c40fe-3483-4da9-a529-9676c8394b23-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xx257\" (UID: \"fb2c40fe-3483-4da9-a529-9676c8394b23\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.589770 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.589660    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:52.871571 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:52.871549    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"]
Sep 17 17:37:52.873367 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:37:52.873340    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2c40fe_3483_4da9_a529_9676c8394b23.slice/crio-88e85fc699d5f43bb5f7132ed9dda9c7f6cd23600c6daa3bd67bb604f84760d9 WatchSource:0}: Error finding container 88e85fc699d5f43bb5f7132ed9dda9c7f6cd23600c6daa3bd67bb604f84760d9: Status 404 returned error can't find the container with id 88e85fc699d5f43bb5f7132ed9dda9c7f6cd23600c6daa3bd67bb604f84760d9
Sep 17 17:37:53.531933 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.531903    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257" event={"ID":"fb2c40fe-3483-4da9-a529-9676c8394b23","Type":"ContainerStarted","Data":"88e85fc699d5f43bb5f7132ed9dda9c7f6cd23600c6daa3bd67bb604f84760d9"}
Sep 17 17:37:53.760235 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.760212    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:53.904633 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.904544    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istiod-ca-cert\") pod \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") "
Sep 17 17:37:53.904633 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.904586    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-socket\") pod \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") "
Sep 17 17:37:53.904633 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.904615    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-podinfo\") pod \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") "
Sep 17 17:37:53.904913 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.904648    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-credential-socket\") pod \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") "
Sep 17 17:37:53.904913 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.904674    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-envoy\") pod \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") "
Sep 17 17:37:53.904913 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.904735    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khrjf\" (UniqueName: \"kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-kube-api-access-khrjf\") pod \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") "
Sep 17 17:37:53.904913 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.904769    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-data\") pod \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") "
Sep 17 17:37:53.904913 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.904816    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-certs\") pod \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") "
Sep 17 17:37:53.904913 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.904874    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-token\") pod \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\" (UID: \"527b6752-2564-4f4e-bbfb-eb8d7a39c667\") "
Sep 17 17:37:53.905212 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.904911    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "527b6752-2564-4f4e-bbfb-eb8d7a39c667" (UID: "527b6752-2564-4f4e-bbfb-eb8d7a39c667"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:37:53.905212 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.905037    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "527b6752-2564-4f4e-bbfb-eb8d7a39c667" (UID: "527b6752-2564-4f4e-bbfb-eb8d7a39c667"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:37:53.905315 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.905217    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:37:53.905315 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.905238    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:37:53.905315 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.905260    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "527b6752-2564-4f4e-bbfb-eb8d7a39c667" (UID: "527b6752-2564-4f4e-bbfb-eb8d7a39c667"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:37:53.905460 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.905349    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-data" (OuterVolumeSpecName: "istio-data") pod "527b6752-2564-4f4e-bbfb-eb8d7a39c667" (UID: "527b6752-2564-4f4e-bbfb-eb8d7a39c667"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:37:53.905460 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.905415    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "527b6752-2564-4f4e-bbfb-eb8d7a39c667" (UID: "527b6752-2564-4f4e-bbfb-eb8d7a39c667"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:37:53.907754 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.907693    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "527b6752-2564-4f4e-bbfb-eb8d7a39c667" (UID: "527b6752-2564-4f4e-bbfb-eb8d7a39c667"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:37:53.907754 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.907684    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-kube-api-access-khrjf" (OuterVolumeSpecName: "kube-api-access-khrjf") pod "527b6752-2564-4f4e-bbfb-eb8d7a39c667" (UID: "527b6752-2564-4f4e-bbfb-eb8d7a39c667"). InnerVolumeSpecName "kube-api-access-khrjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:37:53.907965 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.907753    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-token" (OuterVolumeSpecName: "istio-token") pod "527b6752-2564-4f4e-bbfb-eb8d7a39c667" (UID: "527b6752-2564-4f4e-bbfb-eb8d7a39c667"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:37:53.907965 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:53.907870    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "527b6752-2564-4f4e-bbfb-eb8d7a39c667" (UID: "527b6752-2564-4f4e-bbfb-eb8d7a39c667"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:37:54.005960 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.005923    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:37:54.005960 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.005957    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:37:54.005960 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.005968    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khrjf\" (UniqueName: \"kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-kube-api-access-khrjf\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:37:54.006192 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.005977    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:37:54.006192 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.005986    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/527b6752-2564-4f4e-bbfb-eb8d7a39c667-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:37:54.006192 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.005995    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:37:54.006192 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.006004    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/527b6752-2564-4f4e-bbfb-eb8d7a39c667-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:37:54.539853 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.539811    2563 generic.go:356] "Generic (PLEG): container finished" podID="527b6752-2564-4f4e-bbfb-eb8d7a39c667" containerID="f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c" exitCode=0
Sep 17 17:37:54.540330 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.539881    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"
Sep 17 17:37:54.540330 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.539912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5" event={"ID":"527b6752-2564-4f4e-bbfb-eb8d7a39c667","Type":"ContainerDied","Data":"f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c"}
Sep 17 17:37:54.540330 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.539965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5" event={"ID":"527b6752-2564-4f4e-bbfb-eb8d7a39c667","Type":"ContainerDied","Data":"0193a99695444a6838df50bbddcf4a16259697ff8ec80db827fd72309bbbaf2a"}
Sep 17 17:37:54.540330 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.539994    2563 scope.go:117] "RemoveContainer" containerID="f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c"
Sep 17 17:37:54.565217 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.565189    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"]
Sep 17 17:37:54.570439 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:54.570415    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6lp5"]
Sep 17 17:37:55.332687 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:55.332530    2563 scope.go:117] "RemoveContainer" containerID="f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c"
Sep 17 17:37:55.332916 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:37:55.332896    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c\": container with ID starting with f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c not found: ID does not exist" containerID="f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c"
Sep 17 17:37:55.332983 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:55.332930    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c"} err="failed to get container status \"f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c\": rpc error: code = NotFound desc = could not find container \"f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c\": container with ID starting with f82bc06e7db256c1e7dac4d3408a8c1ad6a6740d01a7725a2b140128fddc626c not found: ID does not exist"
Sep 17 17:37:55.366881 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:55.366850    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:37:55.366959 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:55.366911    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:37:55.547614 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:55.547577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257" event={"ID":"fb2c40fe-3483-4da9-a529-9676c8394b23","Type":"ContainerStarted","Data":"40d3eba7628cf670501dd5341a745a74c2672d82a4fb8e89b152e601848b085a"}
Sep 17 17:37:55.548122 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:55.547668    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:37:55.585247 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:55.585156    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257" podStartSLOduration=1.094323722 podStartE2EDuration="3.585141245s" totalImagesPullingTime="2.490817523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:55.584987743 +0000 UTC m=+402.235893734" watchObservedRunningTime="2026-09-17 17:37:55.585141245 +0000 UTC m=+402.236047238"
Sep 17 17:37:55.617155 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:55.617121    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="527b6752-2564-4f4e-bbfb-eb8d7a39c667" path="/var/lib/kubelet/pods/527b6752-2564-4f4e-bbfb-eb8d7a39c667/volumes"
Sep 17 17:37:56.555326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:56.555295    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-xx257 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 17:37:56.555782 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:56.555353    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257" podUID="fb2c40fe-3483-4da9-a529-9676c8394b23" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:37:59.555082 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:37:59.555045    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx257"
Sep 17 17:38:00.512369 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:38:00.512329    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wzc29"
Sep 17 17:39:00.076084 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.076053    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c66548b85-49xvz"]
Sep 17 17:39:00.076536 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.076415    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527b6752-2564-4f4e-bbfb-eb8d7a39c667" containerName="istio-proxy"
Sep 17 17:39:00.076536 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.076426    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="527b6752-2564-4f4e-bbfb-eb8d7a39c667" containerName="istio-proxy"
Sep 17 17:39:00.076536 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.076480    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="527b6752-2564-4f4e-bbfb-eb8d7a39c667" containerName="istio-proxy"
Sep 17 17:39:00.078534 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.078519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.095303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.095278    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c66548b85-49xvz"]
Sep 17 17:39:00.101335 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.101303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-service-ca\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.101471 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.101402    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd8cc64-571c-4c7e-b673-6d92640791c5-console-serving-cert\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.101471 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.101433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-trusted-ca-bundle\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.101471 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.101462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pwks\" (UniqueName: \"kubernetes.io/projected/cfd8cc64-571c-4c7e-b673-6d92640791c5-kube-api-access-5pwks\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.101621 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.101494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-console-config\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.101621 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.101551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfd8cc64-571c-4c7e-b673-6d92640791c5-console-oauth-config\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.101621 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.101608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-oauth-serving-cert\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.202083 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.202039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfd8cc64-571c-4c7e-b673-6d92640791c5-console-oauth-config\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.202083 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.202080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-oauth-serving-cert\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.202347 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.202119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-service-ca\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.202347 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.202151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd8cc64-571c-4c7e-b673-6d92640791c5-console-serving-cert\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.202347 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.202167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-trusted-ca-bundle\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.202347 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.202190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pwks\" (UniqueName: \"kubernetes.io/projected/cfd8cc64-571c-4c7e-b673-6d92640791c5-kube-api-access-5pwks\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.202347 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.202220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-console-config\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.203075 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.203046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-console-config\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.203194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.203169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-service-ca\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.203194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.203177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-oauth-serving-cert\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.203311 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.203223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd8cc64-571c-4c7e-b673-6d92640791c5-trusted-ca-bundle\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.204737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.204718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd8cc64-571c-4c7e-b673-6d92640791c5-console-serving-cert\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.204844 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.204753    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfd8cc64-571c-4c7e-b673-6d92640791c5-console-oauth-config\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.213210 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.213187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pwks\" (UniqueName: \"kubernetes.io/projected/cfd8cc64-571c-4c7e-b673-6d92640791c5-kube-api-access-5pwks\") pod \"console-7c66548b85-49xvz\" (UID: \"cfd8cc64-571c-4c7e-b673-6d92640791c5\") " pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.388845 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.388749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:00.666955 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.666925    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c66548b85-49xvz"]
Sep 17 17:39:00.669596 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:39:00.669562    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd8cc64_571c_4c7e_b673_6d92640791c5.slice/crio-33a8812cbf780fea4a6d9c140d2601e66cb0c4211fad3ce636d608c21b15abac WatchSource:0}: Error finding container 33a8812cbf780fea4a6d9c140d2601e66cb0c4211fad3ce636d608c21b15abac: Status 404 returned error can't find the container with id 33a8812cbf780fea4a6d9c140d2601e66cb0c4211fad3ce636d608c21b15abac
Sep 17 17:39:00.849426 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.849390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c66548b85-49xvz" event={"ID":"cfd8cc64-571c-4c7e-b673-6d92640791c5","Type":"ContainerStarted","Data":"792d6067b50151ee5f702378d6df74ba1835deb147bb1fb68625c2558bcbf673"}
Sep 17 17:39:00.849595 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.849443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c66548b85-49xvz" event={"ID":"cfd8cc64-571c-4c7e-b673-6d92640791c5","Type":"ContainerStarted","Data":"33a8812cbf780fea4a6d9c140d2601e66cb0c4211fad3ce636d608c21b15abac"}
Sep 17 17:39:00.868038 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:00.867958    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c66548b85-49xvz" podStartSLOduration=0.867940514 podStartE2EDuration="867.940514ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:39:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:39:00.867696215 +0000 UTC m=+467.518602209" watchObservedRunningTime="2026-09-17 17:39:00.867940514 +0000 UTC m=+467.518846506"
Sep 17 17:39:10.389084 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:10.389046    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:10.389505 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:10.389107    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:10.393815 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:10.393789    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:10.902617 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:10.902585    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c66548b85-49xvz"
Sep 17 17:39:10.966607 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:10.966577    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-674477c4d8-97nkb"]
Sep 17 17:39:35.989581 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:35.989524    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-674477c4d8-97nkb" podUID="aabded83-0bf5-444c-9be5-9e880e5431ea" containerName="console" containerID="cri-o://0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c" gracePeriod=15
Sep 17 17:39:36.234385 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.234361    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:39:36.328756 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.328726    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-console-config\") pod \"aabded83-0bf5-444c-9be5-9e880e5431ea\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") "
Sep 17 17:39:36.328917 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.328780    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-trusted-ca-bundle\") pod \"aabded83-0bf5-444c-9be5-9e880e5431ea\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") "
Sep 17 17:39:36.328985 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.328929    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-service-ca\") pod \"aabded83-0bf5-444c-9be5-9e880e5431ea\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") "
Sep 17 17:39:36.329046 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.328986    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k869\" (UniqueName: \"kubernetes.io/projected/aabded83-0bf5-444c-9be5-9e880e5431ea-kube-api-access-5k869\") pod \"aabded83-0bf5-444c-9be5-9e880e5431ea\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") "
Sep 17 17:39:36.329099 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.329046    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-oauth-config\") pod \"aabded83-0bf5-444c-9be5-9e880e5431ea\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") "
Sep 17 17:39:36.329099 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.329076    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-oauth-serving-cert\") pod \"aabded83-0bf5-444c-9be5-9e880e5431ea\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") "
Sep 17 17:39:36.329099 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.329076    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-console-config" (OuterVolumeSpecName: "console-config") pod "aabded83-0bf5-444c-9be5-9e880e5431ea" (UID: "aabded83-0bf5-444c-9be5-9e880e5431ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:36.329243 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.329140    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-serving-cert\") pod \"aabded83-0bf5-444c-9be5-9e880e5431ea\" (UID: \"aabded83-0bf5-444c-9be5-9e880e5431ea\") "
Sep 17 17:39:36.329243 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.329150    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aabded83-0bf5-444c-9be5-9e880e5431ea" (UID: "aabded83-0bf5-444c-9be5-9e880e5431ea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:36.329243 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.329230    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "aabded83-0bf5-444c-9be5-9e880e5431ea" (UID: "aabded83-0bf5-444c-9be5-9e880e5431ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:36.329489 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.329468    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aabded83-0bf5-444c-9be5-9e880e5431ea" (UID: "aabded83-0bf5-444c-9be5-9e880e5431ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:36.329618 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.329597    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-trusted-ca-bundle\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:39:36.329618 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.329619    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:39:36.329850 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.329633    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-oauth-serving-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:39:36.329850 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.329646    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aabded83-0bf5-444c-9be5-9e880e5431ea-console-config\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:39:36.331181 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.331156    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aabded83-0bf5-444c-9be5-9e880e5431ea" (UID: "aabded83-0bf5-444c-9be5-9e880e5431ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:39:36.331257 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.331229    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aabded83-0bf5-444c-9be5-9e880e5431ea-kube-api-access-5k869" (OuterVolumeSpecName: "kube-api-access-5k869") pod "aabded83-0bf5-444c-9be5-9e880e5431ea" (UID: "aabded83-0bf5-444c-9be5-9e880e5431ea"). InnerVolumeSpecName "kube-api-access-5k869". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:39:36.331297 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.331253    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aabded83-0bf5-444c-9be5-9e880e5431ea" (UID: "aabded83-0bf5-444c-9be5-9e880e5431ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:39:36.430386 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.430358    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k869\" (UniqueName: \"kubernetes.io/projected/aabded83-0bf5-444c-9be5-9e880e5431ea-kube-api-access-5k869\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:39:36.430386 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.430382    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-oauth-config\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:39:36.430386 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:36.430393    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aabded83-0bf5-444c-9be5-9e880e5431ea-console-serving-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:39:37.022627 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:37.022596    2563 generic.go:356] "Generic (PLEG): container finished" podID="aabded83-0bf5-444c-9be5-9e880e5431ea" containerID="0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c" exitCode=0
Sep 17 17:39:37.023126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:37.022656    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674477c4d8-97nkb"
Sep 17 17:39:37.023126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:37.022673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674477c4d8-97nkb" event={"ID":"aabded83-0bf5-444c-9be5-9e880e5431ea","Type":"ContainerDied","Data":"0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c"}
Sep 17 17:39:37.023126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:37.022746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674477c4d8-97nkb" event={"ID":"aabded83-0bf5-444c-9be5-9e880e5431ea","Type":"ContainerDied","Data":"a63757766caa4339083b4e78e1b62963efe0390fcf20e57ee7440ed9f3ee29b8"}
Sep 17 17:39:37.023126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:37.022769    2563 scope.go:117] "RemoveContainer" containerID="0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c"
Sep 17 17:39:37.032345 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:37.032327    2563 scope.go:117] "RemoveContainer" containerID="0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c"
Sep 17 17:39:37.032656 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:39:37.032636    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c\": container with ID starting with 0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c not found: ID does not exist" containerID="0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c"
Sep 17 17:39:37.032723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:37.032667    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c"} err="failed to get container status \"0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c\": rpc error: code = NotFound desc = could not find container \"0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c\": container with ID starting with 0c3eb15c81cd70042c367227ef9435f9631e3df09e53a01a3ecf94ca4a83791c not found: ID does not exist"
Sep 17 17:39:37.050629 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:37.050594    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-674477c4d8-97nkb"]
Sep 17 17:39:37.059476 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:37.059447    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-674477c4d8-97nkb"]
Sep 17 17:39:37.613250 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:37.613217    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aabded83-0bf5-444c-9be5-9e880e5431ea" path="/var/lib/kubelet/pods/aabded83-0bf5-444c-9be5-9e880e5431ea/volumes"
Sep 17 17:39:56.751621 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.751589    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"]
Sep 17 17:39:56.752131 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.752074    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aabded83-0bf5-444c-9be5-9e880e5431ea" containerName="console"
Sep 17 17:39:56.752131 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.752093    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aabded83-0bf5-444c-9be5-9e880e5431ea" containerName="console"
Sep 17 17:39:56.752247 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.752183    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aabded83-0bf5-444c-9be5-9e880e5431ea" containerName="console"
Sep 17 17:39:56.757011 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.756993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.759750 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.759731    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6bz7q\""
Sep 17 17:39:56.767502 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.767482    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"]
Sep 17 17:39:56.793374 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.793351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.793483 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.793384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.793483 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.793420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.793483 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.793448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.793674 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.793502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n95hv\" (UniqueName: \"kubernetes.io/projected/79abe069-9c02-44c6-9ba7-cc58175e7fb6-kube-api-access-n95hv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.793674 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.793581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.793674 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.793640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.793814 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.793728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.793814 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.793758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895012 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.894975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895012 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895258 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n95hv\" (UniqueName: \"kubernetes.io/projected/79abe069-9c02-44c6-9ba7-cc58175e7fb6-kube-api-access-n95hv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895258 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895258 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895258 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895258 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895258 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895258 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895614 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895556    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895614 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895744 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895679    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895815 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.895871 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.895819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.898108 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.898086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.898350 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.898331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.902515 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.902484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n95hv\" (UniqueName: \"kubernetes.io/projected/79abe069-9c02-44c6-9ba7-cc58175e7fb6-kube-api-access-n95hv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:56.902597 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:56.902499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79abe069-9c02-44c6-9ba7-cc58175e7fb6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fdnt5\" (UID: \"79abe069-9c02-44c6-9ba7-cc58175e7fb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:57.069201 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:57.069171    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:57.358414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:57.358384    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"]
Sep 17 17:39:57.359855 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:39:57.359832    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79abe069_9c02_44c6_9ba7_cc58175e7fb6.slice/crio-088be3304955d0d5fcdbbd4edbf47f3b2acc4d6d0263925b3b24372beb97c1d1 WatchSource:0}: Error finding container 088be3304955d0d5fcdbbd4edbf47f3b2acc4d6d0263925b3b24372beb97c1d1: Status 404 returned error can't find the container with id 088be3304955d0d5fcdbbd4edbf47f3b2acc4d6d0263925b3b24372beb97c1d1
Sep 17 17:39:57.362081 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:57.362042    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:39:57.362160 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:57.362117    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:39:57.362160 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:57.362145    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:39:58.128711 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:58.128677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5" event={"ID":"79abe069-9c02-44c6-9ba7-cc58175e7fb6","Type":"ContainerStarted","Data":"bc4666a00bd1b81f2618296360c48a86be1fdbe64ab0924feaf584bc5a54e18a"}
Sep 17 17:39:58.129091 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:58.128754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5" event={"ID":"79abe069-9c02-44c6-9ba7-cc58175e7fb6","Type":"ContainerStarted","Data":"088be3304955d0d5fcdbbd4edbf47f3b2acc4d6d0263925b3b24372beb97c1d1"}
Sep 17 17:39:58.154916 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:58.154868    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5" podStartSLOduration=2.154852936 podStartE2EDuration="2.154852936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:39:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:39:58.154452344 +0000 UTC m=+524.805358339" watchObservedRunningTime="2026-09-17 17:39:58.154852936 +0000 UTC m=+524.805758984"
Sep 17 17:39:59.069857 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:59.069818    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:59.074579 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:59.074554    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:59.133695 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:59.133670    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:39:59.134556 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:39:59.134537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:40:08.712317 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.712279    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:40:08.715953 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.715929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"
Sep 17 17:40:08.718321 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.718296    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 17:40:08.718438 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.718344    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 17 17:40:08.718438 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.718417    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gqjh7\""
Sep 17 17:40:08.719047 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.719031    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 17:40:08.724686 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.724667    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:40:08.756591 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.756566    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:40:08.802635 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.802613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5011632-8f68-47a3-a2a4-db05e5533b06-config-file\") pod \"limitador-limitador-84994f7ffc-xw9l6\" (UID: \"d5011632-8f68-47a3-a2a4-db05e5533b06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"
Sep 17 17:40:08.802765 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.802651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r82ps\" (UniqueName: \"kubernetes.io/projected/d5011632-8f68-47a3-a2a4-db05e5533b06-kube-api-access-r82ps\") pod \"limitador-limitador-84994f7ffc-xw9l6\" (UID: \"d5011632-8f68-47a3-a2a4-db05e5533b06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"
Sep 17 17:40:08.903070 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.903037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r82ps\" (UniqueName: \"kubernetes.io/projected/d5011632-8f68-47a3-a2a4-db05e5533b06-kube-api-access-r82ps\") pod \"limitador-limitador-84994f7ffc-xw9l6\" (UID: \"d5011632-8f68-47a3-a2a4-db05e5533b06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"
Sep 17 17:40:08.903195 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.903121    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5011632-8f68-47a3-a2a4-db05e5533b06-config-file\") pod \"limitador-limitador-84994f7ffc-xw9l6\" (UID: \"d5011632-8f68-47a3-a2a4-db05e5533b06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"
Sep 17 17:40:08.903801 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.903780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5011632-8f68-47a3-a2a4-db05e5533b06-config-file\") pod \"limitador-limitador-84994f7ffc-xw9l6\" (UID: \"d5011632-8f68-47a3-a2a4-db05e5533b06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"
Sep 17 17:40:08.911591 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:08.911566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r82ps\" (UniqueName: \"kubernetes.io/projected/d5011632-8f68-47a3-a2a4-db05e5533b06-kube-api-access-r82ps\") pod \"limitador-limitador-84994f7ffc-xw9l6\" (UID: \"d5011632-8f68-47a3-a2a4-db05e5533b06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"
Sep 17 17:40:09.027823 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:09.027785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"
Sep 17 17:40:09.303294 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:09.303224    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:40:09.305513 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:40:09.305480    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5011632_8f68_47a3_a2a4_db05e5533b06.slice/crio-31094dc51f4ecdfd57766ed89ab2c9f94940715742fb337b232b254279df1345 WatchSource:0}: Error finding container 31094dc51f4ecdfd57766ed89ab2c9f94940715742fb337b232b254279df1345: Status 404 returned error can't find the container with id 31094dc51f4ecdfd57766ed89ab2c9f94940715742fb337b232b254279df1345
Sep 17 17:40:10.189513 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:10.189472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6" event={"ID":"d5011632-8f68-47a3-a2a4-db05e5533b06","Type":"ContainerStarted","Data":"31094dc51f4ecdfd57766ed89ab2c9f94940715742fb337b232b254279df1345"}
Sep 17 17:40:12.201429 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:12.201393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6" event={"ID":"d5011632-8f68-47a3-a2a4-db05e5533b06","Type":"ContainerStarted","Data":"c6812fba539855131e000fbce93f3e2c99370c87cdfcd731102b427c25eb43de"}
Sep 17 17:40:12.201880 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:12.201562    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"
Sep 17 17:40:12.224696 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:12.224639    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6" podStartSLOduration=2.059921075 podStartE2EDuration="4.224621578s" totalImagesPullingTime="2.164700503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:40:12.223512255 +0000 UTC m=+538.874418246" watchObservedRunningTime="2026-09-17 17:40:12.224621578 +0000 UTC m=+538.875527568"
Sep 17 17:40:23.207389 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:40:23.207354    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"
Sep 17 17:41:15.550636 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:15.550608    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:41:15.551109 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:15.550911    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:41:15.554452 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:15.554433    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:41:15.554559 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:15.554490    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:41:26.021766 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:26.021734    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:41:35.627717 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:35.627678    2563 generic.go:356] "Generic (PLEG): container finished" podID="79abe069-9c02-44c6-9ba7-cc58175e7fb6" containerID="bc4666a00bd1b81f2618296360c48a86be1fdbe64ab0924feaf584bc5a54e18a" exitCode=0
Sep 17 17:41:35.628151 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:35.627753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5" event={"ID":"79abe069-9c02-44c6-9ba7-cc58175e7fb6","Type":"ContainerDied","Data":"bc4666a00bd1b81f2618296360c48a86be1fdbe64ab0924feaf584bc5a54e18a"}
Sep 17 17:41:35.628151 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:35.628099    2563 scope.go:117] "RemoveContainer" containerID="bc4666a00bd1b81f2618296360c48a86be1fdbe64ab0924feaf584bc5a54e18a"
Sep 17 17:41:35.629166 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:35.629135    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:41:35.629237 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:35.629219    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:41:35.629317 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:35.629303    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:41:36.634549 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:36.634517    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5" event={"ID":"79abe069-9c02-44c6-9ba7-cc58175e7fb6","Type":"ContainerStarted","Data":"dd68e14f8427fbc7eaba0893a84a208689f40076356a85c60da52ee2897f2d22"}
Sep 17 17:41:37.069411 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:37.069374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:41:37.069608 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:37.069584    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fdnt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 17 17:41:37.069657 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:37.069637    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5" podUID="79abe069-9c02-44c6-9ba7-cc58175e7fb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 17 17:41:38.070335 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:38.070297    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fdnt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 17 17:41:38.070743 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:38.070368    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5" podUID="79abe069-9c02-44c6-9ba7-cc58175e7fb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 17 17:41:39.069945 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:39.069916    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fdnt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 17 17:41:39.070098 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:39.069969    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5" podUID="79abe069-9c02-44c6-9ba7-cc58175e7fb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 17 17:41:40.070468 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:40.070429    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fdnt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 17 17:41:40.070968 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:40.070503    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5" podUID="79abe069-9c02-44c6-9ba7-cc58175e7fb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 17 17:41:41.069944 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:41.069906    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fdnt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 17 17:41:41.070118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:41.069967    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5" podUID="79abe069-9c02-44c6-9ba7-cc58175e7fb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 17 17:41:41.779185 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:41.779153    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:41:42.140868 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:42.140793    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:41:42.141092 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:42.141073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:41:42.141887 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:42.141866    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fdnt5"
Sep 17 17:41:49.228554 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:41:49.228523    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:42:09.343295 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:42:09.343257    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:42:19.343190 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:42:19.343152    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:42:40.436766 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:42:40.436728    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:42:53.727996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:42:53.727902    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:43:07.437383 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:43:07.437339    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:45:00.069237 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.069205    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"]
Sep 17 17:45:00.071895 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.071872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.076273 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.076249    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-54966d-openshift-default-dockercfg-7lxzh\""
Sep 17 17:45:00.198738 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.198679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a54b60-3261-4eb0-8a08-dda408fe7112-istiod-ca-cert\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.198995 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.198964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9gpg\" (UniqueName: \"kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-kube-api-access-q9gpg\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.199101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.199043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-socket\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.199101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.199082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-token\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.199205 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.199183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-data\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.199260 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.199237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-certs\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.199307 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.199286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-podinfo\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.199364 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.199342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-envoy\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.199423 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.199394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-credential-socket\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.200049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.200024    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"]
Sep 17 17:45:00.276575 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.276537    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs"]
Sep 17 17:45:00.279072 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.279050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs"
Sep 17 17:45:00.282556 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.282531    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:45:00.289501 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.289475    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs"
Sep 17 17:45:00.300959 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.300920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-data\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.301156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.301141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-certs\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.301270 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.301255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-podinfo\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.301381 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.301369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-envoy\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.301519 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.301505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-credential-socket\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.301750 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.301697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a54b60-3261-4eb0-8a08-dda408fe7112-istiod-ca-cert\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.301886 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.301872    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9gpg\" (UniqueName: \"kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-kube-api-access-q9gpg\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.302006 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.301993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-socket\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.302133 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.302119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-token\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.303079 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.303061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-data\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.303549 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.303533    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-certs\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.307735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.307204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a54b60-3261-4eb0-8a08-dda408fe7112-istiod-ca-cert\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.307735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.307507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-credential-socket\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.307912 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.307775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-socket\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.310378 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.310360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-podinfo\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.316101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.315862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-envoy\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.324777 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.323652    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs"]
Sep 17 17:45:00.339322 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.339265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-token\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.340220 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.340143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9gpg\" (UniqueName: \"kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-kube-api-access-q9gpg\") pod \"e2e-inf-a-54966d-openshift-default-8976c7674-z868k\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") " pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.348657 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.348625    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"]
Sep 17 17:45:00.352438 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.352417    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.361936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.361914    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-db7813-openshift-default-dockercfg-hw82j\""
Sep 17 17:45:00.383146 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.383118    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:00.404301 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.404270    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"]
Sep 17 17:45:00.505486 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.505453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-token\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.505673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.505517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-envoy\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.505673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.505551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-credential-socket\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.505673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.505618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5nz8\" (UniqueName: \"kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-kube-api-access-w5nz8\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.505673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.505647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ad60a08-e817-4118-8d0d-955d2bf63893-istiod-ca-cert\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.505860 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.505692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-data\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.505860 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.505750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-podinfo\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.505860 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.505798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-socket\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.506026 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.505926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-certs\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.533651 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.533623    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"]
Sep 17 17:45:00.536047 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.536032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.543018 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.542981    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-8aeea1-openshift-default-dockercfg-tjzf5\""
Sep 17 17:45:00.585604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.585519    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"]
Sep 17 17:45:00.607189 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-data\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.607340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-podinfo\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.607340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5nz8\" (UniqueName: \"kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-kube-api-access-w5nz8\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.607340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ad60a08-e817-4118-8d0d-955d2bf63893-istiod-ca-cert\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.607340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a3e3975-eddf-4feb-8285-38aa901ccb71-istiod-ca-cert\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.607493 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-data\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.607493 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvwkr\" (UniqueName: \"kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-kube-api-access-zvwkr\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.607493 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-podinfo\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.607611 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-socket\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.607611 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-socket\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.607725 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-certs\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.607725 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607679    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-certs\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.607844 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-token\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.607844 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-token\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.607844 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607783    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-data\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.607844 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607801    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-credential-socket\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.608037 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-envoy\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.608037 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-credential-socket\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.608037 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-socket\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.608037 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.607927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-envoy\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.608246 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.608061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ad60a08-e817-4118-8d0d-955d2bf63893-istiod-ca-cert\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.608246 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.608182    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-credential-socket\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.608344 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.608283    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-certs\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.610412 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.610391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-envoy\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.611542 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.611497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-podinfo\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.615153 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.615135    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs"]
Sep 17 17:45:00.617613 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:45:00.617592    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c17a5f8_c2b0_4d38_b0b8_9a88d2e8ec53.slice/crio-aa893bfaeb76acc97a980577f750d0177316ed83d558a5c04fc817041806fbfc WatchSource:0}: Error finding container aa893bfaeb76acc97a980577f750d0177316ed83d558a5c04fc817041806fbfc: Status 404 returned error can't find the container with id aa893bfaeb76acc97a980577f750d0177316ed83d558a5c04fc817041806fbfc
Sep 17 17:45:00.620087 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.620068    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:45:00.652736 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.652685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-token\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.652866 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.652852    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5nz8\" (UniqueName: \"kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-kube-api-access-w5nz8\") pod \"e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") " pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.664761 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.664695    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:00.698784 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.698749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"]
Sep 17 17:45:00.705613 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:45:00.705579    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a54b60_3261_4eb0_8a08_dda408fe7112.slice/crio-4f223cd9a89fa1d6ae99d5826684c09689310a45701b9153836fd2c462fc39c7 WatchSource:0}: Error finding container 4f223cd9a89fa1d6ae99d5826684c09689310a45701b9153836fd2c462fc39c7: Status 404 returned error can't find the container with id 4f223cd9a89fa1d6ae99d5826684c09689310a45701b9153836fd2c462fc39c7
Sep 17 17:45:00.708498 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a3e3975-eddf-4feb-8285-38aa901ccb71-istiod-ca-cert\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.708590 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvwkr\" (UniqueName: \"kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-kube-api-access-zvwkr\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.708590 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708578    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-socket\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.708722 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-certs\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.708722 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-token\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.708834 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-credential-socket\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.708834 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708721    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:00.708834 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-envoy\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.708834 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-data\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.708834 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708808    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:00.709084 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-podinfo\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.709084 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.708852    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:00.709084 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.709004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-socket\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.709333 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.709278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a3e3975-eddf-4feb-8285-38aa901ccb71-istiod-ca-cert\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.709546 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.709523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-credential-socket\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.709687 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.709664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-data\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.709813 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.709784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-certs\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.711646 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.711622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-envoy\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.711828 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.711809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-podinfo\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.729298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.726632    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-token\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.729298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.728307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvwkr\" (UniqueName: \"kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-kube-api-access-zvwkr\") pod \"e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") " pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.846293 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.846200    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:00.971373 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.971349    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"]
Sep 17 17:45:00.974265 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:45:00.974222    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad60a08_e817_4118_8d0d_955d2bf63893.slice/crio-df1889dc504f46768470917b696b763c8dfac67bfc34dca5708f1a8bfa0f38c5 WatchSource:0}: Error finding container df1889dc504f46768470917b696b763c8dfac67bfc34dca5708f1a8bfa0f38c5: Status 404 returned error can't find the container with id df1889dc504f46768470917b696b763c8dfac67bfc34dca5708f1a8bfa0f38c5
Sep 17 17:45:00.976622 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.976585    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:00.976761 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.976656    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:00.976761 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:00.976740    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:01.202993 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:45:01.202963    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3e3975_eddf_4feb_8285_38aa901ccb71.slice/crio-f785c4d5bbd43ad1a530b8c6cf6b9ec6b6e6df6ee33be6de1f3d710805fb2ee5 WatchSource:0}: Error finding container f785c4d5bbd43ad1a530b8c6cf6b9ec6b6e6df6ee33be6de1f3d710805fb2ee5: Status 404 returned error can't find the container with id f785c4d5bbd43ad1a530b8c6cf6b9ec6b6e6df6ee33be6de1f3d710805fb2ee5
Sep 17 17:45:01.203643 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.203107    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"]
Sep 17 17:45:01.205678 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.205647    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:01.205779 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.205746    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:01.205836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.205783    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:01.602675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.602637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" event={"ID":"1a3e3975-eddf-4feb-8285-38aa901ccb71","Type":"ContainerStarted","Data":"8f3798f9f90199f95943959b76faec18155a9216dd5f74e204e655a46eb8819a"}
Sep 17 17:45:01.603030 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.602998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" event={"ID":"1a3e3975-eddf-4feb-8285-38aa901ccb71","Type":"ContainerStarted","Data":"f785c4d5bbd43ad1a530b8c6cf6b9ec6b6e6df6ee33be6de1f3d710805fb2ee5"}
Sep 17 17:45:01.605578 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.605531    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" event={"ID":"56a54b60-3261-4eb0-8a08-dda408fe7112","Type":"ContainerStarted","Data":"b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077"}
Sep 17 17:45:01.605771 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.605600    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" event={"ID":"56a54b60-3261-4eb0-8a08-dda408fe7112","Type":"ContainerStarted","Data":"4f223cd9a89fa1d6ae99d5826684c09689310a45701b9153836fd2c462fc39c7"}
Sep 17 17:45:01.615210 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.615180    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs" event={"ID":"4c17a5f8-c2b0-4d38-b0b8-9a88d2e8ec53","Type":"ContainerStarted","Data":"aa893bfaeb76acc97a980577f750d0177316ed83d558a5c04fc817041806fbfc"}
Sep 17 17:45:01.615369 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.615223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" event={"ID":"5ad60a08-e817-4118-8d0d-955d2bf63893","Type":"ContainerStarted","Data":"f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e"}
Sep 17 17:45:01.615369 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.615247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" event={"ID":"5ad60a08-e817-4118-8d0d-955d2bf63893","Type":"ContainerStarted","Data":"df1889dc504f46768470917b696b763c8dfac67bfc34dca5708f1a8bfa0f38c5"}
Sep 17 17:45:01.653315 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.653260    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" podStartSLOduration=1.653241087 podStartE2EDuration="1.653241087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:01.651895576 +0000 UTC m=+828.302801568" watchObservedRunningTime="2026-09-17 17:45:01.653241087 +0000 UTC m=+828.304147078"
Sep 17 17:45:01.664944 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.664914    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:01.713131 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.713068    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" podStartSLOduration=1.7130501329999999 podStartE2EDuration="1.713050133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:01.71126177 +0000 UTC m=+828.362167763" watchObservedRunningTime="2026-09-17 17:45:01.713050133 +0000 UTC m=+828.363956125"
Sep 17 17:45:01.745036 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.744985    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" podStartSLOduration=1.744967088 podStartE2EDuration="1.744967088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:01.744599845 +0000 UTC m=+828.395505850" watchObservedRunningTime="2026-09-17 17:45:01.744967088 +0000 UTC m=+828.395873079"
Sep 17 17:45:01.847134 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:01.847096    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:02.383543 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:02.383504    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:02.389761 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:02.389727    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:02.620061 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:02.620028    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:02.621213 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:02.621187    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:02.671647 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:02.671562    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:02.852981 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:02.852948    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:03.625977 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:03.625868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs" event={"ID":"4c17a5f8-c2b0-4d38-b0b8-9a88d2e8ec53","Type":"ContainerStarted","Data":"6e2532ebc88979fe15cea16cb2a29eb600300ac86d741c893951852cd3ffe00b"}
Sep 17 17:45:03.626589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:03.626568    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:03.626683 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:03.626619    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:03.627173 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:03.627155    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:03.627276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:03.627206    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:03.648284 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:03.648237    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs" podStartSLOduration=0.964344962 podStartE2EDuration="3.648224424s" totalImagesPullingTime="2.683879462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:03.647516735 +0000 UTC m=+830.298422738" watchObservedRunningTime="2026-09-17 17:45:03.648224424 +0000 UTC m=+830.299130415"
Sep 17 17:45:04.608962 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:04.608926    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:45:04.632672 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:04.632634    2563 generic.go:356] "Generic (PLEG): container finished" podID="4c17a5f8-c2b0-4d38-b0b8-9a88d2e8ec53" containerID="6e2532ebc88979fe15cea16cb2a29eb600300ac86d741c893951852cd3ffe00b" exitCode=0
Sep 17 17:45:04.633063 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:04.632738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs" event={"ID":"4c17a5f8-c2b0-4d38-b0b8-9a88d2e8ec53","Type":"ContainerDied","Data":"6e2532ebc88979fe15cea16cb2a29eb600300ac86d741c893951852cd3ffe00b"}
Sep 17 17:45:05.783841 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:05.783812    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs"
Sep 17 17:45:06.649218 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:06.649189    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs"
Sep 17 17:45:06.649399 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:06.649219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827785-997xs" event={"ID":"4c17a5f8-c2b0-4d38-b0b8-9a88d2e8ec53","Type":"ContainerDied","Data":"aa893bfaeb76acc97a980577f750d0177316ed83d558a5c04fc817041806fbfc"}
Sep 17 17:45:06.649399 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:06.649265    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa893bfaeb76acc97a980577f750d0177316ed83d558a5c04fc817041806fbfc"
Sep 17 17:45:07.345578 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.345541    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"]
Sep 17 17:45:07.346282 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.346261    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c17a5f8-c2b0-4d38-b0b8-9a88d2e8ec53" containerName="cleanup"
Sep 17 17:45:07.346353 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.346287    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c17a5f8-c2b0-4d38-b0b8-9a88d2e8ec53" containerName="cleanup"
Sep 17 17:45:07.346413 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.346401    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c17a5f8-c2b0-4d38-b0b8-9a88d2e8ec53" containerName="cleanup"
Sep 17 17:45:07.348965 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.348941    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.354254 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.354233    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-db7813-serving-cert\""
Sep 17 17:45:07.354391 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.354284    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 17:45:07.354391 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.354326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mzh7j\""
Sep 17 17:45:07.354391 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.354338    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:45:07.355168 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.355152    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 17:45:07.377162 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.377126    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"]
Sep 17 17:45:07.481372 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.481344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-metrics-certs\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.481549 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.481397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcwsz\" (UniqueName: \"kubernetes.io/projected/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-kube-api-access-zcwsz\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.481549 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.481426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.481549 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.481469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-maas-api-tls\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.582842 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.582809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.583020 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.582862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-maas-api-tls\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.583020 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.582921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-metrics-certs\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.583020 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.582957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcwsz\" (UniqueName: \"kubernetes.io/projected/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-kube-api-access-zcwsz\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.583552 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.583533    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.585285 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.585262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-maas-api-tls\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.585437 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.585419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-metrics-certs\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.597041 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.596980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcwsz\" (UniqueName: \"kubernetes.io/projected/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-kube-api-access-zcwsz\") pod \"maas-api-e2e-worker-w0-db7813-7c4b445c-csg77\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.659159 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.659127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:07.964936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:07.964910    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"]
Sep 17 17:45:07.966164 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:45:07.966139    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd639a0_cd56_4fed_a0b0_4ed9279f06fb.slice/crio-674393f37aaa1007aadfd6f9dffb75445ff7681e948eb7e69f014d83fce2464c WatchSource:0}: Error finding container 674393f37aaa1007aadfd6f9dffb75445ff7681e948eb7e69f014d83fce2464c: Status 404 returned error can't find the container with id 674393f37aaa1007aadfd6f9dffb75445ff7681e948eb7e69f014d83fce2464c
Sep 17 17:45:08.662272 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:08.662228    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77" event={"ID":"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb","Type":"ContainerStarted","Data":"674393f37aaa1007aadfd6f9dffb75445ff7681e948eb7e69f014d83fce2464c"}
Sep 17 17:45:10.673720 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:10.673624    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77" event={"ID":"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb","Type":"ContainerStarted","Data":"03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505"}
Sep 17 17:45:10.674056 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:10.673754    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:10.699880 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:10.699831    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77" podStartSLOduration=1.3884619950000001 podStartE2EDuration="3.699813942s" totalImagesPullingTime="2.311351947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:10.69875517 +0000 UTC m=+837.349661162" watchObservedRunningTime="2026-09-17 17:45:10.699813942 +0000 UTC m=+837.350719925"
Sep 17 17:45:11.788895 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.788858    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"]
Sep 17 17:45:11.792129 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.792108    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.795987 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.795964    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f7d735f2-openshift-default-dockercfg-27v6k\""
Sep 17 17:45:11.815349 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.815323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"]
Sep 17 17:45:11.830022 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.829995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-socket\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.830151 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.830033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4624f204-240e-467c-976e-2b138d3127fe-istio-podinfo\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.830151 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.830061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84rh9\" (UniqueName: \"kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-kube-api-access-84rh9\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.830257 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.830180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-envoy\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.830257 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.830240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-data\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.830360 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.830274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-istio-token\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.830360 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.830305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4624f204-240e-467c-976e-2b138d3127fe-istiod-ca-cert\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.830448 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.830361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-certs\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.830495 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.830464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-credential-socket\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.933604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.932238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-socket\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.933604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.932280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4624f204-240e-467c-976e-2b138d3127fe-istio-podinfo\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.933604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.932304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84rh9\" (UniqueName: \"kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-kube-api-access-84rh9\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.933604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.932344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-envoy\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.933604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.932384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-data\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.933604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.932414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-istio-token\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.933604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.932440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4624f204-240e-467c-976e-2b138d3127fe-istiod-ca-cert\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.933604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.932468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-certs\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.933604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.932533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-credential-socket\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.933604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.933007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-credential-socket\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.933604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.933227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-socket\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.936150 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.935389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4624f204-240e-467c-976e-2b138d3127fe-istiod-ca-cert\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.936150 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.935639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-certs\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.936797 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.936753    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4624f204-240e-467c-976e-2b138d3127fe-istio-podinfo\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.937039 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.937023    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-data\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.941833 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.941791    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-envoy\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.953566 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.953514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-istio-token\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:11.954241 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:11.954200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84rh9\" (UniqueName: \"kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-kube-api-access-84rh9\") pod \"e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") " pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:12.104341 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:12.104259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:12.391104 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:12.391079    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"]
Sep 17 17:45:12.392251 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:45:12.392221    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4624f204_240e_467c_976e_2b138d3127fe.slice/crio-28bfdbb1a14a1d1327f42f6487769bfe589ded142a2b9900b4a82d96bae7fa68 WatchSource:0}: Error finding container 28bfdbb1a14a1d1327f42f6487769bfe589ded142a2b9900b4a82d96bae7fa68: Status 404 returned error can't find the container with id 28bfdbb1a14a1d1327f42f6487769bfe589ded142a2b9900b4a82d96bae7fa68
Sep 17 17:45:12.394671 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:12.394641    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:12.394758 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:12.394729    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:12.394796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:12.394758    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:12.685572 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:12.685494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" event={"ID":"4624f204-240e-467c-976e-2b138d3127fe","Type":"ContainerStarted","Data":"1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d"}
Sep 17 17:45:12.685572 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:12.685546    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" event={"ID":"4624f204-240e-467c-976e-2b138d3127fe","Type":"ContainerStarted","Data":"28bfdbb1a14a1d1327f42f6487769bfe589ded142a2b9900b4a82d96bae7fa68"}
Sep 17 17:45:12.719234 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:12.719163    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" podStartSLOduration=1.719134839 podStartE2EDuration="1.719134839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:12.713624424 +0000 UTC m=+839.364530417" watchObservedRunningTime="2026-09-17 17:45:12.719134839 +0000 UTC m=+839.370040831"
Sep 17 17:45:13.105334 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:13.105291    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:13.113125 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:13.113048    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:13.693434 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:13.693398    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:13.694580 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:13.694543    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:16.683757 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:16.683696    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:45:18.365727 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.356172    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"]
Sep 17 17:45:18.373735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.371029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.377726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.376463    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-af14f8-openshift-default-dockercfg-2whp2\""
Sep 17 17:45:18.392579 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.392541    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"]
Sep 17 17:45:18.428876 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.428834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-socket\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.429232 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.429208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-token\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.429458 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.429439    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-credential-socket\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.429670 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.429653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-envoy\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.429917 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.429881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-podinfo\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.430111 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.430074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6lcf\" (UniqueName: \"kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-kube-api-access-s6lcf\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.430301 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.430265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-data\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.430508 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.430457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-certs\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.430738 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.430695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87f9b90a-3226-4d7d-9887-73ef83c732b7-istiod-ca-cert\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.535311 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.535268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-socket\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.535607 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.535584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-token\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.535768 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.535742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-credential-socket\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.535956 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.535942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-envoy\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.536057 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.536043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-podinfo\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.536156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.536139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6lcf\" (UniqueName: \"kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-kube-api-access-s6lcf\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.536308 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.536290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-data\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.536438 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.536423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-certs\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.536617 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.536600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87f9b90a-3226-4d7d-9887-73ef83c732b7-istiod-ca-cert\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.537970 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.537946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87f9b90a-3226-4d7d-9887-73ef83c732b7-istiod-ca-cert\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.539044 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.539023    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-socket\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.540117 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.539498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-certs\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.540256 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.539774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-data\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.540350 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.540060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-credential-socket\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.544264 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.544242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-podinfo\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.552695 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.552672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-envoy\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.560432 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.560380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-token\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.563047 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.563001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6lcf\" (UniqueName: \"kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-kube-api-access-s6lcf\") pod \"e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") " pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:18.703774 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:18.702976    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:19.332355 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:45:19.332326    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f9b90a_3226_4d7d_9887_73ef83c732b7.slice/crio-0281e2fca32141191914e70e363b9f0ae9ccbe99e6a7ccc711e05e1eda82c08b WatchSource:0}: Error finding container 0281e2fca32141191914e70e363b9f0ae9ccbe99e6a7ccc711e05e1eda82c08b: Status 404 returned error can't find the container with id 0281e2fca32141191914e70e363b9f0ae9ccbe99e6a7ccc711e05e1eda82c08b
Sep 17 17:45:19.335477 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.335441    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"]
Sep 17 17:45:19.339110 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.339075    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:19.339285 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.339264    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:19.339409 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.339390    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:19.439726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.437499    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"]
Sep 17 17:45:19.441882 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.441824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.447818 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.446753    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-dfb277-openshift-default-dockercfg-stzb4\""
Sep 17 17:45:19.469083 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.468989    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"]
Sep 17 17:45:19.569253 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.559353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-istio-token\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.569253 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.561298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-credential-socket\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.569253 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.561340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-envoy\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.569253 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.561404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xplfx\" (UniqueName: \"kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-kube-api-access-xplfx\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.569253 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.561465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-socket\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.569253 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.561503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-data\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.569253 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.561557    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/003e4d27-fb69-4dab-9b23-8728552cbded-istiod-ca-cert\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.569253 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.561586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/003e4d27-fb69-4dab-9b23-8728552cbded-istio-podinfo\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.569253 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.561610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-certs\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.663796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.662901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xplfx\" (UniqueName: \"kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-kube-api-access-xplfx\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.663796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.662978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-socket\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.663796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.663016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-data\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.663796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.663072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/003e4d27-fb69-4dab-9b23-8728552cbded-istiod-ca-cert\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.663796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.663103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/003e4d27-fb69-4dab-9b23-8728552cbded-istio-podinfo\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.663796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.663131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-certs\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.663796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.663209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-istio-token\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.663796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.663276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-credential-socket\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.663796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.663298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-envoy\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.664449 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.664348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-socket\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.664514 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.664440    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/003e4d27-fb69-4dab-9b23-8728552cbded-istiod-ca-cert\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.664811 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.664768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-data\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.665490 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.665423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-credential-socket\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.665715 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.665658    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-certs\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.667604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.667555    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-envoy\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.668924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.668907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/003e4d27-fb69-4dab-9b23-8728552cbded-istio-podinfo\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.699905 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.699872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xplfx\" (UniqueName: \"kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-kube-api-access-xplfx\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.700396 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.700372    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-istio-token\") pod \"e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") " pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.765155 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.764174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" event={"ID":"87f9b90a-3226-4d7d-9887-73ef83c732b7","Type":"ContainerStarted","Data":"a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10"}
Sep 17 17:45:19.765155 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.764239    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" event={"ID":"87f9b90a-3226-4d7d-9887-73ef83c732b7","Type":"ContainerStarted","Data":"0281e2fca32141191914e70e363b9f0ae9ccbe99e6a7ccc711e05e1eda82c08b"}
Sep 17 17:45:19.766449 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.766426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:19.798185 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:19.798124    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" podStartSLOduration=1.798100002 podStartE2EDuration="1.798100002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:19.795219863 +0000 UTC m=+846.446125856" watchObservedRunningTime="2026-09-17 17:45:19.798100002 +0000 UTC m=+846.449005995"
Sep 17 17:45:20.094628 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:20.094592    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"]
Sep 17 17:45:20.096590 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:45:20.096537    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003e4d27_fb69_4dab_9b23_8728552cbded.slice/crio-c5283c99eb8d9ba5f464a78c1e7c1aa3ac14feb8ca68e744f9a974c65d80d375 WatchSource:0}: Error finding container c5283c99eb8d9ba5f464a78c1e7c1aa3ac14feb8ca68e744f9a974c65d80d375: Status 404 returned error can't find the container with id c5283c99eb8d9ba5f464a78c1e7c1aa3ac14feb8ca68e744f9a974c65d80d375
Sep 17 17:45:20.099620 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:20.099585    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:20.099720 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:20.099653    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:20.099720 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:20.099681    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:20.705320 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:20.704552    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:20.713030 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:20.712638    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:20.773223 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:20.772895    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" event={"ID":"003e4d27-fb69-4dab-9b23-8728552cbded","Type":"ContainerStarted","Data":"4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530"}
Sep 17 17:45:20.773223 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:20.772960    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" event={"ID":"003e4d27-fb69-4dab-9b23-8728552cbded","Type":"ContainerStarted","Data":"c5283c99eb8d9ba5f464a78c1e7c1aa3ac14feb8ca68e744f9a974c65d80d375"}
Sep 17 17:45:20.774160 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:20.773966    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:20.775080 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:20.775034    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:20.822506 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:20.822444    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" podStartSLOduration=1.822421667 podStartE2EDuration="1.822421667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:20.819737175 +0000 UTC m=+847.470643169" watchObservedRunningTime="2026-09-17 17:45:20.822421667 +0000 UTC m=+847.473327660"
Sep 17 17:45:21.770396 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:21.767200    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:21.780265 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:21.779351    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:45:21.784421 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:21.781246    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:21.789909 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:21.789872    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:21.790948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:21.790900    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:24.809375 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.809341    2563 generic.go:356] "Generic (PLEG): container finished" podID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerID="f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e" exitCode=0
Sep 17 17:45:24.809904 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.809407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" event={"ID":"5ad60a08-e817-4118-8d0d-955d2bf63893","Type":"ContainerDied","Data":"f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e"}
Sep 17 17:45:24.809969 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.809920    2563 scope.go:117] "RemoveContainer" containerID="f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e"
Sep 17 17:45:24.811261 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.811226    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:24.811363 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.811306    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:24.811363 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.811347    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:24.811443 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.811418    2563 generic.go:356] "Generic (PLEG): container finished" podID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerID="b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077" exitCode=0
Sep 17 17:45:24.811518 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.811499    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" event={"ID":"56a54b60-3261-4eb0-8a08-dda408fe7112","Type":"ContainerDied","Data":"b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077"}
Sep 17 17:45:24.811854 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.811838    2563 scope.go:117] "RemoveContainer" containerID="b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077"
Sep 17 17:45:24.812988 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.812961    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:24.813071 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.813020    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:24.813071 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:24.813051    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:25.825729 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:25.825411    2563 generic.go:356] "Generic (PLEG): container finished" podID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerID="8f3798f9f90199f95943959b76faec18155a9216dd5f74e204e655a46eb8819a" exitCode=0
Sep 17 17:45:25.825729 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:25.825528    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" event={"ID":"1a3e3975-eddf-4feb-8285-38aa901ccb71","Type":"ContainerDied","Data":"8f3798f9f90199f95943959b76faec18155a9216dd5f74e204e655a46eb8819a"}
Sep 17 17:45:25.826285 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:25.826120    2563 scope.go:117] "RemoveContainer" containerID="8f3798f9f90199f95943959b76faec18155a9216dd5f74e204e655a46eb8819a"
Sep 17 17:45:25.830175 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:25.827930    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:25.830175 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:25.828025    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:25.830175 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:25.828074    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:25.833723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:25.831668    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" event={"ID":"56a54b60-3261-4eb0-8a08-dda408fe7112","Type":"ContainerStarted","Data":"2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad"}
Sep 17 17:45:25.843033 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:25.843002    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" event={"ID":"5ad60a08-e817-4118-8d0d-955d2bf63893","Type":"ContainerStarted","Data":"99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665"}
Sep 17 17:45:26.384121 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:26.384085    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:26.384557 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:26.384423    2563 patch_prober.go:28] interesting pod/e2e-inf-a-54966d-openshift-default-8976c7674-z868k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 17 17:45:26.384822 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:26.384793    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 17 17:45:26.665494 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:26.665408    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:26.665724 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:26.665682    2563 patch_prober.go:28] interesting pod/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 17 17:45:26.665783 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:26.665745    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 17 17:45:26.850595 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:26.850557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" event={"ID":"1a3e3975-eddf-4feb-8285-38aa901ccb71","Type":"ContainerStarted","Data":"4b0675a746b25e8518fa3ded5ba430e2129d096330006d0abb5f521723c618b7"}
Sep 17 17:45:27.384122 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:27.384075    2563 patch_prober.go:28] interesting pod/e2e-inf-a-54966d-openshift-default-8976c7674-z868k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 17 17:45:27.384331 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:27.384150    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 17 17:45:27.665487 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:27.665384    2563 patch_prober.go:28] interesting pod/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 17 17:45:27.665487 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:27.665453    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 17 17:45:27.847159 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:27.847120    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:27.847514 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:27.847491    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 17 17:45:27.847688 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:27.847663    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 17 17:45:28.266951 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.266913    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"]
Sep 17 17:45:28.273082 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.273056    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.275340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.275317    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-af14f8-serving-cert\""
Sep 17 17:45:28.293727 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.293675    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"]
Sep 17 17:45:28.375737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.374313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zflp2\" (UniqueName: \"kubernetes.io/projected/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-kube-api-access-zflp2\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.375737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.374407    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-metrics-certs\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.375737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.374526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-openshift-service-ca\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.375737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.374557    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.384731 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.384050    2563 patch_prober.go:28] interesting pod/e2e-inf-a-54966d-openshift-default-8976c7674-z868k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 17 17:45:28.384731 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.384110    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 17 17:45:28.475723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.475336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-openshift-service-ca\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.475723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.475392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.475723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.475474    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zflp2\" (UniqueName: \"kubernetes.io/projected/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-kube-api-access-zflp2\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.475723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.475534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-metrics-certs\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.487229 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.486545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-openshift-service-ca\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.487229 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:45:28.486672    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-serving-cert: secret "maas-api-e2e-autores-af14f8-serving-cert" not found
Sep 17 17:45:28.487229 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:45:28.486752    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls podName:acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce nodeName:}" failed. No retries permitted until 2026-09-17 17:45:28.986731149 +0000 UTC m=+855.637637125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls") pod "maas-api-e2e-autores-af14f8-85974fbc55-d82xv" (UID: "acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce") : secret "maas-api-e2e-autores-af14f8-serving-cert" not found
Sep 17 17:45:28.524552 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.523367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zflp2\" (UniqueName: \"kubernetes.io/projected/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-kube-api-access-zflp2\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.540723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.527237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-metrics-certs\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:28.665413 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.665362    2563 patch_prober.go:28] interesting pod/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 17 17:45:28.665613 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.665438    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 17 17:45:28.847850 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.847313    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 17 17:45:28.847850 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:28.847378    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 17 17:45:29.090724 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:29.090665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:29.091727 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:45:29.090905    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-serving-cert: secret "maas-api-e2e-autores-af14f8-serving-cert" not found
Sep 17 17:45:29.091727 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:45:29.091015    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls podName:acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce nodeName:}" failed. No retries permitted until 2026-09-17 17:45:30.090991281 +0000 UTC m=+856.741897272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls") pod "maas-api-e2e-autores-af14f8-85974fbc55-d82xv" (UID: "acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce") : secret "maas-api-e2e-autores-af14f8-serving-cert" not found
Sep 17 17:45:29.391217 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:29.391178    2563 patch_prober.go:28] interesting pod/e2e-inf-a-54966d-openshift-default-8976c7674-z868k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 17 17:45:29.391833 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:29.391796    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 17 17:45:29.665775 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:29.665662    2563 patch_prober.go:28] interesting pod/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 17 17:45:29.666056 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:29.666023    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 17 17:45:29.847725 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:29.847086    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 17 17:45:29.847725 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:29.847152    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 17 17:45:30.107981 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:30.107943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:30.111326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:30.111298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls\") pod \"maas-api-e2e-autores-af14f8-85974fbc55-d82xv\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:30.384684 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:30.384590    2563 patch_prober.go:28] interesting pod/e2e-inf-a-54966d-openshift-default-8976c7674-z868k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 17 17:45:30.385011 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:30.384977    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 17 17:45:30.385547 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:30.385249    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:30.665683 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:30.665134    2563 patch_prober.go:28] interesting pod/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 17 17:45:30.665683 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:30.665204    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 17 17:45:30.815694 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:30.815643    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"]
Sep 17 17:45:30.847723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:30.847067    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 17 17:45:30.847723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:30.847133    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 17 17:45:30.929783 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:30.929193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv" event={"ID":"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce","Type":"ContainerStarted","Data":"a7af4a891ffc56fca9a2e5eff4df73b215342aaac306dd8ae454a4545a50a3a6"}
Sep 17 17:45:31.408896 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:31.408298    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:31.410364 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:31.410166    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:31.412433 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:31.412369    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:45:31.719301 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:31.718419    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:31.719301 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:31.719152    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:31.726720 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:31.721967    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:45:31.847542 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:31.847509    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 17 17:45:31.847750 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:31.847563    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 17 17:45:31.938422 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:31.938381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv" event={"ID":"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce","Type":"ContainerStarted","Data":"a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf"}
Sep 17 17:45:31.938767 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:31.938744    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:31.958150 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:31.958103    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv" podStartSLOduration=3.558876252 podStartE2EDuration="3.958089057s" totalImagesPullingTime="399.212805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:31.955569218 +0000 UTC m=+858.606475211" watchObservedRunningTime="2026-09-17 17:45:31.958089057 +0000 UTC m=+858.608995048"
Sep 17 17:45:32.847088 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:32.847046    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 17 17:45:32.847569 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:32.847109    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 17 17:45:33.626130 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:33.626099    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:33.851633 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:33.851600    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:33.951547 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:33.951473    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:45:37.949474 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:37.949437    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:45:42.233861 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:42.233828    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:45:43.695365 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:43.695315    2563 patch_prober.go:28] interesting pod/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 17:45:43.695942 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:43.695406    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" podUID="4624f204-240e-467c-976e-2b138d3127fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 17:45:44.023757 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.023727    2563 generic.go:356] "Generic (PLEG): container finished" podID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerID="a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10" exitCode=0
Sep 17 17:45:44.023931 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.023790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" event={"ID":"87f9b90a-3226-4d7d-9887-73ef83c732b7","Type":"ContainerDied","Data":"a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10"}
Sep 17 17:45:44.024293 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.024274    2563 scope.go:117] "RemoveContainer" containerID="a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10"
Sep 17 17:45:44.025572 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.025552    2563 generic.go:356] "Generic (PLEG): container finished" podID="4624f204-240e-467c-976e-2b138d3127fe" containerID="1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d" exitCode=0
Sep 17 17:45:44.025572 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.025556    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:44.025681 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.025629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" event={"ID":"4624f204-240e-467c-976e-2b138d3127fe","Type":"ContainerDied","Data":"1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d"}
Sep 17 17:45:44.025755 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.025632    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:44.025795 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.025754    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:44.025987 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.025974    2563 scope.go:117] "RemoveContainer" containerID="1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d"
Sep 17 17:45:44.027129 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.027099    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:44.027194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.027173    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:44.027253 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:44.027206    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:45.037783 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:45.037741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" event={"ID":"4624f204-240e-467c-976e-2b138d3127fe","Type":"ContainerStarted","Data":"f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd"}
Sep 17 17:45:45.041637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:45.041596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" event={"ID":"87f9b90a-3226-4d7d-9887-73ef83c732b7","Type":"ContainerStarted","Data":"5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502"}
Sep 17 17:45:45.105561 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:45.105530    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:45.105934 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:45.105908    2563 patch_prober.go:28] interesting pod/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 17:45:45.106091 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:45.106067    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" podUID="4624f204-240e-467c-976e-2b138d3127fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 17:45:45.674464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:45.674426    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"]
Sep 17 17:45:45.708908 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:45.708877    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:45.710276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:45.709170    2563 patch_prober.go:28] interesting pod/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 17:45:45.710562 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:45.710537    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 17:45:46.051405 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:46.051369    2563 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" secret="" err="secret \"e2e-ait-f7d735f2-openshift-default-dockercfg-27v6k\" not found"
Sep 17 17:45:46.105333 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:46.105298    2563 patch_prober.go:28] interesting pod/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 17:45:46.105694 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:46.105663    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" podUID="4624f204-240e-467c-976e-2b138d3127fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 17:45:46.703794 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:46.703745    2563 patch_prober.go:28] interesting pod/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 17:45:46.704579 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:46.704124    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 17:45:46.931200 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:46.931162    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"]
Sep 17 17:45:46.935654 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:46.934888    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:46.935918 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:46.934792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"]
Sep 17 17:45:46.940723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:46.939820    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-49bc2f4e-gw-openshift-default-dockercfg-28tz7\""
Sep 17 17:45:47.005781 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.002483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e86c0c-48c2-4e5e-8365-b307f710b032-istiod-ca-cert\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.005781 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.002554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-credential-socket\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.005781 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.002632    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-certs\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.005781 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.002672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-envoy\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.005781 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.002760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvskv\" (UniqueName: \"kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-kube-api-access-cvskv\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.005781 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.002821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-data\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.005781 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.002879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-podinfo\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.005781 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.002921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-token\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.005781 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.002955    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-socket\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.060253 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.060188    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" podUID="4624f204-240e-467c-976e-2b138d3127fe" containerName="istio-proxy" containerID="cri-o://f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd" gracePeriod=30
Sep 17 17:45:47.105726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.103959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-socket\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.105726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.104030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e86c0c-48c2-4e5e-8365-b307f710b032-istiod-ca-cert\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.105726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.104105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-credential-socket\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.105726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.104174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-certs\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.105726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.104235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-envoy\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.105726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.104303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvskv\" (UniqueName: \"kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-kube-api-access-cvskv\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.105726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.104359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-data\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.105726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.104419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-podinfo\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.105726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.104459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-token\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.105726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.105212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-socket\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.106424 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.105873    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e86c0c-48c2-4e5e-8365-b307f710b032-istiod-ca-cert\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.107830 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.106505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-certs\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.107830 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.106996    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-credential-socket\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.107830 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.107220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-data\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.113970 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.113940    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-envoy\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.114665 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.114641    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-podinfo\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.127714 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.127677    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvskv\" (UniqueName: \"kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-kube-api-access-cvskv\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.128414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.128344    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-token\") pod \"e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") " pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.257940 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.257841    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:47.703567 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.703539    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"]
Sep 17 17:45:47.704753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.704644    2563 patch_prober.go:28] interesting pod/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 17:45:47.704928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.704905    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 17:45:47.713723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.713394    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:47.713723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.713481    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:47.713723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:47.713522    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:48.080726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:48.078476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" event={"ID":"e5e86c0c-48c2-4e5e-8365-b307f710b032","Type":"ContainerStarted","Data":"dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5"}
Sep 17 17:45:48.080726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:48.078543    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" event={"ID":"e5e86c0c-48c2-4e5e-8365-b307f710b032","Type":"ContainerStarted","Data":"6e79c3d7bce3aa8c98912a6e90cb6f4c81fa7576aa7b344a5641fc44dc0a9b2f"}
Sep 17 17:45:48.104988 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:48.104921    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" podStartSLOduration=2.104898047 podStartE2EDuration="2.104898047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:48.101722698 +0000 UTC m=+874.752628690" watchObservedRunningTime="2026-09-17 17:45:48.104898047 +0000 UTC m=+874.755804040"
Sep 17 17:45:48.261220 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:48.261127    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:48.261904 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:48.261525    2563 patch_prober.go:28] interesting pod/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 17 17:45:48.261904 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:48.261576    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 17 17:45:48.704531 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:48.704493    2563 patch_prober.go:28] interesting pod/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 17:45:48.704871 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:48.704836    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 17:45:49.259896 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:49.259503    2563 patch_prober.go:28] interesting pod/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 17 17:45:49.259896 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:49.259556    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 17 17:45:49.704446 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:49.704396    2563 patch_prober.go:28] interesting pod/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 17:45:49.704647 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:49.704472    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 17:45:50.263004 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:50.262970    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:50.703752 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:50.703692    2563 patch_prober.go:28] interesting pod/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 17:45:50.703979 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:50.703779    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 17:45:50.773319 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:50.773287    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:51.102282 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:51.102250    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:51.103742 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:51.103687    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:45:51.709459 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:51.709429    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:51.710465 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:51.710448    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:45:52.831214 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:52.830847    2563 patch_prober.go:28] interesting pod/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 17:45:52.831214 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:52.830924    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 17:45:53.115569 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:53.115489    2563 generic.go:356] "Generic (PLEG): container finished" podID="003e4d27-fb69-4dab-9b23-8728552cbded" containerID="4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530" exitCode=0
Sep 17 17:45:53.115569 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:53.115556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" event={"ID":"003e4d27-fb69-4dab-9b23-8728552cbded","Type":"ContainerDied","Data":"4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530"}
Sep 17 17:45:53.116125 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:53.116104    2563 scope.go:117] "RemoveContainer" containerID="4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530"
Sep 17 17:45:53.117218 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:53.117183    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:53.117276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:53.117254    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:53.117322 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:53.117294    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:45:54.128205 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:54.128160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" event={"ID":"003e4d27-fb69-4dab-9b23-8728552cbded","Type":"ContainerStarted","Data":"13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b"}
Sep 17 17:45:54.767333 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:54.767301    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:54.767545 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:54.767520    2563 patch_prober.go:28] interesting pod/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 17 17:45:54.767593 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:54.767572    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 17 17:45:55.767218 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:55.767183    2563 patch_prober.go:28] interesting pod/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 17 17:45:55.767689 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:55.767258    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 17 17:45:56.365799 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.365774    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:56.537792 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.537761    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84rh9\" (UniqueName: \"kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-kube-api-access-84rh9\") pod \"4624f204-240e-467c-976e-2b138d3127fe\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") "
Sep 17 17:45:56.537792 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.537795    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-istio-token\") pod \"4624f204-240e-467c-976e-2b138d3127fe\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") "
Sep 17 17:45:56.538042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.537859    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-socket\") pod \"4624f204-240e-467c-976e-2b138d3127fe\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") "
Sep 17 17:45:56.538042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.537903    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-envoy\") pod \"4624f204-240e-467c-976e-2b138d3127fe\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") "
Sep 17 17:45:56.538042 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538017    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-data\") pod \"4624f204-240e-467c-976e-2b138d3127fe\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") "
Sep 17 17:45:56.538204 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538075    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-credential-socket\") pod \"4624f204-240e-467c-976e-2b138d3127fe\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") "
Sep 17 17:45:56.538204 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538115    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-certs\") pod \"4624f204-240e-467c-976e-2b138d3127fe\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") "
Sep 17 17:45:56.538204 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538149    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4624f204-240e-467c-976e-2b138d3127fe-istiod-ca-cert\") pod \"4624f204-240e-467c-976e-2b138d3127fe\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") "
Sep 17 17:45:56.538204 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538185    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4624f204-240e-467c-976e-2b138d3127fe" (UID: "4624f204-240e-467c-976e-2b138d3127fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:45:56.538430 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538192    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4624f204-240e-467c-976e-2b138d3127fe-istio-podinfo\") pod \"4624f204-240e-467c-976e-2b138d3127fe\" (UID: \"4624f204-240e-467c-976e-2b138d3127fe\") "
Sep 17 17:45:56.538430 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538259    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "4624f204-240e-467c-976e-2b138d3127fe" (UID: "4624f204-240e-467c-976e-2b138d3127fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:45:56.538430 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538343    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4624f204-240e-467c-976e-2b138d3127fe" (UID: "4624f204-240e-467c-976e-2b138d3127fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:45:56.538593 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538425    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4624f204-240e-467c-976e-2b138d3127fe" (UID: "4624f204-240e-467c-976e-2b138d3127fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:45:56.538689 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538669    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:45:56.538841 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538746    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:45:56.538841 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538763    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:45:56.538841 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538777    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:45:56.538841 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.538657    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4624f204-240e-467c-976e-2b138d3127fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4624f204-240e-467c-976e-2b138d3127fe" (UID: "4624f204-240e-467c-976e-2b138d3127fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:45:56.540440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.540420    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4624f204-240e-467c-976e-2b138d3127fe" (UID: "4624f204-240e-467c-976e-2b138d3127fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:45:56.540527 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.540456    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-kube-api-access-84rh9" (OuterVolumeSpecName: "kube-api-access-84rh9") pod "4624f204-240e-467c-976e-2b138d3127fe" (UID: "4624f204-240e-467c-976e-2b138d3127fe"). InnerVolumeSpecName "kube-api-access-84rh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:45:56.540569 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.540528    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "4624f204-240e-467c-976e-2b138d3127fe" (UID: "4624f204-240e-467c-976e-2b138d3127fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:45:56.541136 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.541114    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4624f204-240e-467c-976e-2b138d3127fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4624f204-240e-467c-976e-2b138d3127fe" (UID: "4624f204-240e-467c-976e-2b138d3127fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:45:56.639670 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.639628    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84rh9\" (UniqueName: \"kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-kube-api-access-84rh9\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:45:56.639670 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.639664    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4624f204-240e-467c-976e-2b138d3127fe-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:45:56.639670 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.639678    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4624f204-240e-467c-976e-2b138d3127fe-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:45:56.639936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.639690    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4624f204-240e-467c-976e-2b138d3127fe-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:45:56.639936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.639726    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4624f204-240e-467c-976e-2b138d3127fe-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:45:56.767324 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.767289    2563 patch_prober.go:28] interesting pod/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 17 17:45:56.767734 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:56.767358    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 17 17:45:57.146374 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.146334    2563 generic.go:356] "Generic (PLEG): container finished" podID="4624f204-240e-467c-976e-2b138d3127fe" containerID="f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd" exitCode=0
Sep 17 17:45:57.146374 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.146374    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"
Sep 17 17:45:57.146576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.146425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" event={"ID":"4624f204-240e-467c-976e-2b138d3127fe","Type":"ContainerDied","Data":"f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd"}
Sep 17 17:45:57.146576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.146504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844" event={"ID":"4624f204-240e-467c-976e-2b138d3127fe","Type":"ContainerDied","Data":"28bfdbb1a14a1d1327f42f6487769bfe589ded142a2b9900b4a82d96bae7fa68"}
Sep 17 17:45:57.146576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.146533    2563 scope.go:117] "RemoveContainer" containerID="f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd"
Sep 17 17:45:57.157383 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.157359    2563 scope.go:117] "RemoveContainer" containerID="1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d"
Sep 17 17:45:57.166076 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.166056    2563 scope.go:117] "RemoveContainer" containerID="f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd"
Sep 17 17:45:57.166369 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:45:57.166349    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd\": container with ID starting with f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd not found: ID does not exist" containerID="f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd"
Sep 17 17:45:57.166453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.166383    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd"} err="failed to get container status \"f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd\": rpc error: code = NotFound desc = could not find container \"f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd\": container with ID starting with f810309b16c5f94646e61a35c7d943674408ffa26b7771a57ffd49b02ffb2bcd not found: ID does not exist"
Sep 17 17:45:57.166453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.166409    2563 scope.go:117] "RemoveContainer" containerID="1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d"
Sep 17 17:45:57.166690 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:45:57.166671    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d\": container with ID starting with 1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d not found: ID does not exist" containerID="1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d"
Sep 17 17:45:57.166751 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.166696    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d"} err="failed to get container status \"1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d\": rpc error: code = NotFound desc = could not find container \"1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d\": container with ID starting with 1d491b8758a669b6949d07c4ac67e67f5faf64526fc18ccdf6be482b561d6b4d not found: ID does not exist"
Sep 17 17:45:57.188725 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.186677    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"]
Sep 17 17:45:57.192816 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.192789    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f7d735f2-openshift-default-7c8d556d48-r4844"]
Sep 17 17:45:57.616478 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.616436    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4624f204-240e-467c-976e-2b138d3127fe" path="/var/lib/kubelet/pods/4624f204-240e-467c-976e-2b138d3127fe/volumes"
Sep 17 17:45:57.767918 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.767881    2563 patch_prober.go:28] interesting pod/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 17 17:45:57.768277 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:57.767946    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 17 17:45:58.767267 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:58.767232    2563 patch_prober.go:28] interesting pod/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 17 17:45:58.767430 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:58.767281    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 17 17:45:59.771254 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:59.771224    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:59.771626 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:59.771576    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:45:59.772190 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:45:59.772171    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:46:02.404689 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:02.404644    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:46:13.256300 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:13.256269    2563 generic.go:356] "Generic (PLEG): container finished" podID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerID="dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5" exitCode=0
Sep 17 17:46:13.256726 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:13.256342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" event={"ID":"e5e86c0c-48c2-4e5e-8365-b307f710b032","Type":"ContainerDied","Data":"dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5"}
Sep 17 17:46:13.256794 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:13.256779    2563 scope.go:117] "RemoveContainer" containerID="dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5"
Sep 17 17:46:13.257966 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:13.257935    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:13.258063 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:13.258006    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:13.258063 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:13.258040    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:14.263475 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:14.263438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" event={"ID":"e5e86c0c-48c2-4e5e-8365-b307f710b032","Type":"ContainerStarted","Data":"1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3"}
Sep 17 17:46:15.259430 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:15.259397    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:46:15.259603 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:15.259572    2563 patch_prober.go:28] interesting pod/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 17 17:46:15.259649 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:15.259617    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 17 17:46:15.626723 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:15.617769    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:46:15.630038 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:15.630007    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:46:15.661262 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:15.660667    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:46:15.665146 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:15.665068    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:46:15.719527 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:15.719485    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"]
Sep 17 17:46:16.259679 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.259640    2563 patch_prober.go:28] interesting pod/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 17 17:46:16.259939 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.259725    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 17 17:46:16.276181 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.276148    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerName="istio-proxy" containerID="cri-o://1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3" gracePeriod=30
Sep 17 17:46:16.516785 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.516065    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"]
Sep 17 17:46:16.523194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.520776    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4624f204-240e-467c-976e-2b138d3127fe" containerName="istio-proxy"
Sep 17 17:46:16.523194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.520802    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4624f204-240e-467c-976e-2b138d3127fe" containerName="istio-proxy"
Sep 17 17:46:16.523194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.520822    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4624f204-240e-467c-976e-2b138d3127fe" containerName="istio-proxy"
Sep 17 17:46:16.523194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.520831    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4624f204-240e-467c-976e-2b138d3127fe" containerName="istio-proxy"
Sep 17 17:46:16.523194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.520965    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4624f204-240e-467c-976e-2b138d3127fe" containerName="istio-proxy"
Sep 17 17:46:16.523194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.520977    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4624f204-240e-467c-976e-2b138d3127fe" containerName="istio-proxy"
Sep 17 17:46:16.525439 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.525417    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.528342 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.528317    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"]
Sep 17 17:46:16.530006 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.529817    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2b0967aa-openshift-default-dockercfg-wxjwh\""
Sep 17 17:46:16.651613 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.651577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9254587-2974-4050-9936-ced0e8fec72d-istiod-ca-cert\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.652296 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.652255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-envoy\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.652510 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.652491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-certs\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.652637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.652622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-istio-token\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.652796 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.652778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-credential-socket\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.652912 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.652895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9254587-2974-4050-9936-ced0e8fec72d-istio-podinfo\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.653041 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.653020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-socket\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.653965 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.653576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-data\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.653965 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.653649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpfkm\" (UniqueName: \"kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-kube-api-access-cpfkm\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.754996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.754961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-envoy\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-certs\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-istio-token\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-credential-socket\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9254587-2974-4050-9936-ced0e8fec72d-istio-podinfo\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-socket\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-data\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpfkm\" (UniqueName: \"kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-kube-api-access-cpfkm\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755596 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9254587-2974-4050-9936-ced0e8fec72d-istiod-ca-cert\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755596 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-certs\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755596 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-socket\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755801 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755721    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-credential-socket\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.755801 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.755755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-data\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.756078 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.756058    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9254587-2974-4050-9936-ced0e8fec72d-istiod-ca-cert\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.757498 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.757477    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-envoy\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.757598 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.757562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9254587-2974-4050-9936-ced0e8fec72d-istio-podinfo\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.764297 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.764276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-istio-token\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.764377 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.764341    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpfkm\" (UniqueName: \"kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-kube-api-access-cpfkm\") pod \"e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") " pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:16.838401 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:16.838367    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:17.162215 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:17.162184    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"]
Sep 17 17:46:17.163418 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:46:17.163391    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9254587_2974_4050_9936_ced0e8fec72d.slice/crio-86001d0e979290b5d832c3d0e8c0faa9d4ce435de072e901087be5eeaff6cffe WatchSource:0}: Error finding container 86001d0e979290b5d832c3d0e8c0faa9d4ce435de072e901087be5eeaff6cffe: Status 404 returned error can't find the container with id 86001d0e979290b5d832c3d0e8c0faa9d4ce435de072e901087be5eeaff6cffe
Sep 17 17:46:17.165735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:17.165681    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:17.165810 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:17.165774    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:17.165810 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:17.165802    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:17.289101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:17.289064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" event={"ID":"e9254587-2974-4050-9936-ced0e8fec72d","Type":"ContainerStarted","Data":"86001d0e979290b5d832c3d0e8c0faa9d4ce435de072e901087be5eeaff6cffe"}
Sep 17 17:46:18.299119 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:18.299082    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" event={"ID":"e9254587-2974-4050-9936-ced0e8fec72d","Type":"ContainerStarted","Data":"85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47"}
Sep 17 17:46:18.326165 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:18.326112    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" podStartSLOduration=2.326095788 podStartE2EDuration="2.326095788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:46:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:46:18.32526922 +0000 UTC m=+904.976175215" watchObservedRunningTime="2026-09-17 17:46:18.326095788 +0000 UTC m=+904.977001780"
Sep 17 17:46:18.839164 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:18.839130    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:18.844950 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:18.844925    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:19.305109 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:19.305071    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:19.306124 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:19.306103    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:21.102258 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:21.102221    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:46:21.250728 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:21.250251    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:46:24.838126 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.838102    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:46:24.945282 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945203    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-credential-socket\") pod \"e5e86c0c-48c2-4e5e-8365-b307f710b032\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") "
Sep 17 17:46:24.945282 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945235    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-socket\") pod \"e5e86c0c-48c2-4e5e-8365-b307f710b032\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") "
Sep 17 17:46:24.945282 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945267    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-certs\") pod \"e5e86c0c-48c2-4e5e-8365-b307f710b032\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") "
Sep 17 17:46:24.945548 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-token\") pod \"e5e86c0c-48c2-4e5e-8365-b307f710b032\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") "
Sep 17 17:46:24.945548 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945340    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e86c0c-48c2-4e5e-8365-b307f710b032-istiod-ca-cert\") pod \"e5e86c0c-48c2-4e5e-8365-b307f710b032\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") "
Sep 17 17:46:24.945548 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945379    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvskv\" (UniqueName: \"kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-kube-api-access-cvskv\") pod \"e5e86c0c-48c2-4e5e-8365-b307f710b032\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") "
Sep 17 17:46:24.945548 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945514    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-data\") pod \"e5e86c0c-48c2-4e5e-8365-b307f710b032\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") "
Sep 17 17:46:24.945785 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945548    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5e86c0c-48c2-4e5e-8365-b307f710b032" (UID: "e5e86c0c-48c2-4e5e-8365-b307f710b032"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:46:24.945785 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5e86c0c-48c2-4e5e-8365-b307f710b032" (UID: "e5e86c0c-48c2-4e5e-8365-b307f710b032"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:46:24.945785 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945577    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5e86c0c-48c2-4e5e-8365-b307f710b032" (UID: "e5e86c0c-48c2-4e5e-8365-b307f710b032"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:46:24.945785 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945576    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-podinfo\") pod \"e5e86c0c-48c2-4e5e-8365-b307f710b032\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") "
Sep 17 17:46:24.945785 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945670    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-envoy\") pod \"e5e86c0c-48c2-4e5e-8365-b307f710b032\" (UID: \"e5e86c0c-48c2-4e5e-8365-b307f710b032\") "
Sep 17 17:46:24.946026 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945784    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5e86c0c-48c2-4e5e-8365-b307f710b032" (UID: "e5e86c0c-48c2-4e5e-8365-b307f710b032"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:46:24.946026 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.945843    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5e86c0c-48c2-4e5e-8365-b307f710b032-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5e86c0c-48c2-4e5e-8365-b307f710b032" (UID: "e5e86c0c-48c2-4e5e-8365-b307f710b032"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:46:24.946187 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.946161    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:46:24.946187 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.946189    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:46:24.946392 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.946202    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:46:24.946392 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.946210    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e86c0c-48c2-4e5e-8365-b307f710b032-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:46:24.946392 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.946221    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:46:24.947628 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.947605    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5e86c0c-48c2-4e5e-8365-b307f710b032" (UID: "e5e86c0c-48c2-4e5e-8365-b307f710b032"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:46:24.947782 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.947669    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-kube-api-access-cvskv" (OuterVolumeSpecName: "kube-api-access-cvskv") pod "e5e86c0c-48c2-4e5e-8365-b307f710b032" (UID: "e5e86c0c-48c2-4e5e-8365-b307f710b032"). InnerVolumeSpecName "kube-api-access-cvskv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:46:24.948008 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.947987    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5e86c0c-48c2-4e5e-8365-b307f710b032" (UID: "e5e86c0c-48c2-4e5e-8365-b307f710b032"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:46:24.948008 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:24.947996    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5e86c0c-48c2-4e5e-8365-b307f710b032" (UID: "e5e86c0c-48c2-4e5e-8365-b307f710b032"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:46:25.047677 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.047644    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:46:25.047677 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.047671    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvskv\" (UniqueName: \"kubernetes.io/projected/e5e86c0c-48c2-4e5e-8365-b307f710b032-kube-api-access-cvskv\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:46:25.047677 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.047682    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:46:25.047935 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.047692    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e86c0c-48c2-4e5e-8365-b307f710b032-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:46:25.337857 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.337817    2563 generic.go:356] "Generic (PLEG): container finished" podID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerID="1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3" exitCode=0
Sep 17 17:46:25.338032 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.337880    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"
Sep 17 17:46:25.338032 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.337912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" event={"ID":"e5e86c0c-48c2-4e5e-8365-b307f710b032","Type":"ContainerDied","Data":"1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3"}
Sep 17 17:46:25.338032 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.337968    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf" event={"ID":"e5e86c0c-48c2-4e5e-8365-b307f710b032","Type":"ContainerDied","Data":"6e79c3d7bce3aa8c98912a6e90cb6f4c81fa7576aa7b344a5641fc44dc0a9b2f"}
Sep 17 17:46:25.338032 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.337995    2563 scope.go:117] "RemoveContainer" containerID="1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3"
Sep 17 17:46:25.347561 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.347541    2563 scope.go:117] "RemoveContainer" containerID="dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5"
Sep 17 17:46:25.355633 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.355618    2563 scope.go:117] "RemoveContainer" containerID="1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3"
Sep 17 17:46:25.355904 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:46:25.355886    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3\": container with ID starting with 1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3 not found: ID does not exist" containerID="1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3"
Sep 17 17:46:25.355958 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.355913    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3"} err="failed to get container status \"1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3\": rpc error: code = NotFound desc = could not find container \"1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3\": container with ID starting with 1b9482a96eda5b19fb13007960d5ac7d4865f30eef6d3328af36b4d56d8193c3 not found: ID does not exist"
Sep 17 17:46:25.355958 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.355930    2563 scope.go:117] "RemoveContainer" containerID="dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5"
Sep 17 17:46:25.356174 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:46:25.356157    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5\": container with ID starting with dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5 not found: ID does not exist" containerID="dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5"
Sep 17 17:46:25.356211 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.356180    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5"} err="failed to get container status \"dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5\": rpc error: code = NotFound desc = could not find container \"dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5\": container with ID starting with dbf0c565bf6ad93ff91fdc1608e752cc3a88b229a13d0408a3f3e7f51b0b26c5 not found: ID does not exist"
Sep 17 17:46:25.371388 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.369537    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"]
Sep 17 17:46:25.375250 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.375226    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-49bc2f4e-gw-openshift-default-df6d44996-lphgf"]
Sep 17 17:46:25.614931 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:25.614844    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" path="/var/lib/kubelet/pods/e5e86c0c-48c2-4e5e-8365-b307f710b032/volumes"
Sep 17 17:46:40.366991 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:40.366951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:46:42.447691 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:42.447654    2563 generic.go:356] "Generic (PLEG): container finished" podID="e9254587-2974-4050-9936-ced0e8fec72d" containerID="85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47" exitCode=0
Sep 17 17:46:42.448113 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:42.447730    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" event={"ID":"e9254587-2974-4050-9936-ced0e8fec72d","Type":"ContainerDied","Data":"85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47"}
Sep 17 17:46:42.448165 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:42.448150    2563 scope.go:117] "RemoveContainer" containerID="85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47"
Sep 17 17:46:42.449428 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:42.449399    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:42.449501 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:42.449469    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:42.449538 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:42.449501    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:43.455304 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:43.455265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" event={"ID":"e9254587-2974-4050-9936-ced0e8fec72d","Type":"ContainerStarted","Data":"b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a"}
Sep 17 17:46:43.838880 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:43.838846    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:43.839072 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:43.839050    2563 patch_prober.go:28] interesting pod/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 17 17:46:43.839127 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:43.839099    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 17 17:46:44.839558 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:44.839523    2563 patch_prober.go:28] interesting pod/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 17 17:46:44.839999 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:44.839575    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 17 17:46:45.838910 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:45.838878    2563 patch_prober.go:28] interesting pod/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 17 17:46:45.839113 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:45.838936    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 17 17:46:46.839342 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:46.839298    2563 patch_prober.go:28] interesting pod/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 17 17:46:46.839762 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:46.839357    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 17 17:46:47.839322 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:47.839286    2563 patch_prober.go:28] interesting pod/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 17 17:46:47.839506 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:47.839346    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 17 17:46:48.843534 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:48.843507    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:48.843990 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:48.843790    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:48.844419 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:48.844404    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:46:55.503566 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:55.503536    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"]
Sep 17 17:46:55.504047 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:55.503759    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy" containerID="cri-o://b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a" gracePeriod=30
Sep 17 17:46:56.436910 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.436876    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"]
Sep 17 17:46:56.437332 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.437318    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerName="istio-proxy"
Sep 17 17:46:56.437396 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.437333    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerName="istio-proxy"
Sep 17 17:46:56.437449 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.437409    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerName="istio-proxy"
Sep 17 17:46:56.437449 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.437420    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerName="istio-proxy"
Sep 17 17:46:56.441742 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.441688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.446262 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.446237    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-9e4e10ed-openshift-default-dockercfg-88dgl\""
Sep 17 17:46:56.460283 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.460252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"]
Sep 17 17:46:56.571942 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.571909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-data\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.571942 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.571943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c69cd18f-d854-4a67-9726-20810cc88dae-istio-podinfo\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.572473 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.571967    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqlr5\" (UniqueName: \"kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-kube-api-access-dqlr5\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.572473 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.572042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-envoy\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.572473 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.572070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c69cd18f-d854-4a67-9726-20810cc88dae-istiod-ca-cert\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.572473 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.572097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-credential-socket\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.572473 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.572195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-istio-token\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.572473 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.572231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-certs\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.572473 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.572372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-socket\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.673828 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.673789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-data\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.673828 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.673830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c69cd18f-d854-4a67-9726-20810cc88dae-istio-podinfo\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674088 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.673856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqlr5\" (UniqueName: \"kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-kube-api-access-dqlr5\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674088 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.673891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-envoy\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674088 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.673925    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c69cd18f-d854-4a67-9726-20810cc88dae-istiod-ca-cert\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674088 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.673963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-credential-socket\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674088 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.674031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-istio-token\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674088 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.674076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-certs\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674396 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.674206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-socket\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674396 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.674245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-data\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674396 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.674303    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-credential-socket\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674609 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.674589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-certs\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674674 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.674597    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-socket\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.674779 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.674755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c69cd18f-d854-4a67-9726-20810cc88dae-istiod-ca-cert\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.676191 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.676168    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-envoy\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.676430 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.676411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c69cd18f-d854-4a67-9726-20810cc88dae-istio-podinfo\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.690399 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.690336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-istio-token\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.691194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.691176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqlr5\" (UniqueName: \"kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-kube-api-access-dqlr5\") pod \"e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") " pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:56.754490 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:56.754445    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:57.062995 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:57.062973    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"]
Sep 17 17:46:57.065406 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:46:57.065378    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69cd18f_d854_4a67_9726_20810cc88dae.slice/crio-7d74a49c0e7f7c49365f76a44c392ce99f8152860f8af448884f75ade34a4663 WatchSource:0}: Error finding container 7d74a49c0e7f7c49365f76a44c392ce99f8152860f8af448884f75ade34a4663: Status 404 returned error can't find the container with id 7d74a49c0e7f7c49365f76a44c392ce99f8152860f8af448884f75ade34a4663
Sep 17 17:46:57.067771 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:57.067737    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:57.067880 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:57.067815    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:57.067880 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:57.067859    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:46:57.553626 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:57.553588    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" event={"ID":"c69cd18f-d854-4a67-9726-20810cc88dae","Type":"ContainerStarted","Data":"d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1"}
Sep 17 17:46:57.553829 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:57.553644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" event={"ID":"c69cd18f-d854-4a67-9726-20810cc88dae","Type":"ContainerStarted","Data":"7d74a49c0e7f7c49365f76a44c392ce99f8152860f8af448884f75ade34a4663"}
Sep 17 17:46:57.582213 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:57.582164    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" podStartSLOduration=1.582144499 podStartE2EDuration="1.582144499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:46:57.581947747 +0000 UTC m=+944.232853764" watchObservedRunningTime="2026-09-17 17:46:57.582144499 +0000 UTC m=+944.233050525"
Sep 17 17:46:57.755012 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:57.754979    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:58.759896 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:58.759870    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:59.564047 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:59.564020    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:46:59.564809 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:46:59.564789    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:47:00.230782 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.230747    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:47:00.764606 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.764549    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:47:00.919846 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.919810    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpfkm\" (UniqueName: \"kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-kube-api-access-cpfkm\") pod \"e9254587-2974-4050-9936-ced0e8fec72d\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") "
Sep 17 17:47:00.920124 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.920107    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-socket\") pod \"e9254587-2974-4050-9936-ced0e8fec72d\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") "
Sep 17 17:47:00.920280 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.920267    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-certs\") pod \"e9254587-2974-4050-9936-ced0e8fec72d\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") "
Sep 17 17:47:00.920624 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.920608    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-istio-token\") pod \"e9254587-2974-4050-9936-ced0e8fec72d\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") "
Sep 17 17:47:00.921137 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.921114    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-credential-socket\") pod \"e9254587-2974-4050-9936-ced0e8fec72d\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") "
Sep 17 17:47:00.921306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.921290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9254587-2974-4050-9936-ced0e8fec72d-istio-podinfo\") pod \"e9254587-2974-4050-9936-ced0e8fec72d\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") "
Sep 17 17:47:00.921464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.921450    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9254587-2974-4050-9936-ced0e8fec72d-istiod-ca-cert\") pod \"e9254587-2974-4050-9936-ced0e8fec72d\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") "
Sep 17 17:47:00.921604 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.921591    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-envoy\") pod \"e9254587-2974-4050-9936-ced0e8fec72d\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") "
Sep 17 17:47:00.921752 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.921737    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-data\") pod \"e9254587-2974-4050-9936-ced0e8fec72d\" (UID: \"e9254587-2974-4050-9936-ced0e8fec72d\") "
Sep 17 17:47:00.922460 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.920355    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e9254587-2974-4050-9936-ced0e8fec72d" (UID: "e9254587-2974-4050-9936-ced0e8fec72d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:47:00.922575 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.920560    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e9254587-2974-4050-9936-ced0e8fec72d" (UID: "e9254587-2974-4050-9936-ced0e8fec72d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:47:00.922659 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.922438    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-data" (OuterVolumeSpecName: "istio-data") pod "e9254587-2974-4050-9936-ced0e8fec72d" (UID: "e9254587-2974-4050-9936-ced0e8fec72d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:47:00.922937 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.922919    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e9254587-2974-4050-9936-ced0e8fec72d" (UID: "e9254587-2974-4050-9936-ced0e8fec72d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:47:00.923737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.923492    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9254587-2974-4050-9936-ced0e8fec72d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e9254587-2974-4050-9936-ced0e8fec72d" (UID: "e9254587-2974-4050-9936-ced0e8fec72d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:47:00.927145 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.927121    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-kube-api-access-cpfkm" (OuterVolumeSpecName: "kube-api-access-cpfkm") pod "e9254587-2974-4050-9936-ced0e8fec72d" (UID: "e9254587-2974-4050-9936-ced0e8fec72d"). InnerVolumeSpecName "kube-api-access-cpfkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:47:00.936977 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.935054    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e9254587-2974-4050-9936-ced0e8fec72d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e9254587-2974-4050-9936-ced0e8fec72d" (UID: "e9254587-2974-4050-9936-ced0e8fec72d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:47:00.936977 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.935134    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e9254587-2974-4050-9936-ced0e8fec72d" (UID: "e9254587-2974-4050-9936-ced0e8fec72d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:47:00.937873 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:00.937829    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-istio-token" (OuterVolumeSpecName: "istio-token") pod "e9254587-2974-4050-9936-ced0e8fec72d" (UID: "e9254587-2974-4050-9936-ced0e8fec72d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:47:01.022929 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.022886    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:01.022929 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.022917    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:01.022929 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.022928    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpfkm\" (UniqueName: \"kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-kube-api-access-cpfkm\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:01.022929 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.022938    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:01.023316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.022947    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:01.023316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.022955    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9254587-2974-4050-9936-ced0e8fec72d-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:01.023316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.022963    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9254587-2974-4050-9936-ced0e8fec72d-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:01.023316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.022971    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9254587-2974-4050-9936-ced0e8fec72d-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:01.023316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.022979    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9254587-2974-4050-9936-ced0e8fec72d-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:01.575826 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.575790    2563 generic.go:356] "Generic (PLEG): container finished" podID="e9254587-2974-4050-9936-ced0e8fec72d" containerID="b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a" exitCode=0
Sep 17 17:47:01.576245 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.575844    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"
Sep 17 17:47:01.576245 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.575873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" event={"ID":"e9254587-2974-4050-9936-ced0e8fec72d","Type":"ContainerDied","Data":"b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a"}
Sep 17 17:47:01.576245 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.575963    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc" event={"ID":"e9254587-2974-4050-9936-ced0e8fec72d","Type":"ContainerDied","Data":"86001d0e979290b5d832c3d0e8c0faa9d4ce435de072e901087be5eeaff6cffe"}
Sep 17 17:47:01.576245 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.575995    2563 scope.go:117] "RemoveContainer" containerID="b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a"
Sep 17 17:47:01.585567 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.585550    2563 scope.go:117] "RemoveContainer" containerID="85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47"
Sep 17 17:47:01.593648 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.593633    2563 scope.go:117] "RemoveContainer" containerID="b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a"
Sep 17 17:47:01.593973 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:47:01.593955    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a\": container with ID starting with b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a not found: ID does not exist" containerID="b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a"
Sep 17 17:47:01.594026 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.593980    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a"} err="failed to get container status \"b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a\": rpc error: code = NotFound desc = could not find container \"b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a\": container with ID starting with b503584b9a48811347dd2558c5080cf35fd46017011326616a9653dcda72721a not found: ID does not exist"
Sep 17 17:47:01.594026 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.593996    2563 scope.go:117] "RemoveContainer" containerID="85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47"
Sep 17 17:47:01.594224 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:47:01.594206    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47\": container with ID starting with 85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47 not found: ID does not exist" containerID="85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47"
Sep 17 17:47:01.594278 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.594235    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47"} err="failed to get container status \"85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47\": rpc error: code = NotFound desc = could not find container \"85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47\": container with ID starting with 85803dc338f7f67e4937d45d5580e020ba4b00ae263ebcb8069daf03159f4d47 not found: ID does not exist"
Sep 17 17:47:01.599625 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.599601    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"]
Sep 17 17:47:01.605159 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.605136    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2b0967aa-openshift-default-7d946d4848-st7rc"]
Sep 17 17:47:01.614693 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:01.614668    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9254587-2974-4050-9936-ced0e8fec72d" path="/var/lib/kubelet/pods/e9254587-2974-4050-9936-ced0e8fec72d/volumes"
Sep 17 17:47:23.640287 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:23.640254    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:47:24.717385 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:24.717348    2563 generic.go:356] "Generic (PLEG): container finished" podID="c69cd18f-d854-4a67-9726-20810cc88dae" containerID="d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1" exitCode=0
Sep 17 17:47:24.718021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:24.717995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" event={"ID":"c69cd18f-d854-4a67-9726-20810cc88dae","Type":"ContainerDied","Data":"d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1"}
Sep 17 17:47:24.718653 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:24.718633    2563 scope.go:117] "RemoveContainer" containerID="d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1"
Sep 17 17:47:24.721375 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:24.721026    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:47:24.721375 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:24.721122    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:47:24.721375 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:24.721168    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:47:25.726397 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:25.726356    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" event={"ID":"c69cd18f-d854-4a67-9726-20810cc88dae","Type":"ContainerStarted","Data":"9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94"}
Sep 17 17:47:25.755151 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:25.755121    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:47:25.756251 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:25.756224    2563 patch_prober.go:28] interesting pod/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 17:47:25.756383 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:25.756278    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 17:47:26.755668 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:26.755637    2563 patch_prober.go:28] interesting pod/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 17:47:26.756082 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:26.755690    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 17:47:27.755366 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:27.755287    2563 patch_prober.go:28] interesting pod/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 17:47:27.755366 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:27.755342    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 17:47:28.755742 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:28.755692    2563 patch_prober.go:28] interesting pod/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 17:47:28.756141 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:28.755759    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 17:47:29.564860 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:29.564830    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:47:29.755440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:29.755407    2563 patch_prober.go:28] interesting pod/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 17:47:29.755614 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:29.755460    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 17:47:30.755931 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:30.755899    2563 patch_prober.go:28] interesting pod/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 17:47:30.756417 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:30.755962    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 17:47:31.759566 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:31.759539    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:47:31.760625 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:31.760604    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:47:41.880776 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:41.880738    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"]
Sep 17 17:47:41.881675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:41.881638    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy" containerID="cri-o://9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94" gracePeriod=30
Sep 17 17:47:46.761675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:46.761642    2563 patch_prober.go:28] interesting pod/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 17:47:46.762127 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:46.761692    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:47:46.850877 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:46.850847    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:47:47.236108 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.236083    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:47:47.335682 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.335608    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-data\") pod \"c69cd18f-d854-4a67-9726-20810cc88dae\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") "
Sep 17 17:47:47.335682 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.335646    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c69cd18f-d854-4a67-9726-20810cc88dae-istio-podinfo\") pod \"c69cd18f-d854-4a67-9726-20810cc88dae\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") "
Sep 17 17:47:47.335682 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.335683    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-certs\") pod \"c69cd18f-d854-4a67-9726-20810cc88dae\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") "
Sep 17 17:47:47.335956 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.335725    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-envoy\") pod \"c69cd18f-d854-4a67-9726-20810cc88dae\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") "
Sep 17 17:47:47.335956 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.335755    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-istio-token\") pod \"c69cd18f-d854-4a67-9726-20810cc88dae\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") "
Sep 17 17:47:47.335956 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.335800    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c69cd18f-d854-4a67-9726-20810cc88dae-istiod-ca-cert\") pod \"c69cd18f-d854-4a67-9726-20810cc88dae\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") "
Sep 17 17:47:47.335956 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.335891    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-socket\") pod \"c69cd18f-d854-4a67-9726-20810cc88dae\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") "
Sep 17 17:47:47.335956 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.335916    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-data" (OuterVolumeSpecName: "istio-data") pod "c69cd18f-d854-4a67-9726-20810cc88dae" (UID: "c69cd18f-d854-4a67-9726-20810cc88dae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:47:47.335956 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.335946    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqlr5\" (UniqueName: \"kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-kube-api-access-dqlr5\") pod \"c69cd18f-d854-4a67-9726-20810cc88dae\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") "
Sep 17 17:47:47.336279 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.335992    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c69cd18f-d854-4a67-9726-20810cc88dae" (UID: "c69cd18f-d854-4a67-9726-20810cc88dae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:47:47.336279 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.336046    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-credential-socket\") pod \"c69cd18f-d854-4a67-9726-20810cc88dae\" (UID: \"c69cd18f-d854-4a67-9726-20810cc88dae\") "
Sep 17 17:47:47.336279 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.336175    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c69cd18f-d854-4a67-9726-20810cc88dae" (UID: "c69cd18f-d854-4a67-9726-20810cc88dae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:47:47.336279 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.336271    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69cd18f-d854-4a67-9726-20810cc88dae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c69cd18f-d854-4a67-9726-20810cc88dae" (UID: "c69cd18f-d854-4a67-9726-20810cc88dae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:47:47.336516 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.336354    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c69cd18f-d854-4a67-9726-20810cc88dae" (UID: "c69cd18f-d854-4a67-9726-20810cc88dae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:47:47.336578 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.336542    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:47.336578 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.336564    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:47.336691 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.336578    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:47.336691 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.336592    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:47.336691 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.336608    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c69cd18f-d854-4a67-9726-20810cc88dae-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:47.338061 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.338029    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c69cd18f-d854-4a67-9726-20810cc88dae" (UID: "c69cd18f-d854-4a67-9726-20810cc88dae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:47:47.338179 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.338109    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-istio-token" (OuterVolumeSpecName: "istio-token") pod "c69cd18f-d854-4a67-9726-20810cc88dae" (UID: "c69cd18f-d854-4a67-9726-20810cc88dae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:47:47.338179 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.338134    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-kube-api-access-dqlr5" (OuterVolumeSpecName: "kube-api-access-dqlr5") pod "c69cd18f-d854-4a67-9726-20810cc88dae" (UID: "c69cd18f-d854-4a67-9726-20810cc88dae"). InnerVolumeSpecName "kube-api-access-dqlr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:47:47.338179 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.338145    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c69cd18f-d854-4a67-9726-20810cc88dae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c69cd18f-d854-4a67-9726-20810cc88dae" (UID: "c69cd18f-d854-4a67-9726-20810cc88dae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:47:47.438024 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.437995    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqlr5\" (UniqueName: \"kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-kube-api-access-dqlr5\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:47.438024 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.438021    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c69cd18f-d854-4a67-9726-20810cc88dae-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:47.438024 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.438031    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c69cd18f-d854-4a67-9726-20810cc88dae-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:47.438241 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.438040    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69cd18f-d854-4a67-9726-20810cc88dae-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:47:47.854406 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.854367    2563 generic.go:356] "Generic (PLEG): container finished" podID="c69cd18f-d854-4a67-9726-20810cc88dae" containerID="9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94" exitCode=0
Sep 17 17:47:47.854901 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.854416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" event={"ID":"c69cd18f-d854-4a67-9726-20810cc88dae","Type":"ContainerDied","Data":"9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94"}
Sep 17 17:47:47.854901 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.854433    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"
Sep 17 17:47:47.854901 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.854477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54" event={"ID":"c69cd18f-d854-4a67-9726-20810cc88dae","Type":"ContainerDied","Data":"7d74a49c0e7f7c49365f76a44c392ce99f8152860f8af448884f75ade34a4663"}
Sep 17 17:47:47.854901 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.854499    2563 scope.go:117] "RemoveContainer" containerID="9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94"
Sep 17 17:47:47.863573 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.863553    2563 scope.go:117] "RemoveContainer" containerID="d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1"
Sep 17 17:47:47.871483 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.871466    2563 scope.go:117] "RemoveContainer" containerID="9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94"
Sep 17 17:47:47.871792 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:47:47.871749    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94\": container with ID starting with 9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94 not found: ID does not exist" containerID="9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94"
Sep 17 17:47:47.871792 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.871775    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94"} err="failed to get container status \"9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94\": rpc error: code = NotFound desc = could not find container \"9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94\": container with ID starting with 9b1a65eb9a0ef4a4be8c316842e64e8095161e34ec11bdb7da2a89ef09713b94 not found: ID does not exist"
Sep 17 17:47:47.871918 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.871797    2563 scope.go:117] "RemoveContainer" containerID="d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1"
Sep 17 17:47:47.872077 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:47:47.872058    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1\": container with ID starting with d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1 not found: ID does not exist" containerID="d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1"
Sep 17 17:47:47.872127 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.872081    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1"} err="failed to get container status \"d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1\": rpc error: code = NotFound desc = could not find container \"d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1\": container with ID starting with d9ee91763b1d7afa2729de0d74f8b8bf472e8f10b4c6dea498f359601a0cd6a1 not found: ID does not exist"
Sep 17 17:47:47.879826 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.879805    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"]
Sep 17 17:47:47.888693 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:47.888673    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-9e4e10ed-openshift-default-d4c4f45d4-jwt54"]
Sep 17 17:47:49.614754 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:47:49.614692    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" path="/var/lib/kubelet/pods/c69cd18f-d854-4a67-9726-20810cc88dae/volumes"
Sep 17 17:48:01.836960 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:01.836929    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"]
Sep 17 17:48:01.837426 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:01.837117    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv" podUID="acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce" containerName="maas-api" containerID="cri-o://a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf" gracePeriod=30
Sep 17 17:48:02.083498 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.083473    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:48:02.188861 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.188776    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-openshift-service-ca\") pod \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") "
Sep 17 17:48:02.188861 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.188846    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls\") pod \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") "
Sep 17 17:48:02.189065 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.188892    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-metrics-certs\") pod \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") "
Sep 17 17:48:02.189065 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.188964    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zflp2\" (UniqueName: \"kubernetes.io/projected/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-kube-api-access-zflp2\") pod \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\" (UID: \"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce\") "
Sep 17 17:48:02.189178 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.189130    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce" (UID: "acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:48:02.189328 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.189306    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-openshift-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:02.191136 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.191104    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce" (UID: "acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:48:02.191239 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.191127    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-kube-api-access-zflp2" (OuterVolumeSpecName: "kube-api-access-zflp2") pod "acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce" (UID: "acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce"). InnerVolumeSpecName "kube-api-access-zflp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:48:02.191239 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.191159    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce" (UID: "acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:48:02.290494 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.290453    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zflp2\" (UniqueName: \"kubernetes.io/projected/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-kube-api-access-zflp2\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:02.290494 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.290483    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-maas-api-tls\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:02.290494 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.290493    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce-metrics-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:02.942203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.942169    2563 generic.go:356] "Generic (PLEG): container finished" podID="acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce" containerID="a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf" exitCode=0
Sep 17 17:48:02.942624 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.942213    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"
Sep 17 17:48:02.942624 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.942252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv" event={"ID":"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce","Type":"ContainerDied","Data":"a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf"}
Sep 17 17:48:02.942624 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.942307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv" event={"ID":"acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce","Type":"ContainerDied","Data":"a7af4a891ffc56fca9a2e5eff4df73b215342aaac306dd8ae454a4545a50a3a6"}
Sep 17 17:48:02.942624 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.942336    2563 scope.go:117] "RemoveContainer" containerID="a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf"
Sep 17 17:48:02.953990 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.953955    2563 scope.go:117] "RemoveContainer" containerID="a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf"
Sep 17 17:48:02.954444 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:48:02.954417    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf\": container with ID starting with a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf not found: ID does not exist" containerID="a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf"
Sep 17 17:48:02.954543 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.954454    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf"} err="failed to get container status \"a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf\": rpc error: code = NotFound desc = could not find container \"a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf\": container with ID starting with a7375ad87b2a62ac20e56d71d0c13000c4615f3b589e76687fce727c49f972bf not found: ID does not exist"
Sep 17 17:48:02.965369 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.965345    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"]
Sep 17 17:48:02.971514 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:02.971493    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af14f8-85974fbc55-d82xv"]
Sep 17 17:48:03.614281 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:03.614237    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce" path="/var/lib/kubelet/pods/acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce/volumes"
Sep 17 17:48:06.839268 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:06.839236    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:48:23.744372 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:23.744341    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:48:43.257580 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:43.257546    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"]
Sep 17 17:48:43.258016 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:43.257842    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy" containerID="cri-o://5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502" gracePeriod=30
Sep 17 17:48:44.393886 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.393855    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"]
Sep 17 17:48:44.394458 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394438    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy"
Sep 17 17:48:44.394553 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394461    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy"
Sep 17 17:48:44.394553 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394478    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy"
Sep 17 17:48:44.394553 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394488    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy"
Sep 17 17:48:44.394553 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394535    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce" containerName="maas-api"
Sep 17 17:48:44.394553 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394544    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce" containerName="maas-api"
Sep 17 17:48:44.394553 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394554    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerName="istio-proxy"
Sep 17 17:48:44.394890 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394563    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e86c0c-48c2-4e5e-8365-b307f710b032" containerName="istio-proxy"
Sep 17 17:48:44.394890 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394657    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="acfe17a4-c7f5-4e2c-9e4d-a7a80511d7ce" containerName="maas-api"
Sep 17 17:48:44.394890 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394669    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy"
Sep 17 17:48:44.394890 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394680    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy"
Sep 17 17:48:44.394890 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394695    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy"
Sep 17 17:48:44.394890 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.394720    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy"
Sep 17 17:48:44.396846 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.396826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.400116 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.400099    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-6239ea-openshift-default-dockercfg-mz28w\""
Sep 17 17:48:44.457898 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.457865    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"]
Sep 17 17:48:44.503161 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.503129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-envoy\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.503354 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.503183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-podinfo\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.503354 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.503210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-credential-socket\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.503354 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.503304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-certs\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.503354 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.503340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-token\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.503354 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.503356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4trgb\" (UniqueName: \"kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-kube-api-access-4trgb\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.503609 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.503375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-data\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.503609 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.503403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istiod-ca-cert\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.503609 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.503455    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-socket\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.604649 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.604608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-certs\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.604836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.604652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-token\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.604836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.604679    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4trgb\" (UniqueName: \"kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-kube-api-access-4trgb\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.604836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.604732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-data\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.604836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.604763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istiod-ca-cert\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.604836 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.604834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-socket\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.605102 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.604884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-envoy\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.605102 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.605016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-podinfo\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.605102 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.605065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-credential-socket\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.605102 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.605074    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-certs\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.605297 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.605125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-data\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.605297 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.605197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-socket\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.605363 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.605298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-credential-socket\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.605534 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.605511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istiod-ca-cert\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.607069 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.607043    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-envoy\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.607557 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.607535    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-podinfo\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.615893 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.615875    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-token\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.618242 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.618219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4trgb\" (UniqueName: \"kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-kube-api-access-4trgb\") pod \"e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") " pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.706665 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.706602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:44.986889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.986810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"]
Sep 17 17:48:44.989813 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:48:44.989784    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2effd5cf_9dff_4a30_8456_108d0a0be2ca.slice/crio-16b407ed2aa5ac257322e3703d948d99c25fa3959229698fb30679be5a53ca07 WatchSource:0}: Error finding container 16b407ed2aa5ac257322e3703d948d99c25fa3959229698fb30679be5a53ca07: Status 404 returned error can't find the container with id 16b407ed2aa5ac257322e3703d948d99c25fa3959229698fb30679be5a53ca07
Sep 17 17:48:44.992053 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.992021    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:48:44.992116 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.992085    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:48:44.992158 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:44.992117    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:48:45.169179 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:45.169145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" event={"ID":"2effd5cf-9dff-4a30-8456-108d0a0be2ca","Type":"ContainerStarted","Data":"b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70"}
Sep 17 17:48:45.169355 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:45.169204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" event={"ID":"2effd5cf-9dff-4a30-8456-108d0a0be2ca","Type":"ContainerStarted","Data":"16b407ed2aa5ac257322e3703d948d99c25fa3959229698fb30679be5a53ca07"}
Sep 17 17:48:45.195177 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:45.195126    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" podStartSLOduration=1.195108171 podStartE2EDuration="1.195108171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:48:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:48:45.193033135 +0000 UTC m=+1051.843939127" watchObservedRunningTime="2026-09-17 17:48:45.195108171 +0000 UTC m=+1051.846014234"
Sep 17 17:48:45.706991 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:45.706960    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:46.712930 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:46.712899    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:47.179980 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:47.179938    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:47.180957 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:47.180933    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:48:48.509917 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.509895    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:48:48.650963 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.650937    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-certs\") pod \"87f9b90a-3226-4d7d-9887-73ef83c732b7\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") "
Sep 17 17:48:48.651118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.650972    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-socket\") pod \"87f9b90a-3226-4d7d-9887-73ef83c732b7\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") "
Sep 17 17:48:48.651118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651024    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-credential-socket\") pod \"87f9b90a-3226-4d7d-9887-73ef83c732b7\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") "
Sep 17 17:48:48.651118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651053    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-token\") pod \"87f9b90a-3226-4d7d-9887-73ef83c732b7\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") "
Sep 17 17:48:48.651118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651083    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-envoy\") pod \"87f9b90a-3226-4d7d-9887-73ef83c732b7\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") "
Sep 17 17:48:48.651372 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651136    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-data\") pod \"87f9b90a-3226-4d7d-9887-73ef83c732b7\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") "
Sep 17 17:48:48.651372 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651184    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6lcf\" (UniqueName: \"kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-kube-api-access-s6lcf\") pod \"87f9b90a-3226-4d7d-9887-73ef83c732b7\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") "
Sep 17 17:48:48.651372 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651200    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87f9b90a-3226-4d7d-9887-73ef83c732b7" (UID: "87f9b90a-3226-4d7d-9887-73ef83c732b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:48:48.651372 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651216    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87f9b90a-3226-4d7d-9887-73ef83c732b7-istiod-ca-cert\") pod \"87f9b90a-3226-4d7d-9887-73ef83c732b7\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") "
Sep 17 17:48:48.651372 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651306    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87f9b90a-3226-4d7d-9887-73ef83c732b7" (UID: "87f9b90a-3226-4d7d-9887-73ef83c732b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:48:48.651372 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651313    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-podinfo\") pod \"87f9b90a-3226-4d7d-9887-73ef83c732b7\" (UID: \"87f9b90a-3226-4d7d-9887-73ef83c732b7\") "
Sep 17 17:48:48.651372 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651353    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87f9b90a-3226-4d7d-9887-73ef83c732b7" (UID: "87f9b90a-3226-4d7d-9887-73ef83c732b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:48:48.651737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651447    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "87f9b90a-3226-4d7d-9887-73ef83c732b7" (UID: "87f9b90a-3226-4d7d-9887-73ef83c732b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:48:48.651737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651537    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f9b90a-3226-4d7d-9887-73ef83c732b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87f9b90a-3226-4d7d-9887-73ef83c732b7" (UID: "87f9b90a-3226-4d7d-9887-73ef83c732b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:48:48.651737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651663    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87f9b90a-3226-4d7d-9887-73ef83c732b7-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:48.651737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651683    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:48.651737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651696    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:48.652012 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651739    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:48.652012 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.651756    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:48.653301 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.653280    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87f9b90a-3226-4d7d-9887-73ef83c732b7" (UID: "87f9b90a-3226-4d7d-9887-73ef83c732b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:48:48.653411 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.653390    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-kube-api-access-s6lcf" (OuterVolumeSpecName: "kube-api-access-s6lcf") pod "87f9b90a-3226-4d7d-9887-73ef83c732b7" (UID: "87f9b90a-3226-4d7d-9887-73ef83c732b7"). InnerVolumeSpecName "kube-api-access-s6lcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:48:48.653652 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.653631    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87f9b90a-3226-4d7d-9887-73ef83c732b7" (UID: "87f9b90a-3226-4d7d-9887-73ef83c732b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:48:48.653764 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.653658    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "87f9b90a-3226-4d7d-9887-73ef83c732b7" (UID: "87f9b90a-3226-4d7d-9887-73ef83c732b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:48:48.753235 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.753199    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:48.753235 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.753238    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6lcf\" (UniqueName: \"kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-kube-api-access-s6lcf\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:48.753388 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.753252    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:48.753388 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:48.753264    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87f9b90a-3226-4d7d-9887-73ef83c732b7-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:48:49.196288 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.196252    2563 generic.go:356] "Generic (PLEG): container finished" podID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerID="5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502" exitCode=0
Sep 17 17:48:49.196500 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.196296    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"
Sep 17 17:48:49.196500 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.196341    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" event={"ID":"87f9b90a-3226-4d7d-9887-73ef83c732b7","Type":"ContainerDied","Data":"5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502"}
Sep 17 17:48:49.196500 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.196406    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf" event={"ID":"87f9b90a-3226-4d7d-9887-73ef83c732b7","Type":"ContainerDied","Data":"0281e2fca32141191914e70e363b9f0ae9ccbe99e6a7ccc711e05e1eda82c08b"}
Sep 17 17:48:49.196500 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.196439    2563 scope.go:117] "RemoveContainer" containerID="5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502"
Sep 17 17:48:49.207074 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.207059    2563 scope.go:117] "RemoveContainer" containerID="a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10"
Sep 17 17:48:49.219942 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.219921    2563 scope.go:117] "RemoveContainer" containerID="5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502"
Sep 17 17:48:49.220326 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:48:49.220292    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502\": container with ID starting with 5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502 not found: ID does not exist" containerID="5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502"
Sep 17 17:48:49.220399 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.220336    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502"} err="failed to get container status \"5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502\": rpc error: code = NotFound desc = could not find container \"5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502\": container with ID starting with 5c1584a1ba21b30b73bc61a53050dfa4d76a02ef3d5b6a4e3b13407672d88502 not found: ID does not exist"
Sep 17 17:48:49.220399 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.220354    2563 scope.go:117] "RemoveContainer" containerID="a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10"
Sep 17 17:48:49.220681 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:48:49.220654    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10\": container with ID starting with a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10 not found: ID does not exist" containerID="a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10"
Sep 17 17:48:49.220837 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.220684    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10"} err="failed to get container status \"a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10\": rpc error: code = NotFound desc = could not find container \"a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10\": container with ID starting with a057c33ae519b88c0d5d16b65214ce1506c5f8d4967a56bdfb951b41b2eeaa10 not found: ID does not exist"
Sep 17 17:48:49.224055 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.224031    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"]
Sep 17 17:48:49.230389 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.230366    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-af14f8-openshift-default-6575c9fd6-82fpf"]
Sep 17 17:48:49.614613 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:49.614579    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" path="/var/lib/kubelet/pods/87f9b90a-3226-4d7d-9887-73ef83c732b7/volumes"
Sep 17 17:48:52.720632 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.720596    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"]
Sep 17 17:48:52.721237 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.721218    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy"
Sep 17 17:48:52.721340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.721239    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy"
Sep 17 17:48:52.721340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.721250    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy"
Sep 17 17:48:52.721340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.721258    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69cd18f-d854-4a67-9726-20810cc88dae" containerName="istio-proxy"
Sep 17 17:48:52.721340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.721273    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy"
Sep 17 17:48:52.721340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.721283    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9254587-2974-4050-9936-ced0e8fec72d" containerName="istio-proxy"
Sep 17 17:48:52.721340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.721298    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy"
Sep 17 17:48:52.721340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.721306    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy"
Sep 17 17:48:52.721678 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.721397    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy"
Sep 17 17:48:52.721678 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.721414    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f9b90a-3226-4d7d-9887-73ef83c732b7" containerName="istio-proxy"
Sep 17 17:48:52.724805 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.724786    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:52.727517 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.727495    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-6239ea-serving-cert\""
Sep 17 17:48:52.750734 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.750695    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"]
Sep 17 17:48:52.797257 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.797226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-metrics-certs\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:52.797399 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.797319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-maas-api-tls\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:52.797464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.797384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg7qw\" (UniqueName: \"kubernetes.io/projected/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-kube-api-access-kg7qw\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:52.797464 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.797434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-openshift-service-ca\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:52.898898 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.898855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-maas-api-tls\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:52.899074 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.898936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg7qw\" (UniqueName: \"kubernetes.io/projected/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-kube-api-access-kg7qw\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:52.899074 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.898966    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-openshift-service-ca\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:52.899074 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.899048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-metrics-certs\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:52.899074 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:48:52.899048    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-serving-cert: secret "maas-api-e2e-explicit-6239ea-serving-cert" not found
Sep 17 17:48:52.899325 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:48:52.899131    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-maas-api-tls podName:f7b4783f-926a-4b74-8f25-dfbf8b06fc30 nodeName:}" failed. No retries permitted until 2026-09-17 17:48:53.39910948 +0000 UTC m=+1060.050015457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-maas-api-tls") pod "maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj" (UID: "f7b4783f-926a-4b74-8f25-dfbf8b06fc30") : secret "maas-api-e2e-explicit-6239ea-serving-cert" not found
Sep 17 17:48:52.899646 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.899628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-openshift-service-ca\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:52.901493 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.901476    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-metrics-certs\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:52.910380 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:52.910360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg7qw\" (UniqueName: \"kubernetes.io/projected/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-kube-api-access-kg7qw\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:53.404522 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:53.404491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-maas-api-tls\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:53.406823 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:53.406791    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-maas-api-tls\") pod \"maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:53.635841 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:53.635759    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:53.912640 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:53.912609    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"]
Sep 17 17:48:53.914227 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:48:53.914197    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b4783f_926a_4b74_8f25_dfbf8b06fc30.slice/crio-9cf74f218067155508b721b933cf909036aa300c1f0d2d37874bad730bc1429f WatchSource:0}: Error finding container 9cf74f218067155508b721b933cf909036aa300c1f0d2d37874bad730bc1429f: Status 404 returned error can't find the container with id 9cf74f218067155508b721b933cf909036aa300c1f0d2d37874bad730bc1429f
Sep 17 17:48:54.224506 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:54.224428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj" event={"ID":"f7b4783f-926a-4b74-8f25-dfbf8b06fc30","Type":"ContainerStarted","Data":"9cf74f218067155508b721b933cf909036aa300c1f0d2d37874bad730bc1429f"}
Sep 17 17:48:55.231847 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:55.231812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj" event={"ID":"f7b4783f-926a-4b74-8f25-dfbf8b06fc30","Type":"ContainerStarted","Data":"66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295"}
Sep 17 17:48:55.232349 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:55.231986    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:48:55.252051 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:48:55.251999    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj" podStartSLOduration=2.8413162830000003 podStartE2EDuration="3.251981799s" totalImagesPullingTime="410.665516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:48:55.251078031 +0000 UTC m=+1061.901984089" watchObservedRunningTime="2026-09-17 17:48:55.251981799 +0000 UTC m=+1061.902887821"
Sep 17 17:49:01.243134 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:01.243053    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:49:02.481522 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:02.481481    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:49:13.345861 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:13.345823    2563 generic.go:356] "Generic (PLEG): container finished" podID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerID="b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70" exitCode=0
Sep 17 17:49:13.346332 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:13.345894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" event={"ID":"2effd5cf-9dff-4a30-8456-108d0a0be2ca","Type":"ContainerDied","Data":"b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70"}
Sep 17 17:49:13.346332 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:13.346319    2563 scope.go:117] "RemoveContainer" containerID="b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70"
Sep 17 17:49:13.347488 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:13.347456    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:49:13.347588 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:13.347541    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:49:13.347657 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:13.347592    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:49:14.353176 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:14.353141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" event={"ID":"2effd5cf-9dff-4a30-8456-108d0a0be2ca","Type":"ContainerStarted","Data":"e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2"}
Sep 17 17:49:14.708419 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:14.708275    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:49:14.708775 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:14.708739    2563 patch_prober.go:28] interesting pod/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 17 17:49:14.708898 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:14.708802    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 17 17:49:15.708851 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:15.708809    2563 patch_prober.go:28] interesting pod/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 17 17:49:15.709367 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:15.708885    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 17 17:49:16.707531 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:16.707487    2563 patch_prober.go:28] interesting pod/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 17 17:49:16.707752 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:16.707566    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 17 17:49:17.180174 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:17.180140    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:49:17.707233 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:17.707182    2563 patch_prober.go:28] interesting pod/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 17 17:49:17.707507 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:17.707480    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 17 17:49:18.707095 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:18.707058    2563 patch_prober.go:28] interesting pod/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 17 17:49:18.707725 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:18.707668    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 17 17:49:19.712064 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:19.712036    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:49:19.713559 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:19.713538    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:49:25.195016 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.194982    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"]
Sep 17 17:49:25.198681 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.198661    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.201162 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.201134    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8f6c1ea9-openshift-default-dockercfg-r7d68\""
Sep 17 17:49:25.213170 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.213147    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"]
Sep 17 17:49:25.336465 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.336422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06c139d1-6180-425b-a6d6-1d69a930322d-istiod-ca-cert\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.336918 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.336895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-data\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.337113 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.337089    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gwnc\" (UniqueName: \"kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-kube-api-access-8gwnc\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.337316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.337298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06c139d1-6180-425b-a6d6-1d69a930322d-istio-podinfo\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.337481 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.337465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-socket\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.337645 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.337630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-credential-socket\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.337835 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.337815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-envoy\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.337996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.337980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-istio-token\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.338176 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.338159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-certs\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439294 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-certs\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439474 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06c139d1-6180-425b-a6d6-1d69a930322d-istiod-ca-cert\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439474 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-data\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439474 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gwnc\" (UniqueName: \"kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-kube-api-access-8gwnc\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439474 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06c139d1-6180-425b-a6d6-1d69a930322d-istio-podinfo\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-socket\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-credential-socket\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-envoy\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-istio-token\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439957 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439740    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-certs\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439957 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-data\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.439957 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.439889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-socket\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.440124 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.440021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-credential-socket\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.440215 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.440192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06c139d1-6180-425b-a6d6-1d69a930322d-istiod-ca-cert\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.441783 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.441758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-envoy\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.442057 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.442040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06c139d1-6180-425b-a6d6-1d69a930322d-istio-podinfo\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.447583 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.447525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-istio-token\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.447923 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.447906    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gwnc\" (UniqueName: \"kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-kube-api-access-8gwnc\") pod \"e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") " pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.510578 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.510545    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:25.824073 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.824045    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"]
Sep 17 17:49:25.825866 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:49:25.825839    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c139d1_6180_425b_a6d6_1d69a930322d.slice/crio-19000122511edf1a6d084757ca360cfd0036062d4d88c680da0fde07e48142ee WatchSource:0}: Error finding container 19000122511edf1a6d084757ca360cfd0036062d4d88c680da0fde07e48142ee: Status 404 returned error can't find the container with id 19000122511edf1a6d084757ca360cfd0036062d4d88c680da0fde07e48142ee
Sep 17 17:49:25.828211 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.828171    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:49:25.828302 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.828262    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:49:25.828343 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:25.828310    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:49:26.392675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:26.392641    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:49:26.419101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:26.419066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" event={"ID":"06c139d1-6180-425b-a6d6-1d69a930322d","Type":"ContainerStarted","Data":"6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2"}
Sep 17 17:49:26.419234 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:26.419124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" event={"ID":"06c139d1-6180-425b-a6d6-1d69a930322d","Type":"ContainerStarted","Data":"19000122511edf1a6d084757ca360cfd0036062d4d88c680da0fde07e48142ee"}
Sep 17 17:49:26.467724 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:26.467652    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" podStartSLOduration=1.467636552 podStartE2EDuration="1.467636552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:49:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:49:26.461905056 +0000 UTC m=+1093.112811047" watchObservedRunningTime="2026-09-17 17:49:26.467636552 +0000 UTC m=+1093.118542543"
Sep 17 17:49:26.511309 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:26.511276    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:26.516381 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:26.516356    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:27.426825 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:27.426785    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:27.428003 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:27.427981    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:38.029627 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.029595    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"]
Sep 17 17:49:38.032140 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.032121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.034453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.034424    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8f6c1ea9-serving-cert\""
Sep 17 17:49:38.044501 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.044477    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"]
Sep 17 17:49:38.166678 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.166643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-metrics-certs\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.166887 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.166739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-maas-api-tls\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.166887 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.166790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5011b616-a23f-4590-a18b-6607aac04e22-openshift-service-ca\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.166887 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.166833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5w9z\" (UniqueName: \"kubernetes.io/projected/5011b616-a23f-4590-a18b-6607aac04e22-kube-api-access-k5w9z\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.268334 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.268300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-maas-api-tls\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.268519 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.268357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5011b616-a23f-4590-a18b-6607aac04e22-openshift-service-ca\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.268519 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.268425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5w9z\" (UniqueName: \"kubernetes.io/projected/5011b616-a23f-4590-a18b-6607aac04e22-kube-api-access-k5w9z\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.268519 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:49:38.268455    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-serving-cert: secret "maas-api-e2e-mt-8f6c1ea9-serving-cert" not found
Sep 17 17:49:38.268519 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.268487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-metrics-certs\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.268772 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:49:38.268524    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-maas-api-tls podName:5011b616-a23f-4590-a18b-6607aac04e22 nodeName:}" failed. No retries permitted until 2026-09-17 17:49:38.768502987 +0000 UTC m=+1105.419408972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-maas-api-tls") pod "maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq" (UID: "5011b616-a23f-4590-a18b-6607aac04e22") : secret "maas-api-e2e-mt-8f6c1ea9-serving-cert" not found
Sep 17 17:49:38.269005 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.268982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5011b616-a23f-4590-a18b-6607aac04e22-openshift-service-ca\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.270783 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.270761    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-metrics-certs\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.277302 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.277283    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5w9z\" (UniqueName: \"kubernetes.io/projected/5011b616-a23f-4590-a18b-6607aac04e22-kube-api-access-k5w9z\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.774665 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.774629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-maas-api-tls\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.776970 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.776944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-maas-api-tls\") pod \"maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:38.944939 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:38.944899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:39.235457 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:39.235434    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"]
Sep 17 17:49:39.237047 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:49:39.237022    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5011b616_a23f_4590_a18b_6607aac04e22.slice/crio-c6b80012702f53bcc11629abc9348dea1a3b0d54d26df882a29b8d5dcd8b8d74 WatchSource:0}: Error finding container c6b80012702f53bcc11629abc9348dea1a3b0d54d26df882a29b8d5dcd8b8d74: Status 404 returned error can't find the container with id c6b80012702f53bcc11629abc9348dea1a3b0d54d26df882a29b8d5dcd8b8d74
Sep 17 17:49:39.493873 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:39.493779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq" event={"ID":"5011b616-a23f-4590-a18b-6607aac04e22","Type":"ContainerStarted","Data":"c6b80012702f53bcc11629abc9348dea1a3b0d54d26df882a29b8d5dcd8b8d74"}
Sep 17 17:49:40.500639 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:40.500608    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq" event={"ID":"5011b616-a23f-4590-a18b-6607aac04e22","Type":"ContainerStarted","Data":"582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab"}
Sep 17 17:49:40.501086 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:40.500732    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:46.135025 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:46.134969    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq" podStartSLOduration=7.723887822 podStartE2EDuration="8.134951723s" totalImagesPullingTime="411.063901ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:49:40.531901735 +0000 UTC m=+1107.182807728" watchObservedRunningTime="2026-09-17 17:49:46.134951723 +0000 UTC m=+1112.785857715"
Sep 17 17:49:46.136798 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:46.136771    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:49:46.512394 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:46.512304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:49:57.428398 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:57.428308    2563 patch_prober.go:28] interesting pod/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 17 17:49:57.428398 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:57.428364    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 17 17:49:57.609916 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:57.609885    2563 generic.go:356] "Generic (PLEG): container finished" podID="06c139d1-6180-425b-a6d6-1d69a930322d" containerID="6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2" exitCode=0
Sep 17 17:49:57.614205 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:57.614179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" event={"ID":"06c139d1-6180-425b-a6d6-1d69a930322d","Type":"ContainerDied","Data":"6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2"}
Sep 17 17:49:57.614608 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:57.614595    2563 scope.go:117] "RemoveContainer" containerID="6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2"
Sep 17 17:49:57.615901 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:57.615872    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:49:57.615960 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:57.615942    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:49:57.615996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:57.615973    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:49:58.617060 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:58.617030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" event={"ID":"06c139d1-6180-425b-a6d6-1d69a930322d","Type":"ContainerStarted","Data":"0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863"}
Sep 17 17:49:59.511718 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:59.511668    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:49:59.511928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:59.511893    2563 patch_prober.go:28] interesting pod/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 17 17:49:59.511997 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:49:59.511937    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 17 17:50:00.511681 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:00.511640    2563 patch_prober.go:28] interesting pod/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 17 17:50:00.512182 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:00.511756    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 17 17:50:01.511136 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:01.511093    2563 patch_prober.go:28] interesting pod/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 17 17:50:01.511326 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:01.511176    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 17 17:50:02.511778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:02.511741    2563 patch_prober.go:28] interesting pod/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 17 17:50:02.512270 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:02.511801    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 17 17:50:03.511718 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:03.511667    2563 patch_prober.go:28] interesting pod/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 17 17:50:03.511894 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:03.511761    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 17 17:50:04.515151 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:04.515121    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:50:04.515559 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:04.515507    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:50:04.516242 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:04.516223    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:50:21.354835 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.354801    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"]
Sep 17 17:50:21.355319 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.355025    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj" podUID="f7b4783f-926a-4b74-8f25-dfbf8b06fc30" containerName="maas-api" containerID="cri-o://66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295" gracePeriod=30
Sep 17 17:50:21.600585 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.600555    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:50:21.610763 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.610675    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:50:21.736105 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.736071    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-maas-api-tls\") pod \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") "
Sep 17 17:50:21.736280 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.736155    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-metrics-certs\") pod \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") "
Sep 17 17:50:21.736280 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.736208    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-openshift-service-ca\") pod \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") "
Sep 17 17:50:21.736280 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.736242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg7qw\" (UniqueName: \"kubernetes.io/projected/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-kube-api-access-kg7qw\") pod \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\" (UID: \"f7b4783f-926a-4b74-8f25-dfbf8b06fc30\") "
Sep 17 17:50:21.736656 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.736627    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f7b4783f-926a-4b74-8f25-dfbf8b06fc30" (UID: "f7b4783f-926a-4b74-8f25-dfbf8b06fc30"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:50:21.738346 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.738312    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f7b4783f-926a-4b74-8f25-dfbf8b06fc30" (UID: "f7b4783f-926a-4b74-8f25-dfbf8b06fc30"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:50:21.738445 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.738375    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-kube-api-access-kg7qw" (OuterVolumeSpecName: "kube-api-access-kg7qw") pod "f7b4783f-926a-4b74-8f25-dfbf8b06fc30" (UID: "f7b4783f-926a-4b74-8f25-dfbf8b06fc30"). InnerVolumeSpecName "kube-api-access-kg7qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:50:21.738445 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.738406    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f7b4783f-926a-4b74-8f25-dfbf8b06fc30" (UID: "f7b4783f-926a-4b74-8f25-dfbf8b06fc30"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:50:21.746772 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.746742    2563 generic.go:356] "Generic (PLEG): container finished" podID="f7b4783f-926a-4b74-8f25-dfbf8b06fc30" containerID="66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295" exitCode=0
Sep 17 17:50:21.746870 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.746821    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"
Sep 17 17:50:21.746921 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.746866    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj" event={"ID":"f7b4783f-926a-4b74-8f25-dfbf8b06fc30","Type":"ContainerDied","Data":"66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295"}
Sep 17 17:50:21.746974 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.746942    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj" event={"ID":"f7b4783f-926a-4b74-8f25-dfbf8b06fc30","Type":"ContainerDied","Data":"9cf74f218067155508b721b933cf909036aa300c1f0d2d37874bad730bc1429f"}
Sep 17 17:50:21.747024 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.746980    2563 scope.go:117] "RemoveContainer" containerID="66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295"
Sep 17 17:50:21.762031 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.762013    2563 scope.go:117] "RemoveContainer" containerID="66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295"
Sep 17 17:50:21.762350 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:50:21.762332    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295\": container with ID starting with 66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295 not found: ID does not exist" containerID="66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295"
Sep 17 17:50:21.762404 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.762361    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295"} err="failed to get container status \"66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295\": rpc error: code = NotFound desc = could not find container \"66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295\": container with ID starting with 66ade784e9ba0f677c6d59c50a7be849a5aa903721b3a717a42517c1cfe85295 not found: ID does not exist"
Sep 17 17:50:21.798727 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.796880    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"]
Sep 17 17:50:21.805997 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.805684    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-6239ea-69d45d6d68-qlrjj"]
Sep 17 17:50:21.841190 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.841153    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-metrics-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:21.841449 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.841432    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-openshift-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:21.841560 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.841546    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg7qw\" (UniqueName: \"kubernetes.io/projected/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-kube-api-access-kg7qw\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:21.841647 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:21.841636    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7b4783f-926a-4b74-8f25-dfbf8b06fc30-maas-api-tls\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:23.614401 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:23.614326    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7b4783f-926a-4b74-8f25-dfbf8b06fc30" path="/var/lib/kubelet/pods/f7b4783f-926a-4b74-8f25-dfbf8b06fc30/volumes"
Sep 17 17:50:28.287681 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.287606    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"]
Sep 17 17:50:28.288149 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.287861    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq" podUID="5011b616-a23f-4590-a18b-6607aac04e22" containerName="maas-api" containerID="cri-o://582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab" gracePeriod=30
Sep 17 17:50:28.539950 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.539892    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:50:28.617722 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.613903    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-maas-api-tls\") pod \"5011b616-a23f-4590-a18b-6607aac04e22\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") "
Sep 17 17:50:28.617722 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.614125    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-metrics-certs\") pod \"5011b616-a23f-4590-a18b-6607aac04e22\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") "
Sep 17 17:50:28.617722 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.614162    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5011b616-a23f-4590-a18b-6607aac04e22-openshift-service-ca\") pod \"5011b616-a23f-4590-a18b-6607aac04e22\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") "
Sep 17 17:50:28.617722 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.614207    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5w9z\" (UniqueName: \"kubernetes.io/projected/5011b616-a23f-4590-a18b-6607aac04e22-kube-api-access-k5w9z\") pod \"5011b616-a23f-4590-a18b-6607aac04e22\" (UID: \"5011b616-a23f-4590-a18b-6607aac04e22\") "
Sep 17 17:50:28.617722 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.616211    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5011b616-a23f-4590-a18b-6607aac04e22-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5011b616-a23f-4590-a18b-6607aac04e22" (UID: "5011b616-a23f-4590-a18b-6607aac04e22"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:50:28.629771 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.628718    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5011b616-a23f-4590-a18b-6607aac04e22-kube-api-access-k5w9z" (OuterVolumeSpecName: "kube-api-access-k5w9z") pod "5011b616-a23f-4590-a18b-6607aac04e22" (UID: "5011b616-a23f-4590-a18b-6607aac04e22"). InnerVolumeSpecName "kube-api-access-k5w9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:50:28.633242 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.632233    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5011b616-a23f-4590-a18b-6607aac04e22" (UID: "5011b616-a23f-4590-a18b-6607aac04e22"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:50:28.633870 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.633825    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5011b616-a23f-4590-a18b-6607aac04e22" (UID: "5011b616-a23f-4590-a18b-6607aac04e22"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:50:28.716338 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.716248    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-maas-api-tls\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:28.716338 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.716283    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5011b616-a23f-4590-a18b-6607aac04e22-metrics-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:28.716338 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.716298    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5011b616-a23f-4590-a18b-6607aac04e22-openshift-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:28.716338 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.716311    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5w9z\" (UniqueName: \"kubernetes.io/projected/5011b616-a23f-4590-a18b-6607aac04e22-kube-api-access-k5w9z\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:28.795551 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.795462    2563 generic.go:356] "Generic (PLEG): container finished" podID="5011b616-a23f-4590-a18b-6607aac04e22" containerID="582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab" exitCode=0
Sep 17 17:50:28.795551 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.795524    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"
Sep 17 17:50:28.795551 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.795541    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq" event={"ID":"5011b616-a23f-4590-a18b-6607aac04e22","Type":"ContainerDied","Data":"582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab"}
Sep 17 17:50:28.795823 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.795593    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq" event={"ID":"5011b616-a23f-4590-a18b-6607aac04e22","Type":"ContainerDied","Data":"c6b80012702f53bcc11629abc9348dea1a3b0d54d26df882a29b8d5dcd8b8d74"}
Sep 17 17:50:28.795823 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.795616    2563 scope.go:117] "RemoveContainer" containerID="582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab"
Sep 17 17:50:28.804541 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.804525    2563 scope.go:117] "RemoveContainer" containerID="582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab"
Sep 17 17:50:28.804820 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:50:28.804803    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab\": container with ID starting with 582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab not found: ID does not exist" containerID="582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab"
Sep 17 17:50:28.804874 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.804827    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab"} err="failed to get container status \"582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab\": rpc error: code = NotFound desc = could not find container \"582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab\": container with ID starting with 582da68d4ffdf6279607d81bf37ae868b8ef568c0983ac499cc63ced69ba32ab not found: ID does not exist"
Sep 17 17:50:28.823768 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.823740    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"]
Sep 17 17:50:28.826172 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:28.826151    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8f6c1ea9-5c45dd67b4-rnhqq"]
Sep 17 17:50:29.620555 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:29.614553    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5011b616-a23f-4590-a18b-6607aac04e22" path="/var/lib/kubelet/pods/5011b616-a23f-4590-a18b-6607aac04e22/volumes"
Sep 17 17:50:31.822812 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:31.822781    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"]
Sep 17 17:50:31.823312 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:31.823045    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy" containerID="cri-o://e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2" gracePeriod=30
Sep 17 17:50:32.693783 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.693749    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"]
Sep 17 17:50:32.694261 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.694244    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5011b616-a23f-4590-a18b-6607aac04e22" containerName="maas-api"
Sep 17 17:50:32.694325 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.694263    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5011b616-a23f-4590-a18b-6607aac04e22" containerName="maas-api"
Sep 17 17:50:32.694325 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.694292    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b4783f-926a-4b74-8f25-dfbf8b06fc30" containerName="maas-api"
Sep 17 17:50:32.694325 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.694299    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b4783f-926a-4b74-8f25-dfbf8b06fc30" containerName="maas-api"
Sep 17 17:50:32.694444 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.694362    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5011b616-a23f-4590-a18b-6607aac04e22" containerName="maas-api"
Sep 17 17:50:32.694444 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.694376    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7b4783f-926a-4b74-8f25-dfbf8b06fc30" containerName="maas-api"
Sep 17 17:50:32.697534 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.697519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.700560 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.700536    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-850d96-openshift-default-dockercfg-45tcs\""
Sep 17 17:50:32.715412 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.715385    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"]
Sep 17 17:50:32.862414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.862385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-envoy\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.862414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.862417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6wqd\" (UniqueName: \"kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-kube-api-access-f6wqd\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.862875 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.862513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-socket\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.862875 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.862541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-credential-socket\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.862875 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.862586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-token\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.862875 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.862616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-data\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.862875 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.862660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-podinfo\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.862875 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.862693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669677ae-73ec-466b-81ca-d8b7f7f78afb-istiod-ca-cert\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.862875 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.862773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-certs\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.963524 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.963437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-podinfo\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.963524 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.963488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669677ae-73ec-466b-81ca-d8b7f7f78afb-istiod-ca-cert\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.963804 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.963531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-certs\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.963804 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.963588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-envoy\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.963804 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.963612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6wqd\" (UniqueName: \"kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-kube-api-access-f6wqd\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.963804 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.963689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-socket\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.963804 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.963728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-credential-socket\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.963804 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.963758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-token\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.963804 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.963795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-data\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.964168 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.964035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-certs\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.964168 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.964083    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-socket\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.964257 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.964188    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-data\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.964296 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.964268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-credential-socket\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.964345 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.964323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669677ae-73ec-466b-81ca-d8b7f7f78afb-istiod-ca-cert\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.966030 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.966010    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-envoy\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.966262 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.966244    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-podinfo\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.978928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.978903    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6wqd\" (UniqueName: \"kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-kube-api-access-f6wqd\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:32.979980 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:32.979960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-token\") pod \"e2e-noten-850d96-openshift-default-7949676d9b-wbhcf\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") " pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:33.008316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:33.008285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:33.317629 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:33.317602    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"]
Sep 17 17:50:33.319533 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:50:33.319503    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669677ae_73ec_466b_81ca_d8b7f7f78afb.slice/crio-f908c43a749bf0531b1a2225d011fe75de8d58adba9d9ce998231b562e390333 WatchSource:0}: Error finding container f908c43a749bf0531b1a2225d011fe75de8d58adba9d9ce998231b562e390333: Status 404 returned error can't find the container with id f908c43a749bf0531b1a2225d011fe75de8d58adba9d9ce998231b562e390333
Sep 17 17:50:33.321756 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:33.321723    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:50:33.321823 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:33.321788    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:50:33.321823 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:33.321814    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:50:33.831109 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:33.831069    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf" event={"ID":"669677ae-73ec-466b-81ca-d8b7f7f78afb","Type":"ContainerStarted","Data":"372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083"}
Sep 17 17:50:33.831261 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:33.831152    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf" event={"ID":"669677ae-73ec-466b-81ca-d8b7f7f78afb","Type":"ContainerStarted","Data":"f908c43a749bf0531b1a2225d011fe75de8d58adba9d9ce998231b562e390333"}
Sep 17 17:50:33.869136 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:33.869093    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf" podStartSLOduration=1.86907558 podStartE2EDuration="1.86907558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:50:33.868402313 +0000 UTC m=+1160.519308309" watchObservedRunningTime="2026-09-17 17:50:33.86907558 +0000 UTC m=+1160.519981572"
Sep 17 17:50:34.009117 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:34.009079    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:34.014327 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:34.014300    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:34.715038 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:34.715001    2563 patch_prober.go:28] interesting pod/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 17 17:50:34.715223 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:34.715080    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:50:34.837032 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:34.836999    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:34.838088 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:34.838070    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:50:37.084727 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.084650    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:50:37.212267 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212223    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-podinfo\") pod \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") "
Sep 17 17:50:37.212267 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212274    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istiod-ca-cert\") pod \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") "
Sep 17 17:50:37.212494 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212307    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-data\") pod \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") "
Sep 17 17:50:37.212494 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212349    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-socket\") pod \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") "
Sep 17 17:50:37.212494 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212386    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-envoy\") pod \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") "
Sep 17 17:50:37.212494 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212446    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-token\") pod \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") "
Sep 17 17:50:37.212680 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212514    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-certs\") pod \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") "
Sep 17 17:50:37.212680 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212573    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-credential-socket\") pod \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") "
Sep 17 17:50:37.212680 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212597    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4trgb\" (UniqueName: \"kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-kube-api-access-4trgb\") pod \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\" (UID: \"2effd5cf-9dff-4a30-8456-108d0a0be2ca\") "
Sep 17 17:50:37.212680 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212632    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "2effd5cf-9dff-4a30-8456-108d0a0be2ca" (UID: "2effd5cf-9dff-4a30-8456-108d0a0be2ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:37.212680 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212653    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2effd5cf-9dff-4a30-8456-108d0a0be2ca" (UID: "2effd5cf-9dff-4a30-8456-108d0a0be2ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:37.212973 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212766    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2effd5cf-9dff-4a30-8456-108d0a0be2ca" (UID: "2effd5cf-9dff-4a30-8456-108d0a0be2ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:50:37.212973 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212894    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2effd5cf-9dff-4a30-8456-108d0a0be2ca" (UID: "2effd5cf-9dff-4a30-8456-108d0a0be2ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:37.212973 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.212912    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2effd5cf-9dff-4a30-8456-108d0a0be2ca" (UID: "2effd5cf-9dff-4a30-8456-108d0a0be2ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:37.213215 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.213198    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:37.213287 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.213217    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:37.213287 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.213226    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:37.213287 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.213234    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:37.213287 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.213242    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:37.214966 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.214944    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2effd5cf-9dff-4a30-8456-108d0a0be2ca" (UID: "2effd5cf-9dff-4a30-8456-108d0a0be2ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:50:37.215119 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.215084    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2effd5cf-9dff-4a30-8456-108d0a0be2ca" (UID: "2effd5cf-9dff-4a30-8456-108d0a0be2ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:37.215191 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.215105    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "2effd5cf-9dff-4a30-8456-108d0a0be2ca" (UID: "2effd5cf-9dff-4a30-8456-108d0a0be2ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:50:37.215191 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.215162    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-kube-api-access-4trgb" (OuterVolumeSpecName: "kube-api-access-4trgb") pod "2effd5cf-9dff-4a30-8456-108d0a0be2ca" (UID: "2effd5cf-9dff-4a30-8456-108d0a0be2ca"). InnerVolumeSpecName "kube-api-access-4trgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:50:37.314380 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.314332    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:37.314380 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.314375    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:37.314380 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.314385    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4trgb\" (UniqueName: \"kubernetes.io/projected/2effd5cf-9dff-4a30-8456-108d0a0be2ca-kube-api-access-4trgb\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:37.314380 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.314394    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2effd5cf-9dff-4a30-8456-108d0a0be2ca-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:37.860936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.860900    2563 generic.go:356] "Generic (PLEG): container finished" podID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerID="e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2" exitCode=0
Sep 17 17:50:37.861142 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.860967    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"
Sep 17 17:50:37.861142 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.860970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" event={"ID":"2effd5cf-9dff-4a30-8456-108d0a0be2ca","Type":"ContainerDied","Data":"e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2"}
Sep 17 17:50:37.861142 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.861109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz" event={"ID":"2effd5cf-9dff-4a30-8456-108d0a0be2ca","Type":"ContainerDied","Data":"16b407ed2aa5ac257322e3703d948d99c25fa3959229698fb30679be5a53ca07"}
Sep 17 17:50:37.861142 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.861132    2563 scope.go:117] "RemoveContainer" containerID="e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2"
Sep 17 17:50:37.870722 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.870676    2563 scope.go:117] "RemoveContainer" containerID="b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70"
Sep 17 17:50:37.879023 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.878996    2563 scope.go:117] "RemoveContainer" containerID="e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2"
Sep 17 17:50:37.879302 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:50:37.879283    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2\": container with ID starting with e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2 not found: ID does not exist" containerID="e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2"
Sep 17 17:50:37.879355 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.879312    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2"} err="failed to get container status \"e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2\": rpc error: code = NotFound desc = could not find container \"e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2\": container with ID starting with e731e0416ee02782f02a2484f963d53bc191fdfc7d42a95d7508fcb32f81e6e2 not found: ID does not exist"
Sep 17 17:50:37.879355 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.879331    2563 scope.go:117] "RemoveContainer" containerID="b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70"
Sep 17 17:50:37.879633 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:50:37.879594    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70\": container with ID starting with b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70 not found: ID does not exist" containerID="b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70"
Sep 17 17:50:37.879724 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.879639    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70"} err="failed to get container status \"b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70\": rpc error: code = NotFound desc = could not find container \"b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70\": container with ID starting with b74a39abae68bedaeed8c3f61501dc982179fe7f042b98747a767820d0789c70 not found: ID does not exist"
Sep 17 17:50:37.883111 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.883087    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"]
Sep 17 17:50:37.885862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:37.885840    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-6239ea-openshift-default-56db578d6d-lrdxz"]
Sep 17 17:50:39.146547 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:39.146515    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"]
Sep 17 17:50:39.147034 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:39.146766    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy" containerID="cri-o://0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863" gracePeriod=30
Sep 17 17:50:39.615519 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:39.615489    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" path="/var/lib/kubelet/pods/2effd5cf-9dff-4a30-8456-108d0a0be2ca/volumes"
Sep 17 17:50:44.401560 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.401535    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:50:44.483731 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.483636    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gwnc\" (UniqueName: \"kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-kube-api-access-8gwnc\") pod \"06c139d1-6180-425b-a6d6-1d69a930322d\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") "
Sep 17 17:50:44.483731 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.483694    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-istio-token\") pod \"06c139d1-6180-425b-a6d6-1d69a930322d\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") "
Sep 17 17:50:44.483932 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.483758    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-certs\") pod \"06c139d1-6180-425b-a6d6-1d69a930322d\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") "
Sep 17 17:50:44.483932 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.483799    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-envoy\") pod \"06c139d1-6180-425b-a6d6-1d69a930322d\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") "
Sep 17 17:50:44.483932 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.483824    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06c139d1-6180-425b-a6d6-1d69a930322d-istiod-ca-cert\") pod \"06c139d1-6180-425b-a6d6-1d69a930322d\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") "
Sep 17 17:50:44.483932 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.483898    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06c139d1-6180-425b-a6d6-1d69a930322d-istio-podinfo\") pod \"06c139d1-6180-425b-a6d6-1d69a930322d\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") "
Sep 17 17:50:44.483932 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.483926    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-socket\") pod \"06c139d1-6180-425b-a6d6-1d69a930322d\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") "
Sep 17 17:50:44.484193 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.483950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-credential-socket\") pod \"06c139d1-6180-425b-a6d6-1d69a930322d\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") "
Sep 17 17:50:44.484193 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.483976    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-data\") pod \"06c139d1-6180-425b-a6d6-1d69a930322d\" (UID: \"06c139d1-6180-425b-a6d6-1d69a930322d\") "
Sep 17 17:50:44.484193 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.484065    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06c139d1-6180-425b-a6d6-1d69a930322d" (UID: "06c139d1-6180-425b-a6d6-1d69a930322d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:44.484353 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.484322    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:44.484404 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.484269    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c139d1-6180-425b-a6d6-1d69a930322d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06c139d1-6180-425b-a6d6-1d69a930322d" (UID: "06c139d1-6180-425b-a6d6-1d69a930322d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:50:44.484404 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.484352    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-data" (OuterVolumeSpecName: "istio-data") pod "06c139d1-6180-425b-a6d6-1d69a930322d" (UID: "06c139d1-6180-425b-a6d6-1d69a930322d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:44.484545 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.484520    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06c139d1-6180-425b-a6d6-1d69a930322d" (UID: "06c139d1-6180-425b-a6d6-1d69a930322d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:44.484545 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.484534    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06c139d1-6180-425b-a6d6-1d69a930322d" (UID: "06c139d1-6180-425b-a6d6-1d69a930322d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:44.486001 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.485972    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-istio-token" (OuterVolumeSpecName: "istio-token") pod "06c139d1-6180-425b-a6d6-1d69a930322d" (UID: "06c139d1-6180-425b-a6d6-1d69a930322d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:50:44.486001 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.485979    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-kube-api-access-8gwnc" (OuterVolumeSpecName: "kube-api-access-8gwnc") pod "06c139d1-6180-425b-a6d6-1d69a930322d" (UID: "06c139d1-6180-425b-a6d6-1d69a930322d"). InnerVolumeSpecName "kube-api-access-8gwnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:50:44.486433 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.486401    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06c139d1-6180-425b-a6d6-1d69a930322d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06c139d1-6180-425b-a6d6-1d69a930322d" (UID: "06c139d1-6180-425b-a6d6-1d69a930322d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:50:44.486433 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.486401    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06c139d1-6180-425b-a6d6-1d69a930322d" (UID: "06c139d1-6180-425b-a6d6-1d69a930322d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:44.585503 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.585470    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gwnc\" (UniqueName: \"kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-kube-api-access-8gwnc\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:44.585503 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.585500    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06c139d1-6180-425b-a6d6-1d69a930322d-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:44.585503 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.585510    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:44.585753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.585518    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06c139d1-6180-425b-a6d6-1d69a930322d-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:44.585753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.585526    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06c139d1-6180-425b-a6d6-1d69a930322d-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:44.585753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.585534    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:44.585753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.585545    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:44.585753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.585553    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06c139d1-6180-425b-a6d6-1d69a930322d-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:50:44.903004 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.902970    2563 generic.go:356] "Generic (PLEG): container finished" podID="06c139d1-6180-425b-a6d6-1d69a930322d" containerID="0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863" exitCode=0
Sep 17 17:50:44.903181 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.903018    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"
Sep 17 17:50:44.903181 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.903038    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" event={"ID":"06c139d1-6180-425b-a6d6-1d69a930322d","Type":"ContainerDied","Data":"0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863"}
Sep 17 17:50:44.903181 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.903084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6" event={"ID":"06c139d1-6180-425b-a6d6-1d69a930322d","Type":"ContainerDied","Data":"19000122511edf1a6d084757ca360cfd0036062d4d88c680da0fde07e48142ee"}
Sep 17 17:50:44.903181 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.903106    2563 scope.go:117] "RemoveContainer" containerID="0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863"
Sep 17 17:50:44.912738 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.912694    2563 scope.go:117] "RemoveContainer" containerID="6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2"
Sep 17 17:50:44.920835 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.920816    2563 scope.go:117] "RemoveContainer" containerID="0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863"
Sep 17 17:50:44.921090 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:50:44.921072    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863\": container with ID starting with 0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863 not found: ID does not exist" containerID="0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863"
Sep 17 17:50:44.921134 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.921099    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863"} err="failed to get container status \"0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863\": rpc error: code = NotFound desc = could not find container \"0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863\": container with ID starting with 0a20b6cfd202fb1ef29e7b9e477964b55ff0c6dfe9702b484be63a54b7561863 not found: ID does not exist"
Sep 17 17:50:44.921134 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.921115    2563 scope.go:117] "RemoveContainer" containerID="6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2"
Sep 17 17:50:44.921342 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:50:44.921325    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2\": container with ID starting with 6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2 not found: ID does not exist" containerID="6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2"
Sep 17 17:50:44.921379 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.921350    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2"} err="failed to get container status \"6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2\": rpc error: code = NotFound desc = could not find container \"6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2\": container with ID starting with 6b60bec0ab6354c0ee9a682e10b51b7caa42dbda868e65b33efd272509eb76c2 not found: ID does not exist"
Sep 17 17:50:44.926403 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.926381    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"]
Sep 17 17:50:44.933135 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:44.933112    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8f6c1ea9-openshift-default-5c457c5fd4-5m7b6"]
Sep 17 17:50:45.615037 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:45.615004    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" path="/var/lib/kubelet/pods/06c139d1-6180-425b-a6d6-1d69a930322d/volumes"
Sep 17 17:50:51.344309 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.344275    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"]
Sep 17 17:50:51.344991 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.344966    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy"
Sep 17 17:50:51.345098 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.344995    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy"
Sep 17 17:50:51.345098 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.345013    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy"
Sep 17 17:50:51.345098 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.345021    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy"
Sep 17 17:50:51.345098 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.345036    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy"
Sep 17 17:50:51.345098 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.345044    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy"
Sep 17 17:50:51.345098 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.345056    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy"
Sep 17 17:50:51.345098 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.345064    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy"
Sep 17 17:50:51.345440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.345194    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy"
Sep 17 17:50:51.345440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.345209    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c139d1-6180-425b-a6d6-1d69a930322d" containerName="istio-proxy"
Sep 17 17:50:51.345440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.345219    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy"
Sep 17 17:50:51.345440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.345231    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2effd5cf-9dff-4a30-8456-108d0a0be2ca" containerName="istio-proxy"
Sep 17 17:50:51.348426 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.348403    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.351791 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.351751    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-8aeea1\"/\"kube-root-ca.crt\""
Sep 17 17:50:51.351791 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.351788    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-8aeea1\"/\"default-dockercfg-8k5x9\""
Sep 17 17:50:51.351941 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.351800    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-8aeea1\"/\"openshift-service-ca.crt\""
Sep 17 17:50:51.351941 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.351816    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-8aeea1\"/\"e2e-conflict-a-42c1d347-kserve-self-signed-certs\""
Sep 17 17:50:51.358550 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.358529    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"]
Sep 17 17:50:51.456025 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.455993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b2666a8-a01d-4524-9768-431fb7031e37-tls-certs\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.456179 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.456041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-home\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.456179 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.456111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-model-cache\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.456266 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.456187    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcnpv\" (UniqueName: \"kubernetes.io/projected/1b2666a8-a01d-4524-9768-431fb7031e37-kube-api-access-jcnpv\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.456266 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.456215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-tmp-dir\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.456266 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.456263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-dshm\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.557859 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.557820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-dshm\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.557859 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.557863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b2666a8-a01d-4524-9768-431fb7031e37-tls-certs\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.558134 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.557904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-home\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.558134 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.557976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-model-cache\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.558134 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.558044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcnpv\" (UniqueName: \"kubernetes.io/projected/1b2666a8-a01d-4524-9768-431fb7031e37-kube-api-access-jcnpv\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.558276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.558144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-tmp-dir\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.558389 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.558360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-home\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.558487 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.558405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-model-cache\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.558544 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.558514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-tmp-dir\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.560198 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.560168    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-dshm\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.560476 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.560457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b2666a8-a01d-4524-9768-431fb7031e37-tls-certs\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.566366 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.566342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcnpv\" (UniqueName: \"kubernetes.io/projected/1b2666a8-a01d-4524-9768-431fb7031e37-kube-api-access-jcnpv\") pod \"e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") " pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.659059 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.658964    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:50:51.932962 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.932935    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"]
Sep 17 17:50:51.934561 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:50:51.934529    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b2666a8_a01d_4524_9768_431fb7031e37.slice/crio-499436dcad0df7500f7419c9d1f66a399be44d8789d70a07d9541e312f1ec807 WatchSource:0}: Error finding container 499436dcad0df7500f7419c9d1f66a399be44d8789d70a07d9541e312f1ec807: Status 404 returned error can't find the container with id 499436dcad0df7500f7419c9d1f66a399be44d8789d70a07d9541e312f1ec807
Sep 17 17:50:51.939928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:51.939905    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:50:52.949149 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:52.949115    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt" event={"ID":"1b2666a8-a01d-4524-9768-431fb7031e37","Type":"ContainerStarted","Data":"499436dcad0df7500f7419c9d1f66a399be44d8789d70a07d9541e312f1ec807"}
Sep 17 17:50:53.432439 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.432405    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:50:53.647961 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.647884    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"]
Sep 17 17:50:53.651512 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.651489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.655742 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.655717    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-7e8755-openshift-default-dockercfg-jtnxg\""
Sep 17 17:50:53.668363 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.668340    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"]
Sep 17 17:50:53.783735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.782069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-socket\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.783735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.782121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9adc4faa-3182-4939-9e46-e7754461f9ac-istiod-ca-cert\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.783735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.782163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-podinfo\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.783735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.782210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-token\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.783735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.782236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-data\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.783735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.782262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk8g2\" (UniqueName: \"kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-kube-api-access-gk8g2\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.783735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.782314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-envoy\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.783735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.782385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-credential-socket\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.783735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.782491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-certs\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.883468 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.883431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-certs\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.883651 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.883511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-socket\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.883651 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.883536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9adc4faa-3182-4939-9e46-e7754461f9ac-istiod-ca-cert\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.883651 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.883571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-podinfo\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.883651 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.883618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-token\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.883651 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.883641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-data\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.883976 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.883665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk8g2\" (UniqueName: \"kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-kube-api-access-gk8g2\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.883976 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.883739    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-envoy\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.883976 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.883808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-credential-socket\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.883976 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.883892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-socket\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.883976 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.883917    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-certs\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.884245 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.884071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-data\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.884245 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.884181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-credential-socket\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.884313 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.884265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9adc4faa-3182-4939-9e46-e7754461f9ac-istiod-ca-cert\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.885990 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.885968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-envoy\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.886290 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.886262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-podinfo\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.892439 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.892415    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-token\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.892529 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.892440    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk8g2\" (UniqueName: \"kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-kube-api-access-gk8g2\") pod \"e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") " pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.955631 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.955537    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt" event={"ID":"1b2666a8-a01d-4524-9768-431fb7031e37","Type":"ContainerStarted","Data":"4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25"}
Sep 17 17:50:53.963307 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.963287    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:53.977145 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:53.977100    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt" podStartSLOduration=1.94868094 podStartE2EDuration="2.977079526s" totalImagesPullingTime="1.028398586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:50:53.973175172 +0000 UTC m=+1180.624081165" watchObservedRunningTime="2026-09-17 17:50:53.977079526 +0000 UTC m=+1180.627985520"
Sep 17 17:50:54.257942 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:54.257917    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"]
Sep 17 17:50:54.260737 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:50:54.260692    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9adc4faa_3182_4939_9e46_e7754461f9ac.slice/crio-1250674735b9949abfd07941eff192e34d3054e80d3e0b076adc3fb8b264371b WatchSource:0}: Error finding container 1250674735b9949abfd07941eff192e34d3054e80d3e0b076adc3fb8b264371b: Status 404 returned error can't find the container with id 1250674735b9949abfd07941eff192e34d3054e80d3e0b076adc3fb8b264371b
Sep 17 17:50:54.263337 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:54.263301    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:50:54.263429 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:54.263378    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:50:54.263429 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:54.263422    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:50:54.962667 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:54.962626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" event={"ID":"9adc4faa-3182-4939-9e46-e7754461f9ac","Type":"ContainerStarted","Data":"27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e"}
Sep 17 17:50:54.963152 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:54.962692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" event={"ID":"9adc4faa-3182-4939-9e46-e7754461f9ac","Type":"ContainerStarted","Data":"1250674735b9949abfd07941eff192e34d3054e80d3e0b076adc3fb8b264371b"}
Sep 17 17:50:54.963988 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:54.963965    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:54.987225 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:54.987184    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" podStartSLOduration=1.987169747 podStartE2EDuration="1.987169747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:50:54.985803649 +0000 UTC m=+1181.636709642" watchObservedRunningTime="2026-09-17 17:50:54.987169747 +0000 UTC m=+1181.638075729"
Sep 17 17:50:55.968766 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:55.968739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:56.973480 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:56.973449    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:50:56.974300 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:50:56.974271    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:51:00.775622 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.775589    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"]
Sep 17 17:51:00.780034 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.780004    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.782402 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.782379    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-7e8755-serving-cert\""
Sep 17 17:51:00.794410 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.794372    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"]
Sep 17 17:51:00.854713 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.854681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c276e87a-0710-49bd-a09d-fdb30361eb0a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.854872 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.854742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwzh8\" (UniqueName: \"kubernetes.io/projected/c276e87a-0710-49bd-a09d-fdb30361eb0a-kube-api-access-fwzh8\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.854936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.854862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.854936 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.854917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.955753 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.955714    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.955948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.955761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.955948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.955814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c276e87a-0710-49bd-a09d-fdb30361eb0a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.955948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.955847    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwzh8\" (UniqueName: \"kubernetes.io/projected/c276e87a-0710-49bd-a09d-fdb30361eb0a-kube-api-access-fwzh8\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.956575 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.956548    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c276e87a-0710-49bd-a09d-fdb30361eb0a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.958467 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.958446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.958576 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.958558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:00.964790 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:00.964772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwzh8\" (UniqueName: \"kubernetes.io/projected/c276e87a-0710-49bd-a09d-fdb30361eb0a-kube-api-access-fwzh8\") pod \"maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:01.092535 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:01.092449    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:01.373243 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:01.373211    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"]
Sep 17 17:51:01.374790 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:51:01.374762    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc276e87a_0710_49bd_a09d_fdb30361eb0a.slice/crio-07ce4bce78f07406248cba525ba220fda925c919a6b17cdcbf4c129c6b3c6f10 WatchSource:0}: Error finding container 07ce4bce78f07406248cba525ba220fda925c919a6b17cdcbf4c129c6b3c6f10: Status 404 returned error can't find the container with id 07ce4bce78f07406248cba525ba220fda925c919a6b17cdcbf4c129c6b3c6f10
Sep 17 17:51:01.659873 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:01.659773    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:51:01.659873 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:01.659824    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:51:01.672634 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:01.672605    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:51:02.003468 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:02.003438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh" event={"ID":"c276e87a-0710-49bd-a09d-fdb30361eb0a","Type":"ContainerStarted","Data":"07ce4bce78f07406248cba525ba220fda925c919a6b17cdcbf4c129c6b3c6f10"}
Sep 17 17:51:02.014935 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:02.014909    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:51:03.010350 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:03.010312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh" event={"ID":"c276e87a-0710-49bd-a09d-fdb30361eb0a","Type":"ContainerStarted","Data":"7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658"}
Sep 17 17:51:03.010833 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:03.010534    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:03.041342 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:03.041289    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh" podStartSLOduration=2.464471049 podStartE2EDuration="3.041271608s" totalImagesPullingTime="576.800559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:51:03.039133103 +0000 UTC m=+1189.690039118" watchObservedRunningTime="2026-09-17 17:51:03.041271608 +0000 UTC m=+1189.692177599"
Sep 17 17:51:09.021124 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:09.021098    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:51:15.730138 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:15.730110    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:51:15.734657 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:15.734633    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:51:15.736992 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:15.736967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:51:15.741147 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:15.741132    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:51:20.115607 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:20.115534    2563 generic.go:356] "Generic (PLEG): container finished" podID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerID="27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e" exitCode=0
Sep 17 17:51:20.115998 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:20.115604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" event={"ID":"9adc4faa-3182-4939-9e46-e7754461f9ac","Type":"ContainerDied","Data":"27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e"}
Sep 17 17:51:20.116069 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:20.116052    2563 scope.go:117] "RemoveContainer" containerID="27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e"
Sep 17 17:51:20.117188 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:20.117154    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:51:20.117272 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:20.117226    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:51:20.117272 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:20.117255    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:51:21.122866 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:21.122828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" event={"ID":"9adc4faa-3182-4939-9e46-e7754461f9ac","Type":"ContainerStarted","Data":"8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e"}
Sep 17 17:51:21.964299 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:21.964268    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:51:21.964492 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:21.964464    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 17 17:51:21.964535 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:21.964517    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 17 17:51:22.964694 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:22.964649    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 17 17:51:22.965099 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:22.964758    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 17 17:51:23.963959 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:23.963918    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 17 17:51:23.964139 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:23.963984    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 17 17:51:24.839269 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:24.839236    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:51:24.964559 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:24.964521    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 17 17:51:24.964734 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:24.964589    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 17 17:51:25.963696 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:25.963664    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 17 17:51:25.964100 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:25.963749    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 17 17:51:26.967719 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:26.967677    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:51:26.968092 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:26.967963    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:51:26.968673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:26.968655    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:51:27.627585 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.627553    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"]
Sep 17 17:51:27.633671 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.633651    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.636840 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.636822    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-ef41f8-openshift-default-dockercfg-fv4vx\""
Sep 17 17:51:27.657262 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.657238    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"]
Sep 17 17:51:27.749340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.749300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-certs\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.749644 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.749624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-data\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.749862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.749845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-podinfo\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.749993 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.749974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-credential-socket\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.750147 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.750120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istiod-ca-cert\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.750293 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.750269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-envoy\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.750420 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.750407    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-socket\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.750625 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.750608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-token\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.750800 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.750781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pjsz\" (UniqueName: \"kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-kube-api-access-4pjsz\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.851976 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.851934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-envoy\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.851976 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.851976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-socket\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.852249 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.852066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-token\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.852249 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.852109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pjsz\" (UniqueName: \"kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-kube-api-access-4pjsz\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.852249 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.852159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-certs\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.852249 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.852185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-data\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.852249 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.852246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-podinfo\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.852522 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.852279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-credential-socket\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.852522 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.852301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istiod-ca-cert\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.852522 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.852479    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-socket\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.852690 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.852548    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-certs\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.852792 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.852741    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-credential-socket\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.852846 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.852805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-data\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.853035 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.853015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istiod-ca-cert\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.854608 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.854585    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-envoy\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.854732 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.854665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-podinfo\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.861903 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.861879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-token\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.864268 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.864248    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pjsz\" (UniqueName: \"kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-kube-api-access-4pjsz\") pod \"e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") " pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:27.945023 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:27.944934    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:28.223579 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:28.223543    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"]
Sep 17 17:51:28.226083 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:51:28.226049    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d56efb7_0dbb_4cb1_a50c_b497e2e4fa82.slice/crio-042a747a299e87dc16132181611b48566baba36e332170be1477beb0ca493f22 WatchSource:0}: Error finding container 042a747a299e87dc16132181611b48566baba36e332170be1477beb0ca493f22: Status 404 returned error can't find the container with id 042a747a299e87dc16132181611b48566baba36e332170be1477beb0ca493f22
Sep 17 17:51:28.233178 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:28.233128    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:51:28.233290 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:28.233269    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:51:28.233371 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:28.233349    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:51:29.167801 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:29.167752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" event={"ID":"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82","Type":"ContainerStarted","Data":"5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec"}
Sep 17 17:51:29.167956 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:29.167844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" event={"ID":"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82","Type":"ContainerStarted","Data":"042a747a299e87dc16132181611b48566baba36e332170be1477beb0ca493f22"}
Sep 17 17:51:29.203044 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:29.202996    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" podStartSLOduration=2.202980037 podStartE2EDuration="2.202980037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:51:29.201966387 +0000 UTC m=+1215.852872379" watchObservedRunningTime="2026-09-17 17:51:29.202980037 +0000 UTC m=+1215.853886029"
Sep 17 17:51:29.945458 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:29.945421    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:29.950756 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:29.950732    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:30.173220 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:30.173193    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:30.174203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:30.174184    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:51:38.149287 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.149255    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"]
Sep 17 17:51:38.153023 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.152999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.155418 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.155393    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-ef41f8-serving-cert\""
Sep 17 17:51:38.171107 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.171075    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"]
Sep 17 17:51:38.265524 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.265493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.265720 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.265594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7vpj\" (UniqueName: \"kubernetes.io/projected/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-kube-api-access-f7vpj\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.265720 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.265644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.265720 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.265673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.366868 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.366830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.367067 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.366902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7vpj\" (UniqueName: \"kubernetes.io/projected/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-kube-api-access-f7vpj\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.367067 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.366941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.367067 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.366980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.367895 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.367867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.369651 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.369627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.369774 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.369631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.375264 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.375239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7vpj\" (UniqueName: \"kubernetes.io/projected/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-kube-api-access-f7vpj\") pod \"maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.466731 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.466625    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:38.768274 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:38.768241    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"]
Sep 17 17:51:38.769378 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:51:38.769352    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e39543_66f2_4fc1_96b4_93bbbb15f92a.slice/crio-6b4e4c5f0ad4fd69d352a24e0b6b89fb4f4547589ab66556924c1f7db6e3dc6b WatchSource:0}: Error finding container 6b4e4c5f0ad4fd69d352a24e0b6b89fb4f4547589ab66556924c1f7db6e3dc6b: Status 404 returned error can't find the container with id 6b4e4c5f0ad4fd69d352a24e0b6b89fb4f4547589ab66556924c1f7db6e3dc6b
Sep 17 17:51:39.225502 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:39.225461    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b" event={"ID":"c9e39543-66f2-4fc1-96b4-93bbbb15f92a","Type":"ContainerStarted","Data":"6b4e4c5f0ad4fd69d352a24e0b6b89fb4f4547589ab66556924c1f7db6e3dc6b"}
Sep 17 17:51:40.233460 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:40.233422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b" event={"ID":"c9e39543-66f2-4fc1-96b4-93bbbb15f92a","Type":"ContainerStarted","Data":"52cebc4d2f3bae12f8e2ccc443e6d9a217f2f467f44ed2a9ccefd6cf9f78c0d7"}
Sep 17 17:51:40.233968 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:40.233492    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:40.259069 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:40.258996    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b" podStartSLOduration=1.626440763 podStartE2EDuration="2.258970624s" totalImagesPullingTime="632.529861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:51:40.254604059 +0000 UTC m=+1226.905510052" watchObservedRunningTime="2026-09-17 17:51:40.258970624 +0000 UTC m=+1226.909876618"
Sep 17 17:51:46.248606 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:46.248572    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:51:54.142748 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:51:54.142685    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:52:05.386304 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:05.386275    2563 generic.go:356] "Generic (PLEG): container finished" podID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerID="5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec" exitCode=0
Sep 17 17:52:05.386787 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:05.386352    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" event={"ID":"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82","Type":"ContainerDied","Data":"5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec"}
Sep 17 17:52:05.386911 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:05.386894    2563 scope.go:117] "RemoveContainer" containerID="5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec"
Sep 17 17:52:05.388149 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:05.388123    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:05.388226 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:05.388184    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:05.388226 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:05.388215    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:06.397963 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:06.397916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" event={"ID":"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82","Type":"ContainerStarted","Data":"2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635"}
Sep 17 17:52:06.945996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:06.945956    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:52:06.946223 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:06.946205    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 17 17:52:06.946284 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:06.946250    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 17 17:52:07.946084 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:07.946043    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 17 17:52:07.946493 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:07.946110    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 17 17:52:08.945276 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:08.945246    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 17 17:52:08.945439 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:08.945299    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 17 17:52:09.945455 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:09.945422    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 17 17:52:09.945862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:09.945478    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 17 17:52:10.946121 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:10.946084    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 17 17:52:10.946544 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:10.946146    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 17 17:52:11.949380 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:11.949350    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:52:11.949799 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:11.949649    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:52:11.950323 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:11.950304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:52:13.619826 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.619785    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"]
Sep 17 17:52:13.622471 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.622454    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.626884 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.626861    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f9224635-openshift-default-dockercfg-vr6gb\""
Sep 17 17:52:13.648896 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.648875    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"]
Sep 17 17:52:13.672984 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.672952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-podinfo\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.672984 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.672980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-token\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.673171 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.673026    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1add5096-5e7a-4152-aa23-4c9102a7ec87-istiod-ca-cert\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.673260 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.673236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-certs\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.673323 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.673276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-envoy\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.673379 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.673323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tgv2\" (UniqueName: \"kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-kube-api-access-9tgv2\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.673436 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.673383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-credential-socket\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.673436 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.673428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-socket\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.673547 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.673484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-data\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.774735 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.774671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-podinfo\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.774912 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.774750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-token\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.774912 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.774807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1add5096-5e7a-4152-aa23-4c9102a7ec87-istiod-ca-cert\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.774912 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.774869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-certs\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.774912 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.774891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-envoy\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.775145 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.774921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tgv2\" (UniqueName: \"kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-kube-api-access-9tgv2\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.775145 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.774969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-credential-socket\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.775145 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.775021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-socket\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.775145 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.775064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-data\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.775557 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.775497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-credential-socket\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.775557 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.775522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-socket\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.775801 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.775574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-data\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.775977 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.775951    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-certs\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.776049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.775972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1add5096-5e7a-4152-aa23-4c9102a7ec87-istiod-ca-cert\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.777428 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.777410    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-podinfo\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.777686 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.777667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-envoy\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.793347 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.793311    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tgv2\" (UniqueName: \"kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-kube-api-access-9tgv2\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.794050 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.794031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-token\") pod \"e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") " pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:13.936203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:13.936116    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:14.228637 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:14.228613    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"]
Sep 17 17:52:14.230612 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:52:14.230582    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1add5096_5e7a_4152_aa23_4c9102a7ec87.slice/crio-39cbc35e39341f4d0becc3c193f16599b4aa694f81da40050cf086a152299bee WatchSource:0}: Error finding container 39cbc35e39341f4d0becc3c193f16599b4aa694f81da40050cf086a152299bee: Status 404 returned error can't find the container with id 39cbc35e39341f4d0becc3c193f16599b4aa694f81da40050cf086a152299bee
Sep 17 17:52:14.232924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:14.232892    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:14.233251 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:14.232976    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:14.233251 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:14.233007    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:14.449957 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:14.449912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" event={"ID":"1add5096-5e7a-4152-aa23-4c9102a7ec87","Type":"ContainerStarted","Data":"919a09c1a2a8ef0ef8bb11ad5eb960d7ce465760b927df27e1041bb3820145fa"}
Sep 17 17:52:14.450135 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:14.449981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" event={"ID":"1add5096-5e7a-4152-aa23-4c9102a7ec87","Type":"ContainerStarted","Data":"39cbc35e39341f4d0becc3c193f16599b4aa694f81da40050cf086a152299bee"}
Sep 17 17:52:14.477408 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:14.477364    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" podStartSLOduration=1.477349155 podStartE2EDuration="1.477349155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:52:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:52:14.474095278 +0000 UTC m=+1261.125001270" watchObservedRunningTime="2026-09-17 17:52:14.477349155 +0000 UTC m=+1261.128255148"
Sep 17 17:52:14.936693 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:14.936659    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:15.942054 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:15.942022    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:16.408996 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:16.408960    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"]
Sep 17 17:52:16.409227 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:16.409188    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy" containerID="cri-o://2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad" gracePeriod=30
Sep 17 17:52:16.412720 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:16.412678    2563 patch_prober.go:28] interesting pod/e2e-inf-a-54966d-openshift-default-8976c7674-z868k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 17:52:16.412904 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:16.412806    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:52:16.461323 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:16.461295    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:16.462151 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:16.462132    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:17.375977 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:17.375946    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:52:21.669055 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.669027    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:52:21.753332 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753257    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-data\") pod \"56a54b60-3261-4eb0-8a08-dda408fe7112\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") "
Sep 17 17:52:21.753332 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753324    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-socket\") pod \"56a54b60-3261-4eb0-8a08-dda408fe7112\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") "
Sep 17 17:52:21.753518 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753368    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a54b60-3261-4eb0-8a08-dda408fe7112-istiod-ca-cert\") pod \"56a54b60-3261-4eb0-8a08-dda408fe7112\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") "
Sep 17 17:52:21.753518 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753439    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-podinfo\") pod \"56a54b60-3261-4eb0-8a08-dda408fe7112\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") "
Sep 17 17:52:21.753518 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753507    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-token\") pod \"56a54b60-3261-4eb0-8a08-dda408fe7112\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") "
Sep 17 17:52:21.753660 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753544    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-data" (OuterVolumeSpecName: "istio-data") pod "56a54b60-3261-4eb0-8a08-dda408fe7112" (UID: "56a54b60-3261-4eb0-8a08-dda408fe7112"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:21.753660 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753558    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-envoy\") pod \"56a54b60-3261-4eb0-8a08-dda408fe7112\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") "
Sep 17 17:52:21.753660 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753639    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56a54b60-3261-4eb0-8a08-dda408fe7112" (UID: "56a54b60-3261-4eb0-8a08-dda408fe7112"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:21.753839 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9gpg\" (UniqueName: \"kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-kube-api-access-q9gpg\") pod \"56a54b60-3261-4eb0-8a08-dda408fe7112\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") "
Sep 17 17:52:21.753839 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753693    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-certs\") pod \"56a54b60-3261-4eb0-8a08-dda408fe7112\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") "
Sep 17 17:52:21.753839 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753745    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-credential-socket\") pod \"56a54b60-3261-4eb0-8a08-dda408fe7112\" (UID: \"56a54b60-3261-4eb0-8a08-dda408fe7112\") "
Sep 17 17:52:21.753839 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753788    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56a54b60-3261-4eb0-8a08-dda408fe7112-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56a54b60-3261-4eb0-8a08-dda408fe7112" (UID: "56a54b60-3261-4eb0-8a08-dda408fe7112"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:52:21.754041 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.753982    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56a54b60-3261-4eb0-8a08-dda408fe7112" (UID: "56a54b60-3261-4eb0-8a08-dda408fe7112"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:21.754191 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.754166    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56a54b60-3261-4eb0-8a08-dda408fe7112" (UID: "56a54b60-3261-4eb0-8a08-dda408fe7112"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:21.754349 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.754332    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a54b60-3261-4eb0-8a08-dda408fe7112-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:21.754394 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.754356    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:21.754394 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.754370    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:21.754394 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.754385    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:21.754487 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.754398    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:21.755777 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.755745    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-kube-api-access-q9gpg" (OuterVolumeSpecName: "kube-api-access-q9gpg") pod "56a54b60-3261-4eb0-8a08-dda408fe7112" (UID: "56a54b60-3261-4eb0-8a08-dda408fe7112"). InnerVolumeSpecName "kube-api-access-q9gpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:21.755884 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.755837    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56a54b60-3261-4eb0-8a08-dda408fe7112" (UID: "56a54b60-3261-4eb0-8a08-dda408fe7112"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:52:21.756033 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.756015    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-token" (OuterVolumeSpecName: "istio-token") pod "56a54b60-3261-4eb0-8a08-dda408fe7112" (UID: "56a54b60-3261-4eb0-8a08-dda408fe7112"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:21.756033 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.756020    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56a54b60-3261-4eb0-8a08-dda408fe7112" (UID: "56a54b60-3261-4eb0-8a08-dda408fe7112"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:21.855818 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.855784    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:21.855818 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.855811    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:21.855818 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.855824    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a54b60-3261-4eb0-8a08-dda408fe7112-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:21.856051 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:21.855836    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9gpg\" (UniqueName: \"kubernetes.io/projected/56a54b60-3261-4eb0-8a08-dda408fe7112-kube-api-access-q9gpg\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:22.499859 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.499828    2563 generic.go:356] "Generic (PLEG): container finished" podID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerID="2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad" exitCode=0
Sep 17 17:52:22.500059 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.499879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" event={"ID":"56a54b60-3261-4eb0-8a08-dda408fe7112","Type":"ContainerDied","Data":"2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad"}
Sep 17 17:52:22.500059 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.499896    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"
Sep 17 17:52:22.500059 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.499929    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k" event={"ID":"56a54b60-3261-4eb0-8a08-dda408fe7112","Type":"ContainerDied","Data":"4f223cd9a89fa1d6ae99d5826684c09689310a45701b9153836fd2c462fc39c7"}
Sep 17 17:52:22.500059 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.499963    2563 scope.go:117] "RemoveContainer" containerID="2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad"
Sep 17 17:52:22.510278 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.510242    2563 scope.go:117] "RemoveContainer" containerID="b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077"
Sep 17 17:52:22.519499 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.519481    2563 scope.go:117] "RemoveContainer" containerID="2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad"
Sep 17 17:52:22.519769 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:52:22.519746    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad\": container with ID starting with 2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad not found: ID does not exist" containerID="2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad"
Sep 17 17:52:22.519828 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.519779    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad"} err="failed to get container status \"2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad\": rpc error: code = NotFound desc = could not find container \"2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad\": container with ID starting with 2ac1320f1d5a4f6cd361b380541452b4c06a602627de88b25be4dfa5bd8ac1ad not found: ID does not exist"
Sep 17 17:52:22.519828 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.519798    2563 scope.go:117] "RemoveContainer" containerID="b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077"
Sep 17 17:52:22.520073 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:52:22.520057    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077\": container with ID starting with b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077 not found: ID does not exist" containerID="b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077"
Sep 17 17:52:22.520127 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.520076    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077"} err="failed to get container status \"b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077\": rpc error: code = NotFound desc = could not find container \"b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077\": container with ID starting with b00f40ae0f41d9aa83e3849e3d972b37972e4f315f2be76f9a4068576d105077 not found: ID does not exist"
Sep 17 17:52:22.534649 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.534625    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"]
Sep 17 17:52:22.544583 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.544560    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-54966d-openshift-default-8976c7674-z868k"]
Sep 17 17:52:22.757176 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.757082    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"]
Sep 17 17:52:22.757622 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:22.757309    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf" podUID="669677ae-73ec-466b-81ca-d8b7f7f78afb" containerName="istio-proxy" containerID="cri-o://372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083" gracePeriod=30
Sep 17 17:52:23.614733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:23.614667    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" path="/var/lib/kubelet/pods/56a54b60-3261-4eb0-8a08-dda408fe7112/volumes"
Sep 17 17:52:28.019219 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.019188    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:52:28.124821 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.124695    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-certs\") pod \"669677ae-73ec-466b-81ca-d8b7f7f78afb\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") "
Sep 17 17:52:28.124821 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.124780    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-socket\") pod \"669677ae-73ec-466b-81ca-d8b7f7f78afb\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") "
Sep 17 17:52:28.125074 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.124855    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-podinfo\") pod \"669677ae-73ec-466b-81ca-d8b7f7f78afb\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") "
Sep 17 17:52:28.125074 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.124939    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6wqd\" (UniqueName: \"kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-kube-api-access-f6wqd\") pod \"669677ae-73ec-466b-81ca-d8b7f7f78afb\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") "
Sep 17 17:52:28.125074 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.124990    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-envoy\") pod \"669677ae-73ec-466b-81ca-d8b7f7f78afb\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") "
Sep 17 17:52:28.125074 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.125014    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-data\") pod \"669677ae-73ec-466b-81ca-d8b7f7f78afb\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") "
Sep 17 17:52:28.125074 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.125032    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669677ae-73ec-466b-81ca-d8b7f7f78afb-istiod-ca-cert\") pod \"669677ae-73ec-466b-81ca-d8b7f7f78afb\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") "
Sep 17 17:52:28.125074 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.125065    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-token\") pod \"669677ae-73ec-466b-81ca-d8b7f7f78afb\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") "
Sep 17 17:52:28.125395 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.125095    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-credential-socket\") pod \"669677ae-73ec-466b-81ca-d8b7f7f78afb\" (UID: \"669677ae-73ec-466b-81ca-d8b7f7f78afb\") "
Sep 17 17:52:28.125731 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.125033    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "669677ae-73ec-466b-81ca-d8b7f7f78afb" (UID: "669677ae-73ec-466b-81ca-d8b7f7f78afb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:28.125731 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.125110    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "669677ae-73ec-466b-81ca-d8b7f7f78afb" (UID: "669677ae-73ec-466b-81ca-d8b7f7f78afb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:28.125908 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.125345    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-data" (OuterVolumeSpecName: "istio-data") pod "669677ae-73ec-466b-81ca-d8b7f7f78afb" (UID: "669677ae-73ec-466b-81ca-d8b7f7f78afb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:28.125908 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.125554    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/669677ae-73ec-466b-81ca-d8b7f7f78afb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "669677ae-73ec-466b-81ca-d8b7f7f78afb" (UID: "669677ae-73ec-466b-81ca-d8b7f7f78afb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:52:28.125908 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.125739    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "669677ae-73ec-466b-81ca-d8b7f7f78afb" (UID: "669677ae-73ec-466b-81ca-d8b7f7f78afb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:28.127353 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.127325    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "669677ae-73ec-466b-81ca-d8b7f7f78afb" (UID: "669677ae-73ec-466b-81ca-d8b7f7f78afb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:52:28.127470 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.127363    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-kube-api-access-f6wqd" (OuterVolumeSpecName: "kube-api-access-f6wqd") pod "669677ae-73ec-466b-81ca-d8b7f7f78afb" (UID: "669677ae-73ec-466b-81ca-d8b7f7f78afb"). InnerVolumeSpecName "kube-api-access-f6wqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:28.127470 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.127420    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "669677ae-73ec-466b-81ca-d8b7f7f78afb" (UID: "669677ae-73ec-466b-81ca-d8b7f7f78afb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:28.127470 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.127429    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-token" (OuterVolumeSpecName: "istio-token") pod "669677ae-73ec-466b-81ca-d8b7f7f78afb" (UID: "669677ae-73ec-466b-81ca-d8b7f7f78afb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:28.226432 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.226400    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:28.226432 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.226433    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:28.226628 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.226446    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669677ae-73ec-466b-81ca-d8b7f7f78afb-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:28.226628 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.226459    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:28.226628 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.226473    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:28.226628 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.226487    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:28.226628 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.226500    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669677ae-73ec-466b-81ca-d8b7f7f78afb-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:28.226628 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.226512    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669677ae-73ec-466b-81ca-d8b7f7f78afb-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:28.226628 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.226528    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6wqd\" (UniqueName: \"kubernetes.io/projected/669677ae-73ec-466b-81ca-d8b7f7f78afb-kube-api-access-f6wqd\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:28.535393 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.535359    2563 generic.go:356] "Generic (PLEG): container finished" podID="669677ae-73ec-466b-81ca-d8b7f7f78afb" containerID="372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083" exitCode=0
Sep 17 17:52:28.535539 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.535400    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"
Sep 17 17:52:28.535539 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.535448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf" event={"ID":"669677ae-73ec-466b-81ca-d8b7f7f78afb","Type":"ContainerDied","Data":"372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083"}
Sep 17 17:52:28.535539 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.535501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf" event={"ID":"669677ae-73ec-466b-81ca-d8b7f7f78afb","Type":"ContainerDied","Data":"f908c43a749bf0531b1a2225d011fe75de8d58adba9d9ce998231b562e390333"}
Sep 17 17:52:28.535539 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.535523    2563 scope.go:117] "RemoveContainer" containerID="372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083"
Sep 17 17:52:28.545165 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.545150    2563 scope.go:117] "RemoveContainer" containerID="372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083"
Sep 17 17:52:28.545413 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:52:28.545392    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083\": container with ID starting with 372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083 not found: ID does not exist" containerID="372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083"
Sep 17 17:52:28.545476 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.545425    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083"} err="failed to get container status \"372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083\": rpc error: code = NotFound desc = could not find container \"372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083\": container with ID starting with 372e1054b8cc2cf74a6098f58f3ea85d690f9470c0d45b4ce8197985427a5083 not found: ID does not exist"
Sep 17 17:52:28.586995 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.586963    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"]
Sep 17 17:52:28.603135 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:28.603112    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-850d96-openshift-default-7949676d9b-wbhcf"]
Sep 17 17:52:29.614747 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:29.614693    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="669677ae-73ec-466b-81ca-d8b7f7f78afb" path="/var/lib/kubelet/pods/669677ae-73ec-466b-81ca-d8b7f7f78afb/volumes"
Sep 17 17:52:35.799173 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:35.791926    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"]
Sep 17 17:52:35.799173 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:35.792161    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy" containerID="cri-o://13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b" gracePeriod=30
Sep 17 17:52:36.706984 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.706950    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"]
Sep 17 17:52:36.707910 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.707884    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy"
Sep 17 17:52:36.708071 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.708058    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy"
Sep 17 17:52:36.708208 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.708195    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy"
Sep 17 17:52:36.708323 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.708312    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy"
Sep 17 17:52:36.708447 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.708436    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669677ae-73ec-466b-81ca-d8b7f7f78afb" containerName="istio-proxy"
Sep 17 17:52:36.708550 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.708539    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="669677ae-73ec-466b-81ca-d8b7f7f78afb" containerName="istio-proxy"
Sep 17 17:52:36.708822 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.708809    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy"
Sep 17 17:52:36.708955 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.708944    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="669677ae-73ec-466b-81ca-d8b7f7f78afb" containerName="istio-proxy"
Sep 17 17:52:36.709059 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.709049    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a54b60-3261-4eb0-8a08-dda408fe7112" containerName="istio-proxy"
Sep 17 17:52:36.713129 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.713109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.715777 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.715757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-abb363-openshift-default-dockercfg-pq69j\""
Sep 17 17:52:36.730012 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.729990    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"]
Sep 17 17:52:36.840889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.838457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/396d08c5-df17-4dc1-8ba5-e7440e14158a-istiod-ca-cert\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.840889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.838535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj99x\" (UniqueName: \"kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-kube-api-access-mj99x\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.840889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.838585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-podinfo\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.840889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.838638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-certs\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.840889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.838659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-token\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.840889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.838742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-credential-socket\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.840889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.838812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-envoy\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.840889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.838860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-socket\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.840889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.838889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-data\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.939608 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.939569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/396d08c5-df17-4dc1-8ba5-e7440e14158a-istiod-ca-cert\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.939832 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.939651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj99x\" (UniqueName: \"kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-kube-api-access-mj99x\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.939832 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.939696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-podinfo\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.939832 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.939775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-certs\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.939832 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.939799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-token\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.940071 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.939860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-credential-socket\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.940071 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.939927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-envoy\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.940071 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.939981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-socket\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.940071 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.940015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-data\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.940281 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.940108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-certs\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.940428 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.940396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-data\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.940514 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.940405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/396d08c5-df17-4dc1-8ba5-e7440e14158a-istiod-ca-cert\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.940514 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.940411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-socket\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.940628 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.940605    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-credential-socket\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.942132 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.942113    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-envoy\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.942568 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.942550    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-podinfo\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.958645 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.958589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-token\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:36.960715 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:36.960668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj99x\" (UniqueName: \"kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-kube-api-access-mj99x\") pod \"e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") " pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:37.024805 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:37.024770    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:37.332685 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:37.332653    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"]
Sep 17 17:52:37.337355 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:52:37.337324    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396d08c5_df17_4dc1_8ba5_e7440e14158a.slice/crio-2675a4ebb7911e53ebe16762d79b34726fb464df89d6e9cab35b346b42d6ea69 WatchSource:0}: Error finding container 2675a4ebb7911e53ebe16762d79b34726fb464df89d6e9cab35b346b42d6ea69: Status 404 returned error can't find the container with id 2675a4ebb7911e53ebe16762d79b34726fb464df89d6e9cab35b346b42d6ea69
Sep 17 17:52:37.339883 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:37.339852    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:37.339972 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:37.339918    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:37.339972 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:37.339947    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:37.598223 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:37.598120    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" event={"ID":"396d08c5-df17-4dc1-8ba5-e7440e14158a","Type":"ContainerStarted","Data":"bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8"}
Sep 17 17:52:37.598412 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:37.598228    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" event={"ID":"396d08c5-df17-4dc1-8ba5-e7440e14158a","Type":"ContainerStarted","Data":"2675a4ebb7911e53ebe16762d79b34726fb464df89d6e9cab35b346b42d6ea69"}
Sep 17 17:52:37.633611 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:37.633561    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" podStartSLOduration=1.6335448320000001 podStartE2EDuration="1.633544832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:52:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:52:37.631097431 +0000 UTC m=+1284.282003422" watchObservedRunningTime="2026-09-17 17:52:37.633544832 +0000 UTC m=+1284.284450893"
Sep 17 17:52:38.025782 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:38.025739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:38.031118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:38.031092    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:38.608619 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:38.608580    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:38.609541 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:38.609515    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:52:41.058437 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.058414    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:52:41.092216 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092152    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-data\") pod \"003e4d27-fb69-4dab-9b23-8728552cbded\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") "
Sep 17 17:52:41.092341 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-certs\") pod \"003e4d27-fb69-4dab-9b23-8728552cbded\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") "
Sep 17 17:52:41.092341 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092319    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/003e4d27-fb69-4dab-9b23-8728552cbded-istio-podinfo\") pod \"003e4d27-fb69-4dab-9b23-8728552cbded\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") "
Sep 17 17:52:41.092462 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092360    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-envoy\") pod \"003e4d27-fb69-4dab-9b23-8728552cbded\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") "
Sep 17 17:52:41.092462 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092373    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-data" (OuterVolumeSpecName: "istio-data") pod "003e4d27-fb69-4dab-9b23-8728552cbded" (UID: "003e4d27-fb69-4dab-9b23-8728552cbded"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:41.092462 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092412    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-socket\") pod \"003e4d27-fb69-4dab-9b23-8728552cbded\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") "
Sep 17 17:52:41.092462 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092449    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-istio-token\") pod \"003e4d27-fb69-4dab-9b23-8728552cbded\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") "
Sep 17 17:52:41.092669 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092483    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-credential-socket\") pod \"003e4d27-fb69-4dab-9b23-8728552cbded\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") "
Sep 17 17:52:41.092669 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092487    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "003e4d27-fb69-4dab-9b23-8728552cbded" (UID: "003e4d27-fb69-4dab-9b23-8728552cbded"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:41.092669 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092524    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xplfx\" (UniqueName: \"kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-kube-api-access-xplfx\") pod \"003e4d27-fb69-4dab-9b23-8728552cbded\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") "
Sep 17 17:52:41.092669 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092550    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/003e4d27-fb69-4dab-9b23-8728552cbded-istiod-ca-cert\") pod \"003e4d27-fb69-4dab-9b23-8728552cbded\" (UID: \"003e4d27-fb69-4dab-9b23-8728552cbded\") "
Sep 17 17:52:41.092898 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092682    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "003e4d27-fb69-4dab-9b23-8728552cbded" (UID: "003e4d27-fb69-4dab-9b23-8728552cbded"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:41.092898 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.092819    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "003e4d27-fb69-4dab-9b23-8728552cbded" (UID: "003e4d27-fb69-4dab-9b23-8728552cbded"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:41.093131 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.093083    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:41.093131 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.093093    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/003e4d27-fb69-4dab-9b23-8728552cbded-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "003e4d27-fb69-4dab-9b23-8728552cbded" (UID: "003e4d27-fb69-4dab-9b23-8728552cbded"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:52:41.093131 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.093104    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:41.093131 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.093120    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:41.093568 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.093136    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:41.095122 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.095088    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/003e4d27-fb69-4dab-9b23-8728552cbded-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "003e4d27-fb69-4dab-9b23-8728552cbded" (UID: "003e4d27-fb69-4dab-9b23-8728552cbded"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:52:41.095232 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.095171    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "003e4d27-fb69-4dab-9b23-8728552cbded" (UID: "003e4d27-fb69-4dab-9b23-8728552cbded"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:41.095303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.095285    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-istio-token" (OuterVolumeSpecName: "istio-token") pod "003e4d27-fb69-4dab-9b23-8728552cbded" (UID: "003e4d27-fb69-4dab-9b23-8728552cbded"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:41.095377 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.095356    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-kube-api-access-xplfx" (OuterVolumeSpecName: "kube-api-access-xplfx") pod "003e4d27-fb69-4dab-9b23-8728552cbded" (UID: "003e4d27-fb69-4dab-9b23-8728552cbded"). InnerVolumeSpecName "kube-api-access-xplfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:41.194189 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.194157    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/003e4d27-fb69-4dab-9b23-8728552cbded-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:41.194189 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.194184    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/003e4d27-fb69-4dab-9b23-8728552cbded-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:41.194377 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.194198    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:41.194377 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.194210    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xplfx\" (UniqueName: \"kubernetes.io/projected/003e4d27-fb69-4dab-9b23-8728552cbded-kube-api-access-xplfx\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:41.194377 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.194222    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/003e4d27-fb69-4dab-9b23-8728552cbded-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:52:41.628244 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.628212    2563 generic.go:356] "Generic (PLEG): container finished" podID="003e4d27-fb69-4dab-9b23-8728552cbded" containerID="13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b" exitCode=0
Sep 17 17:52:41.628364 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.628275    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"
Sep 17 17:52:41.628364 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.628295    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" event={"ID":"003e4d27-fb69-4dab-9b23-8728552cbded","Type":"ContainerDied","Data":"13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b"}
Sep 17 17:52:41.628364 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.628343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt" event={"ID":"003e4d27-fb69-4dab-9b23-8728552cbded","Type":"ContainerDied","Data":"c5283c99eb8d9ba5f464a78c1e7c1aa3ac14feb8ca68e744f9a974c65d80d375"}
Sep 17 17:52:41.628495 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.628366    2563 scope.go:117] "RemoveContainer" containerID="13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b"
Sep 17 17:52:41.640663 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.640647    2563 scope.go:117] "RemoveContainer" containerID="4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530"
Sep 17 17:52:41.649201 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.649176    2563 scope.go:117] "RemoveContainer" containerID="13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b"
Sep 17 17:52:41.649514 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:52:41.649485    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b\": container with ID starting with 13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b not found: ID does not exist" containerID="13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b"
Sep 17 17:52:41.649598 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.649530    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b"} err="failed to get container status \"13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b\": rpc error: code = NotFound desc = could not find container \"13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b\": container with ID starting with 13fd2388aa0229e09d0d547f2672f788673353c640e7d6459e96c44720404a4b not found: ID does not exist"
Sep 17 17:52:41.649598 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.649556    2563 scope.go:117] "RemoveContainer" containerID="4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530"
Sep 17 17:52:41.649979 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:52:41.649954    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530\": container with ID starting with 4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530 not found: ID does not exist" containerID="4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530"
Sep 17 17:52:41.650064 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.649989    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530"} err="failed to get container status \"4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530\": rpc error: code = NotFound desc = could not find container \"4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530\": container with ID starting with 4c616fb9882c8493d61f5134c2d1a2112195d0d974090f56674eaff710dc3530 not found: ID does not exist"
Sep 17 17:52:41.675957 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.675927    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"]
Sep 17 17:52:41.689677 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:41.689647    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-dfb277-openshift-default-55896774d-lzdzt"]
Sep 17 17:52:43.615718 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:43.615664    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" path="/var/lib/kubelet/pods/003e4d27-fb69-4dab-9b23-8728552cbded/volumes"
Sep 17 17:52:44.647356 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:44.647317    2563 generic.go:356] "Generic (PLEG): container finished" podID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerID="919a09c1a2a8ef0ef8bb11ad5eb960d7ce465760b927df27e1041bb3820145fa" exitCode=0
Sep 17 17:52:44.647850 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:44.647390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" event={"ID":"1add5096-5e7a-4152-aa23-4c9102a7ec87","Type":"ContainerDied","Data":"919a09c1a2a8ef0ef8bb11ad5eb960d7ce465760b927df27e1041bb3820145fa"}
Sep 17 17:52:44.647850 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:44.647797    2563 scope.go:117] "RemoveContainer" containerID="919a09c1a2a8ef0ef8bb11ad5eb960d7ce465760b927df27e1041bb3820145fa"
Sep 17 17:52:44.648924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:44.648890    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:44.649015 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:44.648959    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:44.649015 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:44.648993    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:52:45.655127 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:45.655092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" event={"ID":"1add5096-5e7a-4152-aa23-4c9102a7ec87","Type":"ContainerStarted","Data":"6b91b66369287bd18aa4a10014477acc5c1372018f28c651ad1d4ed96cc94dc9"}
Sep 17 17:52:45.850021 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:45.849988    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:52:45.937380 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:45.937294    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:45.938495 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:45.938471    2563 patch_prober.go:28] interesting pod/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 17 17:52:45.938557 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:45.938522    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 17 17:52:46.462289 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:46.462252    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:46.936809 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:46.936773    2563 patch_prober.go:28] interesting pod/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 17 17:52:46.937245 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:46.936832    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 17 17:52:47.936899 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:47.936855    2563 patch_prober.go:28] interesting pod/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 17 17:52:47.937275 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:47.936940    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 17 17:52:48.936935 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:48.936900    2563 patch_prober.go:28] interesting pod/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 17 17:52:48.937323 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:48.936956    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 17 17:52:49.936983 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:49.936948    2563 patch_prober.go:28] interesting pod/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 17 17:52:49.937354 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:49.937005    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 17 17:52:50.936926 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:50.936889    2563 patch_prober.go:28] interesting pod/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 17 17:52:50.937090 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:50.936946    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 17 17:52:51.941277 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:51.941247    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:52:51.942283 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:52:51.942264    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:53:06.776413 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:06.776376    2563 generic.go:356] "Generic (PLEG): container finished" podID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerID="bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8" exitCode=0
Sep 17 17:53:06.776942 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:06.776454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" event={"ID":"396d08c5-df17-4dc1-8ba5-e7440e14158a","Type":"ContainerDied","Data":"bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8"}
Sep 17 17:53:06.777024 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:06.777003    2563 scope.go:117] "RemoveContainer" containerID="bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8"
Sep 17 17:53:06.778188 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:06.778159    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:53:06.778304 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:06.778240    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:53:06.778367 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:06.778297    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:53:07.784043 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:07.784008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" event={"ID":"396d08c5-df17-4dc1-8ba5-e7440e14158a","Type":"ContainerStarted","Data":"f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97"}
Sep 17 17:53:08.025149 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:08.025113    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:53:08.026391 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:08.026362    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 17 17:53:08.026538 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:08.026419    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 17 17:53:08.608948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:08.608908    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:53:09.025875 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:09.025846    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 17 17:53:09.026280 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:09.025911    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 17 17:53:10.025367 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.025329    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 17 17:53:10.025574 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.025392    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 17 17:53:10.323180 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.323092    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"]
Sep 17 17:53:10.323789 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.323769    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy"
Sep 17 17:53:10.323789 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.323790    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy"
Sep 17 17:53:10.323943 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.323802    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy"
Sep 17 17:53:10.323943 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.323811    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy"
Sep 17 17:53:10.323943 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.323934    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy"
Sep 17 17:53:10.326465 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.326443    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.329032 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.328934    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-7b7c8c-openshift-default-dockercfg-5znqp\""
Sep 17 17:53:10.359553 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.359527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"]
Sep 17 17:53:10.441737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.440087    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-certs\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.441737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.440181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-credential-socket\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.441737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.440235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-envoy\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.441737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.440287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istiod-ca-cert\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.441737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.440339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-podinfo\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.441737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.440393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-socket\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.441737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.440468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-data\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.441737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.440498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5pz7\" (UniqueName: \"kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-kube-api-access-d5pz7\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.441737 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.440579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-token\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.541439 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.541395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5pz7\" (UniqueName: \"kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-kube-api-access-d5pz7\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.541600 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.541461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-token\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.541600 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.541520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-certs\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.541675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.541604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-credential-socket\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.541675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.541660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-envoy\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.541792 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.541743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istiod-ca-cert\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.541837 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.541815    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-podinfo\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.541910 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.541893    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-socket\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.542000 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.541981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-data\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.542210 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.542188    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-socket\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.542324 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.542027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-certs\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.542324 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.541980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-credential-socket\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.542324 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.542301    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-data\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.542499 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.542482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istiod-ca-cert\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.544191 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.544019    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-envoy\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.544191 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.544151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-podinfo\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.553304 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.553282    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5pz7\" (UniqueName: \"kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-kube-api-access-d5pz7\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.555026 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.555000    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-token\") pod \"e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") " pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.641571 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.641492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:10.953287 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.953256    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"]
Sep 17 17:53:10.955048 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:53:10.955014    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001c690c_8c85_4d2b_a9f8_ee4d4c16fbc1.slice/crio-9470ef6ecc1a178147c94a910b9cd2b1bb0ff8f8924945e141e179ff219cab8e WatchSource:0}: Error finding container 9470ef6ecc1a178147c94a910b9cd2b1bb0ff8f8924945e141e179ff219cab8e: Status 404 returned error can't find the container with id 9470ef6ecc1a178147c94a910b9cd2b1bb0ff8f8924945e141e179ff219cab8e
Sep 17 17:53:10.957438 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.957405    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:53:10.957512 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.957473    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:53:10.957512 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:10.957499    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:53:11.025926 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:11.025877    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 17 17:53:11.026077 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:11.025958    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 17 17:53:11.571336 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:11.571307    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:53:11.833128 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:11.833040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" event={"ID":"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1","Type":"ContainerStarted","Data":"b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a"}
Sep 17 17:53:11.833128 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:11.833090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" event={"ID":"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1","Type":"ContainerStarted","Data":"9470ef6ecc1a178147c94a910b9cd2b1bb0ff8f8924945e141e179ff219cab8e"}
Sep 17 17:53:11.923505 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:11.923447    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" podStartSLOduration=1.923428791 podStartE2EDuration="1.923428791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:53:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:53:11.914461471 +0000 UTC m=+1318.565367464" watchObservedRunningTime="2026-09-17 17:53:11.923428791 +0000 UTC m=+1318.574334782"
Sep 17 17:53:12.025646 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:12.025606    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 17 17:53:12.025842 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:12.025674    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 17 17:53:12.641728 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:12.641679    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:12.647010 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:12.646984    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:12.839303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:12.839268    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:12.840148 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:12.840127    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:13.026138 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:13.025967    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 17 17:53:13.026138 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:13.026027    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 17 17:53:14.030286 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:14.030245    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:53:14.031263 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:14.031244    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 17:53:15.340772 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.340738    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"]
Sep 17 17:53:15.341520 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.341502    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="003e4d27-fb69-4dab-9b23-8728552cbded" containerName="istio-proxy"
Sep 17 17:53:15.344244 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.344226    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.347966 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.347947    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-7b7c8c-serving-cert\""
Sep 17 17:53:15.360309 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.360285    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"]
Sep 17 17:53:15.397543 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.397519    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.397691 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.397657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.397780 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.397727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkfz7\" (UniqueName: \"kubernetes.io/projected/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-kube-api-access-qkfz7\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.397850 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.397800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.500118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.498502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.500118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.498647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.500118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.498680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkfz7\" (UniqueName: \"kubernetes.io/projected/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-kube-api-access-qkfz7\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.500118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.498763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.500118 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.499695    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.503786 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.503762    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-7b7c8c-serving-cert\""
Sep 17 17:53:15.504125 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.503760    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.515400 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.515347    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkfz7\" (UniqueName: \"kubernetes.io/projected/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-kube-api-access-qkfz7\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.525353 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.525294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.655959 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.655878    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:15.958856 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:15.958830    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"]
Sep 17 17:53:15.960980 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:53:15.960955    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5e5e37_fa9e_41b6_9ca1_32a4f8a547ba.slice/crio-36ee8867fb0c2c5c9457ab344bf972e6c50413a97ef1bd1406375a4cd3db6562 WatchSource:0}: Error finding container 36ee8867fb0c2c5c9457ab344bf972e6c50413a97ef1bd1406375a4cd3db6562: Status 404 returned error can't find the container with id 36ee8867fb0c2c5c9457ab344bf972e6c50413a97ef1bd1406375a4cd3db6562
Sep 17 17:53:16.863508 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:16.863474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf" event={"ID":"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba","Type":"ContainerStarted","Data":"a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b"}
Sep 17 17:53:16.863924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:16.863528    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf" event={"ID":"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba","Type":"ContainerStarted","Data":"36ee8867fb0c2c5c9457ab344bf972e6c50413a97ef1bd1406375a4cd3db6562"}
Sep 17 17:53:16.863924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:16.863611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:16.886988 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:16.886940    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf" podStartSLOduration=1.567491926 podStartE2EDuration="1.886923311s" totalImagesPullingTime="319.431385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:53:16.885326856 +0000 UTC m=+1323.536232848" watchObservedRunningTime="2026-09-17 17:53:16.886923311 +0000 UTC m=+1323.537829301"
Sep 17 17:53:22.874665 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:22.874633    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 17:53:36.994306 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:36.994274    2563 generic.go:356] "Generic (PLEG): container finished" podID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerID="b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a" exitCode=0
Sep 17 17:53:36.994783 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:36.994355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" event={"ID":"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1","Type":"ContainerDied","Data":"b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a"}
Sep 17 17:53:36.994954 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:36.994936    2563 scope.go:117] "RemoveContainer" containerID="b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a"
Sep 17 17:53:36.996632 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:36.996555    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:53:36.996742 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:36.996639    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:53:36.996742 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:36.996671    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:53:38.007466 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:38.007421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" event={"ID":"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1","Type":"ContainerStarted","Data":"e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604"}
Sep 17 17:53:38.642496 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:38.642458    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:38.643553 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:38.643529    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 17 17:53:38.643622 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:38.643580    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 17 17:53:39.642292 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:39.642259    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 17 17:53:39.642695 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:39.642308    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 17 17:53:40.642228 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:40.642192    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 17 17:53:40.642408 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:40.642266    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 17 17:53:41.642856 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.642822    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 17 17:53:41.643225 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.642877    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 17 17:53:41.832955 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.832911    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"]
Sep 17 17:53:41.835817 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.835800    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:41.846150 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.846127    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f9224635\"/\"kube-root-ca.crt\""
Sep 17 17:53:41.846414 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.846397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f9224635\"/\"default-dockercfg-hsd28\""
Sep 17 17:53:41.846465 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.846419    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f9224635\"/\"e2e-lifecycle-model-f9224635-kserve-self-signed-certs\""
Sep 17 17:53:41.846526 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.846510    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f9224635\"/\"openshift-service-ca.crt\""
Sep 17 17:53:41.910920 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.910498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-model-cache\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:41.910920 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.910551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-home\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:41.910920 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.910596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxfgt\" (UniqueName: \"kubernetes.io/projected/0d29006c-e384-4ffb-833d-5e7cd388eb82-kube-api-access-pxfgt\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:41.910920 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.910637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-tmp-dir\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:41.910920 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.910715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-dshm\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:41.910920 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.910759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d29006c-e384-4ffb-833d-5e7cd388eb82-tls-certs\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:41.919137 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:41.919110    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"]
Sep 17 17:53:42.012224 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.012184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxfgt\" (UniqueName: \"kubernetes.io/projected/0d29006c-e384-4ffb-833d-5e7cd388eb82-kube-api-access-pxfgt\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.012422 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.012241    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-tmp-dir\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.012422 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.012299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-dshm\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.012550 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.012435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d29006c-e384-4ffb-833d-5e7cd388eb82-tls-certs\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.012641 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.012623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-model-cache\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.012724 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.012655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-home\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.012788 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.012718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-tmp-dir\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.012980 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.012957    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-model-cache\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.013082 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.013002    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-home\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.014673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.014648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-dshm\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.014985 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.014969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d29006c-e384-4ffb-833d-5e7cd388eb82-tls-certs\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.028858 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.028828    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxfgt\" (UniqueName: \"kubernetes.io/projected/0d29006c-e384-4ffb-833d-5e7cd388eb82-kube-api-access-pxfgt\") pod \"e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") " pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.144665 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.144633    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:42.461205 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.461181    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"]
Sep 17 17:53:42.463259 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:53:42.463231    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d29006c_e384_4ffb_833d_5e7cd388eb82.slice/crio-6dda81a8c46acddb71a408577227b6cfc678a1038c0f42fc01f8554ada89772c WatchSource:0}: Error finding container 6dda81a8c46acddb71a408577227b6cfc678a1038c0f42fc01f8554ada89772c: Status 404 returned error can't find the container with id 6dda81a8c46acddb71a408577227b6cfc678a1038c0f42fc01f8554ada89772c
Sep 17 17:53:42.642499 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.642459    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 17 17:53:42.642662 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.642526    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 17 17:53:42.839303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:42.839270    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:43.040816 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:43.040770    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8" event={"ID":"0d29006c-e384-4ffb-833d-5e7cd388eb82","Type":"ContainerStarted","Data":"8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b"}
Sep 17 17:53:43.040981 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:43.040825    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8" event={"ID":"0d29006c-e384-4ffb-833d-5e7cd388eb82","Type":"ContainerStarted","Data":"6dda81a8c46acddb71a408577227b6cfc678a1038c0f42fc01f8554ada89772c"}
Sep 17 17:53:43.068368 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:43.068319    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8" podStartSLOduration=2.068302583 podStartE2EDuration="2.068302583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:53:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:53:43.066681662 +0000 UTC m=+1349.717587695" watchObservedRunningTime="2026-09-17 17:53:43.068302583 +0000 UTC m=+1349.719208576"
Sep 17 17:53:43.647062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:43.647028    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:43.648033 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:43.648014    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 17:53:44.908364 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:44.908329    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:53:52.145767 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:52.145696    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:52.146335 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:52.145786    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:52.158157 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:52.158129    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:53:53.115332 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:53:53.115302    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:54:12.532143 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:12.532106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:54:22.971268 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:22.971235    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"]
Sep 17 17:54:37.990831 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:37.990774    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt" podUID="1b2666a8-a01d-4524-9768-431fb7031e37" containerName="main" containerID="cri-o://4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25" gracePeriod=45
Sep 17 17:54:38.244463 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.244404    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:54:38.308939 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.308908    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-model-cache\") pod \"1b2666a8-a01d-4524-9768-431fb7031e37\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") "
Sep 17 17:54:38.309113 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.309039    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-dshm\") pod \"1b2666a8-a01d-4524-9768-431fb7031e37\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") "
Sep 17 17:54:38.309113 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.309066    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcnpv\" (UniqueName: \"kubernetes.io/projected/1b2666a8-a01d-4524-9768-431fb7031e37-kube-api-access-jcnpv\") pod \"1b2666a8-a01d-4524-9768-431fb7031e37\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") "
Sep 17 17:54:38.309113 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.309109    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-home\") pod \"1b2666a8-a01d-4524-9768-431fb7031e37\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") "
Sep 17 17:54:38.309309 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.309162    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-model-cache" (OuterVolumeSpecName: "model-cache") pod "1b2666a8-a01d-4524-9768-431fb7031e37" (UID: "1b2666a8-a01d-4524-9768-431fb7031e37"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:54:38.309309 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.309187    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-tmp-dir\") pod \"1b2666a8-a01d-4524-9768-431fb7031e37\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") "
Sep 17 17:54:38.309309 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.309224    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b2666a8-a01d-4524-9768-431fb7031e37-tls-certs\") pod \"1b2666a8-a01d-4524-9768-431fb7031e37\" (UID: \"1b2666a8-a01d-4524-9768-431fb7031e37\") "
Sep 17 17:54:38.309470 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.309389    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-home" (OuterVolumeSpecName: "home") pod "1b2666a8-a01d-4524-9768-431fb7031e37" (UID: "1b2666a8-a01d-4524-9768-431fb7031e37"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:54:38.309470 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.309459    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1b2666a8-a01d-4524-9768-431fb7031e37" (UID: "1b2666a8-a01d-4524-9768-431fb7031e37"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:54:38.309685 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.309661    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-home\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:54:38.309829 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.309688    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-tmp-dir\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:54:38.309829 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.309732    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-model-cache\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:54:38.311316 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.311295    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b2666a8-a01d-4524-9768-431fb7031e37-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1b2666a8-a01d-4524-9768-431fb7031e37" (UID: "1b2666a8-a01d-4524-9768-431fb7031e37"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:54:38.311405 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.311357    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-dshm" (OuterVolumeSpecName: "dshm") pod "1b2666a8-a01d-4524-9768-431fb7031e37" (UID: "1b2666a8-a01d-4524-9768-431fb7031e37"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:54:38.311405 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.311381    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2666a8-a01d-4524-9768-431fb7031e37-kube-api-access-jcnpv" (OuterVolumeSpecName: "kube-api-access-jcnpv") pod "1b2666a8-a01d-4524-9768-431fb7031e37" (UID: "1b2666a8-a01d-4524-9768-431fb7031e37"). InnerVolumeSpecName "kube-api-access-jcnpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:54:38.363233 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.363201    2563 generic.go:356] "Generic (PLEG): container finished" podID="1b2666a8-a01d-4524-9768-431fb7031e37" containerID="4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25" exitCode=0
Sep 17 17:54:38.363344 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.363247    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"
Sep 17 17:54:38.363344 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.363291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt" event={"ID":"1b2666a8-a01d-4524-9768-431fb7031e37","Type":"ContainerDied","Data":"4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25"}
Sep 17 17:54:38.363344 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.363341    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt" event={"ID":"1b2666a8-a01d-4524-9768-431fb7031e37","Type":"ContainerDied","Data":"499436dcad0df7500f7419c9d1f66a399be44d8789d70a07d9541e312f1ec807"}
Sep 17 17:54:38.363452 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.363364    2563 scope.go:117] "RemoveContainer" containerID="4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25"
Sep 17 17:54:38.372611 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.372596    2563 scope.go:117] "RemoveContainer" containerID="4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25"
Sep 17 17:54:38.372911 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:54:38.372893    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25\": container with ID starting with 4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25 not found: ID does not exist" containerID="4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25"
Sep 17 17:54:38.372965 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.372919    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25"} err="failed to get container status \"4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25\": rpc error: code = NotFound desc = could not find container \"4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25\": container with ID starting with 4b86728ba1a217b973cc09bad580effc69867bd073f20ddf74eaabf60e63ae25 not found: ID does not exist"
Sep 17 17:54:38.388695 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.388673    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"]
Sep 17 17:54:38.392868 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.392843    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/e2e-conflict-a-42c1d347-kserve-78f944f66c-gsvvt"]
Sep 17 17:54:38.411150 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.411133    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b2666a8-a01d-4524-9768-431fb7031e37-tls-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:54:38.411150 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.411151    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b2666a8-a01d-4524-9768-431fb7031e37-dshm\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:54:38.411269 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:38.411161    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcnpv\" (UniqueName: \"kubernetes.io/projected/1b2666a8-a01d-4524-9768-431fb7031e37-kube-api-access-jcnpv\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:54:39.614294 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:39.614262    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b2666a8-a01d-4524-9768-431fb7031e37" path="/var/lib/kubelet/pods/1b2666a8-a01d-4524-9768-431fb7031e37/volumes"
Sep 17 17:54:53.093000 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:54:53.092963    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:55:03.223905 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:03.223822    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"]
Sep 17 17:55:18.244334 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.244295    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8" podUID="0d29006c-e384-4ffb-833d-5e7cd388eb82" containerName="main" containerID="cri-o://8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b" gracePeriod=45
Sep 17 17:55:18.497675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.497619    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:55:18.587122 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.587092    2563 generic.go:356] "Generic (PLEG): container finished" podID="0d29006c-e384-4ffb-833d-5e7cd388eb82" containerID="8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b" exitCode=0
Sep 17 17:55:18.587281 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.587137    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"
Sep 17 17:55:18.587281 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.587171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8" event={"ID":"0d29006c-e384-4ffb-833d-5e7cd388eb82","Type":"ContainerDied","Data":"8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b"}
Sep 17 17:55:18.587281 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.587218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8" event={"ID":"0d29006c-e384-4ffb-833d-5e7cd388eb82","Type":"ContainerDied","Data":"6dda81a8c46acddb71a408577227b6cfc678a1038c0f42fc01f8554ada89772c"}
Sep 17 17:55:18.587281 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.587238    2563 scope.go:117] "RemoveContainer" containerID="8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b"
Sep 17 17:55:18.596280 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.596263    2563 scope.go:117] "RemoveContainer" containerID="8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b"
Sep 17 17:55:18.596537 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:55:18.596521    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b\": container with ID starting with 8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b not found: ID does not exist" containerID="8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b"
Sep 17 17:55:18.596592 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.596547    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b"} err="failed to get container status \"8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b\": rpc error: code = NotFound desc = could not find container \"8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b\": container with ID starting with 8722b55cbff9469f5408fd4fe7b5b4f1e0c8d377228c2682fec345ee08fd5f1b not found: ID does not exist"
Sep 17 17:55:18.653045 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653019    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-model-cache\") pod \"0d29006c-e384-4ffb-833d-5e7cd388eb82\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") "
Sep 17 17:55:18.653192 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653059    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-tmp-dir\") pod \"0d29006c-e384-4ffb-833d-5e7cd388eb82\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") "
Sep 17 17:55:18.653192 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653101    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d29006c-e384-4ffb-833d-5e7cd388eb82-tls-certs\") pod \"0d29006c-e384-4ffb-833d-5e7cd388eb82\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") "
Sep 17 17:55:18.653192 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653133    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-dshm\") pod \"0d29006c-e384-4ffb-833d-5e7cd388eb82\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") "
Sep 17 17:55:18.653192 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653175    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-home\") pod \"0d29006c-e384-4ffb-833d-5e7cd388eb82\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") "
Sep 17 17:55:18.653412 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653281    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxfgt\" (UniqueName: \"kubernetes.io/projected/0d29006c-e384-4ffb-833d-5e7cd388eb82-kube-api-access-pxfgt\") pod \"0d29006c-e384-4ffb-833d-5e7cd388eb82\" (UID: \"0d29006c-e384-4ffb-833d-5e7cd388eb82\") "
Sep 17 17:55:18.653412 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653309    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-model-cache" (OuterVolumeSpecName: "model-cache") pod "0d29006c-e384-4ffb-833d-5e7cd388eb82" (UID: "0d29006c-e384-4ffb-833d-5e7cd388eb82"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:55:18.653523 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653410    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0d29006c-e384-4ffb-833d-5e7cd388eb82" (UID: "0d29006c-e384-4ffb-833d-5e7cd388eb82"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:55:18.653523 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653451    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-home" (OuterVolumeSpecName: "home") pod "0d29006c-e384-4ffb-833d-5e7cd388eb82" (UID: "0d29006c-e384-4ffb-833d-5e7cd388eb82"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:55:18.653750 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653726    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-home\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:18.653844 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653751    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-model-cache\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:18.653844 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.653763    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-tmp-dir\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:18.655338 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.655306    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-dshm" (OuterVolumeSpecName: "dshm") pod "0d29006c-e384-4ffb-833d-5e7cd388eb82" (UID: "0d29006c-e384-4ffb-833d-5e7cd388eb82"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:55:18.655444 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.655372    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d29006c-e384-4ffb-833d-5e7cd388eb82-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0d29006c-e384-4ffb-833d-5e7cd388eb82" (UID: "0d29006c-e384-4ffb-833d-5e7cd388eb82"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:55:18.655444 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.655404    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d29006c-e384-4ffb-833d-5e7cd388eb82-kube-api-access-pxfgt" (OuterVolumeSpecName: "kube-api-access-pxfgt") pod "0d29006c-e384-4ffb-833d-5e7cd388eb82" (UID: "0d29006c-e384-4ffb-833d-5e7cd388eb82"). InnerVolumeSpecName "kube-api-access-pxfgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:55:18.755376 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.755292    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d29006c-e384-4ffb-833d-5e7cd388eb82-tls-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:18.755376 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.755330    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d29006c-e384-4ffb-833d-5e7cd388eb82-dshm\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:18.755376 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.755342    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxfgt\" (UniqueName: \"kubernetes.io/projected/0d29006c-e384-4ffb-833d-5e7cd388eb82-kube-api-access-pxfgt\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:18.916342 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.916310    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"]
Sep 17 17:55:18.927377 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.927344    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f9224635/e2e-lifecycle-model-f9224635-kserve-57d955d85f-v42w8"]
Sep 17 17:55:18.953744 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:18.953715    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:55:19.614274 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:19.614237    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d29006c-e384-4ffb-833d-5e7cd388eb82" path="/var/lib/kubelet/pods/0d29006c-e384-4ffb-833d-5e7cd388eb82/volumes"
Sep 17 17:55:38.835835 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.835804    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"]
Sep 17 17:55:38.836508 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.836489    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d29006c-e384-4ffb-833d-5e7cd388eb82" containerName="main"
Sep 17 17:55:38.836601 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.836509    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d29006c-e384-4ffb-833d-5e7cd388eb82" containerName="main"
Sep 17 17:55:38.836601 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.836545    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2666a8-a01d-4524-9768-431fb7031e37" containerName="main"
Sep 17 17:55:38.836601 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.836554    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2666a8-a01d-4524-9768-431fb7031e37" containerName="main"
Sep 17 17:55:38.836778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.836670    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d29006c-e384-4ffb-833d-5e7cd388eb82" containerName="main"
Sep 17 17:55:38.836778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.836687    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b2666a8-a01d-4524-9768-431fb7031e37" containerName="main"
Sep 17 17:55:38.838970 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.838952    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:38.842048 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.842021    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-8aeea1\"/\"openshift-service-ca.crt\""
Sep 17 17:55:38.842169 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.842115    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-8aeea1\"/\"kube-root-ca.crt\""
Sep 17 17:55:38.842868 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.842849    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-8aeea1\"/\"default-dockercfg-8k5x9\""
Sep 17 17:55:38.842948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.842882    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-8aeea1\"/\"distinct-2-w4-8aeea1-kserve-self-signed-certs\""
Sep 17 17:55:38.849452 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.849430    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"]
Sep 17 17:55:38.963320 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.963285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-model-cache\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:38.963488 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.963340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-tmp-dir\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:38.963488 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.963427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f802d0-1534-4cd9-ac25-979981d19c91-tls-certs\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:38.963488 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.963478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7frb\" (UniqueName: \"kubernetes.io/projected/75f802d0-1534-4cd9-ac25-979981d19c91-kube-api-access-q7frb\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:38.963595 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.963576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-dshm\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:38.963635 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:38.963608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-home\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.064500 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.064460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f802d0-1534-4cd9-ac25-979981d19c91-tls-certs\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.064673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.064516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7frb\" (UniqueName: \"kubernetes.io/projected/75f802d0-1534-4cd9-ac25-979981d19c91-kube-api-access-q7frb\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.064673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.064564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-dshm\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.064673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.064587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-home\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.064673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.064651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-model-cache\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.064860 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.064694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-tmp-dir\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.065102 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.065075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-home\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.065220 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.065204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-tmp-dir\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.065288 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.065222    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-model-cache\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.066905 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.066881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-dshm\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.067034 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.067013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f802d0-1534-4cd9-ac25-979981d19c91-tls-certs\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.077277 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.077250    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7frb\" (UniqueName: \"kubernetes.io/projected/75f802d0-1534-4cd9-ac25-979981d19c91-kube-api-access-q7frb\") pod \"distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") " pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.150078 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.150008    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:39.428743 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.428719    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"]
Sep 17 17:55:39.430892 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:55:39.430864    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75f802d0_1534_4cd9_ac25_979981d19c91.slice/crio-6ccb0b3739dc5ffe31333e1a82b822edf9cc33becfc3edf6ca5b16fcad92243c WatchSource:0}: Error finding container 6ccb0b3739dc5ffe31333e1a82b822edf9cc33becfc3edf6ca5b16fcad92243c: Status 404 returned error can't find the container with id 6ccb0b3739dc5ffe31333e1a82b822edf9cc33becfc3edf6ca5b16fcad92243c
Sep 17 17:55:39.707818 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.707696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr" event={"ID":"75f802d0-1534-4cd9-ac25-979981d19c91","Type":"ContainerStarted","Data":"3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f"}
Sep 17 17:55:39.707818 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.707768    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr" event={"ID":"75f802d0-1534-4cd9-ac25-979981d19c91","Type":"ContainerStarted","Data":"6ccb0b3739dc5ffe31333e1a82b822edf9cc33becfc3edf6ca5b16fcad92243c"}
Sep 17 17:55:39.738666 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:39.738578    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr" podStartSLOduration=1.738559289 podStartE2EDuration="1.738559289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:55:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:55:39.737967908 +0000 UTC m=+1466.388873901" watchObservedRunningTime="2026-09-17 17:55:39.738559289 +0000 UTC m=+1466.389465286"
Sep 17 17:55:49.150354 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:49.150318    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:49.150817 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:49.150366    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:49.162528 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:49.162503    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:49.593850 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:49.593818    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"]
Sep 17 17:55:49.594098 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:49.594074    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy" containerID="cri-o://6b91b66369287bd18aa4a10014477acc5c1372018f28c651ad1d4ed96cc94dc9" gracePeriod=30
Sep 17 17:55:49.779624 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:49.779589    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:55:51.162960 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:51.162926    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:55:51.943674 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:51.943643    2563 patch_prober.go:28] interesting pod/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 17:55:51.943856 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:51.943733    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:55:54.801471 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.801441    2563 generic.go:356] "Generic (PLEG): container finished" podID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerID="6b91b66369287bd18aa4a10014477acc5c1372018f28c651ad1d4ed96cc94dc9" exitCode=0
Sep 17 17:55:54.801967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.801500    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" event={"ID":"1add5096-5e7a-4152-aa23-4c9102a7ec87","Type":"ContainerDied","Data":"6b91b66369287bd18aa4a10014477acc5c1372018f28c651ad1d4ed96cc94dc9"}
Sep 17 17:55:54.801967 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.801581    2563 scope.go:117] "RemoveContainer" containerID="919a09c1a2a8ef0ef8bb11ad5eb960d7ce465760b927df27e1041bb3820145fa"
Sep 17 17:55:54.838681 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.838652    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:55:54.938742 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.938630    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-credential-socket\") pod \"1add5096-5e7a-4152-aa23-4c9102a7ec87\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") "
Sep 17 17:55:54.938742 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.938667    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-envoy\") pod \"1add5096-5e7a-4152-aa23-4c9102a7ec87\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") "
Sep 17 17:55:54.938742 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.938684    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-socket\") pod \"1add5096-5e7a-4152-aa23-4c9102a7ec87\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") "
Sep 17 17:55:54.939022 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.938767    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-certs\") pod \"1add5096-5e7a-4152-aa23-4c9102a7ec87\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") "
Sep 17 17:55:54.939022 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.938793    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-token\") pod \"1add5096-5e7a-4152-aa23-4c9102a7ec87\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") "
Sep 17 17:55:54.939022 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.938838    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tgv2\" (UniqueName: \"kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-kube-api-access-9tgv2\") pod \"1add5096-5e7a-4152-aa23-4c9102a7ec87\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") "
Sep 17 17:55:54.939022 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.938909    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1add5096-5e7a-4152-aa23-4c9102a7ec87-istiod-ca-cert\") pod \"1add5096-5e7a-4152-aa23-4c9102a7ec87\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") "
Sep 17 17:55:54.939022 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.938971    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1add5096-5e7a-4152-aa23-4c9102a7ec87" (UID: "1add5096-5e7a-4152-aa23-4c9102a7ec87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:55:54.939022 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.938990    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-podinfo\") pod \"1add5096-5e7a-4152-aa23-4c9102a7ec87\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") "
Sep 17 17:55:54.939022 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.939017    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1add5096-5e7a-4152-aa23-4c9102a7ec87" (UID: "1add5096-5e7a-4152-aa23-4c9102a7ec87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:55:54.939392 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.939038    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1add5096-5e7a-4152-aa23-4c9102a7ec87" (UID: "1add5096-5e7a-4152-aa23-4c9102a7ec87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:55:54.939392 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.939066    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-data\") pod \"1add5096-5e7a-4152-aa23-4c9102a7ec87\" (UID: \"1add5096-5e7a-4152-aa23-4c9102a7ec87\") "
Sep 17 17:55:54.939392 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.939282    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1add5096-5e7a-4152-aa23-4c9102a7ec87-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1add5096-5e7a-4152-aa23-4c9102a7ec87" (UID: "1add5096-5e7a-4152-aa23-4c9102a7ec87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:55:54.939536 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.939476    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-data" (OuterVolumeSpecName: "istio-data") pod "1add5096-5e7a-4152-aa23-4c9102a7ec87" (UID: "1add5096-5e7a-4152-aa23-4c9102a7ec87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:55:54.939622 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.939606    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:54.939675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.939624    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1add5096-5e7a-4152-aa23-4c9102a7ec87-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:54.939675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.939633    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:54.939675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.939641    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:54.939675 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.939651    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:54.941377 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.941342    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1add5096-5e7a-4152-aa23-4c9102a7ec87" (UID: "1add5096-5e7a-4152-aa23-4c9102a7ec87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:55:54.941459 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.941349    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1add5096-5e7a-4152-aa23-4c9102a7ec87" (UID: "1add5096-5e7a-4152-aa23-4c9102a7ec87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:55:54.941516 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.941466    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-kube-api-access-9tgv2" (OuterVolumeSpecName: "kube-api-access-9tgv2") pod "1add5096-5e7a-4152-aa23-4c9102a7ec87" (UID: "1add5096-5e7a-4152-aa23-4c9102a7ec87"). InnerVolumeSpecName "kube-api-access-9tgv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:55:54.941516 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:54.941494    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-token" (OuterVolumeSpecName: "istio-token") pod "1add5096-5e7a-4152-aa23-4c9102a7ec87" (UID: "1add5096-5e7a-4152-aa23-4c9102a7ec87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:55:55.040261 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:55.040227    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:55.040261 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:55.040253    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:55.040261 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:55.040263    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:55.040494 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:55.040272    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tgv2\" (UniqueName: \"kubernetes.io/projected/1add5096-5e7a-4152-aa23-4c9102a7ec87-kube-api-access-9tgv2\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:55:55.808650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:55.808617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm" event={"ID":"1add5096-5e7a-4152-aa23-4c9102a7ec87","Type":"ContainerDied","Data":"39cbc35e39341f4d0becc3c193f16599b4aa694f81da40050cf086a152299bee"}
Sep 17 17:55:55.808650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:55.808648    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"
Sep 17 17:55:55.809090 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:55.808673    2563 scope.go:117] "RemoveContainer" containerID="6b91b66369287bd18aa4a10014477acc5c1372018f28c651ad1d4ed96cc94dc9"
Sep 17 17:55:55.829811 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:55.829785    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"]
Sep 17 17:55:55.834843 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:55.834819    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f9224635-openshift-default-7944cdd4d4-kjkcm"]
Sep 17 17:55:57.615214 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:55:57.615185    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" path="/var/lib/kubelet/pods/1add5096-5e7a-4152-aa23-4c9102a7ec87/volumes"
Sep 17 17:56:05.251656 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.251619    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"]
Sep 17 17:56:05.252142 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.252126    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy"
Sep 17 17:56:05.252142 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.252143    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy"
Sep 17 17:56:05.252219 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.252215    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy"
Sep 17 17:56:05.252257 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.252222    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy"
Sep 17 17:56:05.254481 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.254466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.259819 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.259796    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-db7813\"/\"kube-root-ca.crt\""
Sep 17 17:56:05.259819 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.259807    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-db7813\"/\"openshift-service-ca.crt\""
Sep 17 17:56:05.260008 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.259807    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-db7813\"/\"embedding-w0-db7813-kserve-self-signed-certs\""
Sep 17 17:56:05.260421 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.260403    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-db7813\"/\"default-dockercfg-rhrfd\""
Sep 17 17:56:05.270150 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.270127    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"]
Sep 17 17:56:05.360022 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.359985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-model-cache\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.360200 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.360031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-home\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.360200 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.360066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-tmp-dir\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.360200 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.360094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k99cw\" (UniqueName: \"kubernetes.io/projected/2fce659e-069a-4163-997e-55cd799c2a74-kube-api-access-k99cw\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.360200 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.360126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-dshm\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.360400 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.360252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fce659e-069a-4163-997e-55cd799c2a74-tls-certs\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.462588 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.461244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-home\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.462588 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.461317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-tmp-dir\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.462588 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.461365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k99cw\" (UniqueName: \"kubernetes.io/projected/2fce659e-069a-4163-997e-55cd799c2a74-kube-api-access-k99cw\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.462588 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.461422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-dshm\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.462588 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.461511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fce659e-069a-4163-997e-55cd799c2a74-tls-certs\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.462588 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.461598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-model-cache\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.462588 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.462123    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-model-cache\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.462588 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.462439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-home\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.463207 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.462661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-tmp-dir\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.466168 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.466130    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-dshm\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.468384 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.468363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fce659e-069a-4163-997e-55cd799c2a74-tls-certs\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.472597 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.472574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k99cw\" (UniqueName: \"kubernetes.io/projected/2fce659e-069a-4163-997e-55cd799c2a74-kube-api-access-k99cw\") pod \"embedding-w0-db7813-kserve-67bff97f8c-rwjvj\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") " pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.563460 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.563426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:05.840100 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.840069    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"]
Sep 17 17:56:05.840535 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:56:05.840512    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fce659e_069a_4163_997e_55cd799c2a74.slice/crio-0b1fd1eda77fe885513a3efb06a90969c5a8f2bf9732b88593efb87c636bce46 WatchSource:0}: Error finding container 0b1fd1eda77fe885513a3efb06a90969c5a8f2bf9732b88593efb87c636bce46: Status 404 returned error can't find the container with id 0b1fd1eda77fe885513a3efb06a90969c5a8f2bf9732b88593efb87c636bce46
Sep 17 17:56:05.866394 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:05.866365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj" event={"ID":"2fce659e-069a-4163-997e-55cd799c2a74","Type":"ContainerStarted","Data":"0b1fd1eda77fe885513a3efb06a90969c5a8f2bf9732b88593efb87c636bce46"}
Sep 17 17:56:06.873774 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:06.873741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj" event={"ID":"2fce659e-069a-4163-997e-55cd799c2a74","Type":"ContainerStarted","Data":"b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe"}
Sep 17 17:56:06.896892 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:06.896846    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj" podStartSLOduration=1.89683164 podStartE2EDuration="1.89683164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:56:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:56:06.895255795 +0000 UTC m=+1493.546161787" watchObservedRunningTime="2026-09-17 17:56:06.89683164 +0000 UTC m=+1493.547737632"
Sep 17 17:56:15.564043 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:15.564008    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:15.564509 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:15.564060    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:15.577385 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:15.577361    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:15.773810 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:15.773782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:56:15.777857 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:15.777837    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:56:15.782389 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:15.782366    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 17:56:15.786852 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:15.786836    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 17:56:15.942696 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:15.942670    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:56:38.199759 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:38.199652    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:56:48.749886 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.749851    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"]
Sep 17 17:56:48.750345 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.750329    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy"
Sep 17 17:56:48.750345 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.750341    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1add5096-5e7a-4152-aa23-4c9102a7ec87" containerName="istio-proxy"
Sep 17 17:56:48.753664 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.753648    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.758565 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.758548    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ab64d6-openshift-default-dockercfg-bvzts\""
Sep 17 17:56:48.780862 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.780832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"]
Sep 17 17:56:48.826461 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.826382    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-credential-socket\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.826941 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.826740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-data\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.826941 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.826866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-certs\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.827147 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.826930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-envoy\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.827147 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.827004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-token\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.827147 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.827046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istiod-ca-cert\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.827147 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.827090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-socket\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.827375 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.827194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-podinfo\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.827375 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.827240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzsn6\" (UniqueName: \"kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-kube-api-access-nzsn6\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.927948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.927915    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-certs\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.927948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.927950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-envoy\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928153 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.927983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-token\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928153 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.928000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istiod-ca-cert\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928153 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.928026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-socket\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928313 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.928277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-certs\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928374 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.928311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-podinfo\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928430 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.928370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzsn6\" (UniqueName: \"kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-kube-api-access-nzsn6\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928489 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.928435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-credential-socket\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928489 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.928477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-data\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928601 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.928484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-socket\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928659 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.928621    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istiod-ca-cert\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928850 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.928825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-data\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.928961 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.928909    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-credential-socket\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.930452 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.930432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-envoy\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.930858 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.930839    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-podinfo\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.952065 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.952034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-token\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:48.968051 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:48.968023    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzsn6\" (UniqueName: \"kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-kube-api-access-nzsn6\") pod \"e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") " pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:49.063852 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:49.063820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:49.390974 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:49.390948    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"]
Sep 17 17:56:49.391844 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:56:49.391818    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5a845e_b21f_4b2e_ad0d_08b9ec523e00.slice/crio-d040b1b626bec2252e79d5db2a5ee56bcac05718c2c81ca7ab3b808e661cfecf WatchSource:0}: Error finding container d040b1b626bec2252e79d5db2a5ee56bcac05718c2c81ca7ab3b808e661cfecf: Status 404 returned error can't find the container with id d040b1b626bec2252e79d5db2a5ee56bcac05718c2c81ca7ab3b808e661cfecf
Sep 17 17:56:49.394201 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:49.394171    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:56:49.394267 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:49.394234    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:56:49.394267 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:49.394261    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:56:50.122872 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:50.122838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" event={"ID":"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00","Type":"ContainerStarted","Data":"58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3"}
Sep 17 17:56:50.123271 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:50.122889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" event={"ID":"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00","Type":"ContainerStarted","Data":"d040b1b626bec2252e79d5db2a5ee56bcac05718c2c81ca7ab3b808e661cfecf"}
Sep 17 17:56:50.166434 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:50.166372    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" podStartSLOduration=2.166349511 podStartE2EDuration="2.166349511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:56:50.163298054 +0000 UTC m=+1536.814204048" watchObservedRunningTime="2026-09-17 17:56:50.166349511 +0000 UTC m=+1536.817255505"
Sep 17 17:56:51.064696 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:51.064667    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:51.070147 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:51.070122    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:51.135696 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:51.135661    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:56:51.136552 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:56:51.136532    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:57:13.572880 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:13.572844    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"]
Sep 17 17:57:18.053834 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.053798    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"]
Sep 17 17:57:18.058239 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.058218    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.061424 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.061404    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-08f4f7-openshift-default-dockercfg-78prk\""
Sep 17 17:57:18.078485 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.078452    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"]
Sep 17 17:57:18.160732 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.155100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-socket\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.160732 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.155195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-envoy\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.160732 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.155225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-credential-socket\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.160732 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.155285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5qws\" (UniqueName: \"kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-kube-api-access-d5qws\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.160732 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.155400    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-data\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.160732 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.155448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286e0433-ebbd-4907-8118-bc896b32d290-istiod-ca-cert\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.160732 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.155511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-istio-token\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.160732 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.155536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-certs\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.160732 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.155570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286e0433-ebbd-4907-8118-bc896b32d290-istio-podinfo\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.256731 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.256683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5qws\" (UniqueName: \"kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-kube-api-access-d5qws\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.256911 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.256788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-data\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.256911 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.256830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286e0433-ebbd-4907-8118-bc896b32d290-istiod-ca-cert\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.256911 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.256875    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-istio-token\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.256911 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.256898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-certs\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.257137 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.256926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286e0433-ebbd-4907-8118-bc896b32d290-istio-podinfo\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.257137 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.256985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-socket\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.257137 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.257042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-envoy\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.257137 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.257073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-credential-socket\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.257350 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.257225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-data\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.257427 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.257370    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-certs\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.257485 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.257429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-credential-socket\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.257569 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.257534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286e0433-ebbd-4907-8118-bc896b32d290-istiod-ca-cert\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.257620 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.257594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-socket\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.259317 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.259297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-envoy\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.259649 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.259628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286e0433-ebbd-4907-8118-bc896b32d290-istio-podinfo\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.267582 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.267556    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5qws\" (UniqueName: \"kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-kube-api-access-d5qws\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.276388 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.276368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-istio-token\") pod \"e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") " pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.369459 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.369393    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:18.680132 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.680105    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"]
Sep 17 17:57:18.684908 ip-10-0-131-245 kubenswrapper[2563]: W0917 17:57:18.684867    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286e0433_ebbd_4907_8118_bc896b32d290.slice/crio-388859cf3afd34010a8d1d0f6ce98c6a5770024dcaef16346616edefe64cf8c9 WatchSource:0}: Error finding container 388859cf3afd34010a8d1d0f6ce98c6a5770024dcaef16346616edefe64cf8c9: Status 404 returned error can't find the container with id 388859cf3afd34010a8d1d0f6ce98c6a5770024dcaef16346616edefe64cf8c9
Sep 17 17:57:18.687381 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.687343    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:57:18.687462 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.687423    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:57:18.687503 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:18.687460    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:57:19.310627 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:19.310592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" event={"ID":"286e0433-ebbd-4907-8118-bc896b32d290","Type":"ContainerStarted","Data":"67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec"}
Sep 17 17:57:19.311098 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:19.310652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" event={"ID":"286e0433-ebbd-4907-8118-bc896b32d290","Type":"ContainerStarted","Data":"388859cf3afd34010a8d1d0f6ce98c6a5770024dcaef16346616edefe64cf8c9"}
Sep 17 17:57:19.340466 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:19.340421    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" podStartSLOduration=1.3404059130000001 podStartE2EDuration="1.340405913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:19.339583538 +0000 UTC m=+1565.990489558" watchObservedRunningTime="2026-09-17 17:57:19.340405913 +0000 UTC m=+1565.991311905"
Sep 17 17:57:19.370298 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:19.370269    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:19.375401 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:19.375379    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:20.316779 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:20.316748    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:20.317848 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:20.317822    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:57:28.592440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.592399    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj" podUID="2fce659e-069a-4163-997e-55cd799c2a74" containerName="main" containerID="cri-o://b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe" gracePeriod=45
Sep 17 17:57:28.848164 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.848104    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:57:28.876293 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.876267    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-dshm\") pod \"2fce659e-069a-4163-997e-55cd799c2a74\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") "
Sep 17 17:57:28.876432 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.876324    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k99cw\" (UniqueName: \"kubernetes.io/projected/2fce659e-069a-4163-997e-55cd799c2a74-kube-api-access-k99cw\") pod \"2fce659e-069a-4163-997e-55cd799c2a74\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") "
Sep 17 17:57:28.876432 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.876356    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fce659e-069a-4163-997e-55cd799c2a74-tls-certs\") pod \"2fce659e-069a-4163-997e-55cd799c2a74\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") "
Sep 17 17:57:28.876571 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.876523    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-tmp-dir\") pod \"2fce659e-069a-4163-997e-55cd799c2a74\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") "
Sep 17 17:57:28.876631 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.876584    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-home\") pod \"2fce659e-069a-4163-997e-55cd799c2a74\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") "
Sep 17 17:57:28.876631 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.876615    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-model-cache\") pod \"2fce659e-069a-4163-997e-55cd799c2a74\" (UID: \"2fce659e-069a-4163-997e-55cd799c2a74\") "
Sep 17 17:57:28.876889 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.876864    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2fce659e-069a-4163-997e-55cd799c2a74" (UID: "2fce659e-069a-4163-997e-55cd799c2a74"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:28.877132 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.877083    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-home" (OuterVolumeSpecName: "home") pod "2fce659e-069a-4163-997e-55cd799c2a74" (UID: "2fce659e-069a-4163-997e-55cd799c2a74"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:28.877132 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.877091    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-model-cache" (OuterVolumeSpecName: "model-cache") pod "2fce659e-069a-4163-997e-55cd799c2a74" (UID: "2fce659e-069a-4163-997e-55cd799c2a74"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:28.877297 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.877145    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-tmp-dir\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:28.879244 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.879213    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fce659e-069a-4163-997e-55cd799c2a74-kube-api-access-k99cw" (OuterVolumeSpecName: "kube-api-access-k99cw") pod "2fce659e-069a-4163-997e-55cd799c2a74" (UID: "2fce659e-069a-4163-997e-55cd799c2a74"). InnerVolumeSpecName "kube-api-access-k99cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:57:28.879365 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.879261    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-dshm" (OuterVolumeSpecName: "dshm") pod "2fce659e-069a-4163-997e-55cd799c2a74" (UID: "2fce659e-069a-4163-997e-55cd799c2a74"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:28.879516 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.879501    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fce659e-069a-4163-997e-55cd799c2a74-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2fce659e-069a-4163-997e-55cd799c2a74" (UID: "2fce659e-069a-4163-997e-55cd799c2a74"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:57:28.977952 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.977917    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-home\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:28.977952 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.977954    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-model-cache\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:28.978156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.977969    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fce659e-069a-4163-997e-55cd799c2a74-dshm\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:28.978156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.977983    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k99cw\" (UniqueName: \"kubernetes.io/projected/2fce659e-069a-4163-997e-55cd799c2a74-kube-api-access-k99cw\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:28.978156 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:28.978000    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fce659e-069a-4163-997e-55cd799c2a74-tls-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:29.370346 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:29.370316    2563 generic.go:356] "Generic (PLEG): container finished" podID="2fce659e-069a-4163-997e-55cd799c2a74" containerID="b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe" exitCode=0
Sep 17 17:57:29.370534 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:29.370359    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"
Sep 17 17:57:29.370534 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:29.370403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj" event={"ID":"2fce659e-069a-4163-997e-55cd799c2a74","Type":"ContainerDied","Data":"b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe"}
Sep 17 17:57:29.370534 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:29.370449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj" event={"ID":"2fce659e-069a-4163-997e-55cd799c2a74","Type":"ContainerDied","Data":"0b1fd1eda77fe885513a3efb06a90969c5a8f2bf9732b88593efb87c636bce46"}
Sep 17 17:57:29.370534 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:29.370470    2563 scope.go:117] "RemoveContainer" containerID="b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe"
Sep 17 17:57:29.380164 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:29.380146    2563 scope.go:117] "RemoveContainer" containerID="b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe"
Sep 17 17:57:29.380431 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:57:29.380410    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe\": container with ID starting with b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe not found: ID does not exist" containerID="b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe"
Sep 17 17:57:29.380476 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:29.380440    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe"} err="failed to get container status \"b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe\": rpc error: code = NotFound desc = could not find container \"b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe\": container with ID starting with b3fb8d694a9e73532f2b8f7a7493f89f640ba9af92318d78a17aa452c669bffe not found: ID does not exist"
Sep 17 17:57:29.392774 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:29.392748    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"]
Sep 17 17:57:29.396764 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:29.396740    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-db7813/embedding-w0-db7813-kserve-67bff97f8c-rwjvj"]
Sep 17 17:57:29.617184 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:29.617146    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fce659e-069a-4163-997e-55cd799c2a74" path="/var/lib/kubelet/pods/2fce659e-069a-4163-997e-55cd799c2a74/volumes"
Sep 17 17:57:34.415456 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.415423    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"]
Sep 17 17:57:34.415877 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.415613    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77" podUID="1cd639a0-cd56-4fed-a0b0-4ed9279f06fb" containerName="maas-api" containerID="cri-o://03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505" gracePeriod=30
Sep 17 17:57:34.672924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.672859    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:57:34.752955 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.752916    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcwsz\" (UniqueName: \"kubernetes.io/projected/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-kube-api-access-zcwsz\") pod \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") "
Sep 17 17:57:34.753116 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.753014    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-metrics-certs\") pod \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") "
Sep 17 17:57:34.753207 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.753122    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-openshift-service-ca\") pod \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") "
Sep 17 17:57:34.753272 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.753204    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-maas-api-tls\") pod \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\" (UID: \"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb\") "
Sep 17 17:57:34.753501 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.753459    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1cd639a0-cd56-4fed-a0b0-4ed9279f06fb" (UID: "1cd639a0-cd56-4fed-a0b0-4ed9279f06fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:57:34.754282 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.753971    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-openshift-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:34.755398 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.755370    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-kube-api-access-zcwsz" (OuterVolumeSpecName: "kube-api-access-zcwsz") pod "1cd639a0-cd56-4fed-a0b0-4ed9279f06fb" (UID: "1cd639a0-cd56-4fed-a0b0-4ed9279f06fb"). InnerVolumeSpecName "kube-api-access-zcwsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:57:34.755540 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.755525    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1cd639a0-cd56-4fed-a0b0-4ed9279f06fb" (UID: "1cd639a0-cd56-4fed-a0b0-4ed9279f06fb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:57:34.756064 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.756041    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1cd639a0-cd56-4fed-a0b0-4ed9279f06fb" (UID: "1cd639a0-cd56-4fed-a0b0-4ed9279f06fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:57:34.854991 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.854959    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-maas-api-tls\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:34.854991 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.854987    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcwsz\" (UniqueName: \"kubernetes.io/projected/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-kube-api-access-zcwsz\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:34.854991 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:34.854997    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb-metrics-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:35.411839 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:35.411806    2563 generic.go:356] "Generic (PLEG): container finished" podID="1cd639a0-cd56-4fed-a0b0-4ed9279f06fb" containerID="03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505" exitCode=0
Sep 17 17:57:35.412025 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:35.411855    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"
Sep 17 17:57:35.412025 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:35.411898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77" event={"ID":"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb","Type":"ContainerDied","Data":"03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505"}
Sep 17 17:57:35.412025 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:35.411966    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77" event={"ID":"1cd639a0-cd56-4fed-a0b0-4ed9279f06fb","Type":"ContainerDied","Data":"674393f37aaa1007aadfd6f9dffb75445ff7681e948eb7e69f014d83fce2464c"}
Sep 17 17:57:35.412025 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:35.411995    2563 scope.go:117] "RemoveContainer" containerID="03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505"
Sep 17 17:57:35.423599 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:35.423447    2563 scope.go:117] "RemoveContainer" containerID="03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505"
Sep 17 17:57:35.423858 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:57:35.423747    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505\": container with ID starting with 03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505 not found: ID does not exist" containerID="03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505"
Sep 17 17:57:35.423858 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:35.423780    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505"} err="failed to get container status \"03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505\": rpc error: code = NotFound desc = could not find container \"03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505\": container with ID starting with 03c56593907c2cdde164efe69bca4c77aaeb8c058bd3586e5484d77765b26505 not found: ID does not exist"
Sep 17 17:57:35.438829 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:35.438805    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"]
Sep 17 17:57:35.444402 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:35.444372    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db7813-7c4b445c-csg77"]
Sep 17 17:57:35.616323 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:35.616285    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cd639a0-cd56-4fed-a0b0-4ed9279f06fb" path="/var/lib/kubelet/pods/1cd639a0-cd56-4fed-a0b0-4ed9279f06fb/volumes"
Sep 17 17:57:43.837244 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:43.837209    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"]
Sep 17 17:57:43.837613 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:43.837409    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy" containerID="cri-o://99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665" gracePeriod=30
Sep 17 17:57:46.721206 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:46.721166    2563 patch_prober.go:28] interesting pod/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 17:57:46.721589 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:46.721239    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:57:46.768603 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:46.768568    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:57:49.174320 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.174292    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:57:49.213894 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.213857    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-socket\") pod \"5ad60a08-e817-4118-8d0d-955d2bf63893\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") "
Sep 17 17:57:49.214435 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.214415    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5nz8\" (UniqueName: \"kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-kube-api-access-w5nz8\") pod \"5ad60a08-e817-4118-8d0d-955d2bf63893\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") "
Sep 17 17:57:49.215011 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.214990    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-envoy\") pod \"5ad60a08-e817-4118-8d0d-955d2bf63893\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") "
Sep 17 17:57:49.215402 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.215386    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-token\") pod \"5ad60a08-e817-4118-8d0d-955d2bf63893\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") "
Sep 17 17:57:49.215617 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.215603    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-data\") pod \"5ad60a08-e817-4118-8d0d-955d2bf63893\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") "
Sep 17 17:57:49.215791 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.215776    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-podinfo\") pod \"5ad60a08-e817-4118-8d0d-955d2bf63893\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") "
Sep 17 17:57:49.215948 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.215934    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ad60a08-e817-4118-8d0d-955d2bf63893-istiod-ca-cert\") pod \"5ad60a08-e817-4118-8d0d-955d2bf63893\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") "
Sep 17 17:57:49.216065 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.216052    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-certs\") pod \"5ad60a08-e817-4118-8d0d-955d2bf63893\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") "
Sep 17 17:57:49.216195 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.216182    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-credential-socket\") pod \"5ad60a08-e817-4118-8d0d-955d2bf63893\" (UID: \"5ad60a08-e817-4118-8d0d-955d2bf63893\") "
Sep 17 17:57:49.218404 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.214328    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ad60a08-e817-4118-8d0d-955d2bf63893" (UID: "5ad60a08-e817-4118-8d0d-955d2bf63893"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:49.218528 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.218197    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ad60a08-e817-4118-8d0d-955d2bf63893" (UID: "5ad60a08-e817-4118-8d0d-955d2bf63893"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:49.218991 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.218970    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ad60a08-e817-4118-8d0d-955d2bf63893" (UID: "5ad60a08-e817-4118-8d0d-955d2bf63893"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:49.219449 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.219428    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ad60a08-e817-4118-8d0d-955d2bf63893-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ad60a08-e817-4118-8d0d-955d2bf63893" (UID: "5ad60a08-e817-4118-8d0d-955d2bf63893"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:57:49.219827 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.219807    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ad60a08-e817-4118-8d0d-955d2bf63893" (UID: "5ad60a08-e817-4118-8d0d-955d2bf63893"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:49.228225 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.228158    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ad60a08-e817-4118-8d0d-955d2bf63893" (UID: "5ad60a08-e817-4118-8d0d-955d2bf63893"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:49.230181 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.230151    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ad60a08-e817-4118-8d0d-955d2bf63893" (UID: "5ad60a08-e817-4118-8d0d-955d2bf63893"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:57:49.232196 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.232154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ad60a08-e817-4118-8d0d-955d2bf63893" (UID: "5ad60a08-e817-4118-8d0d-955d2bf63893"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:57:49.232748 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.232723    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-kube-api-access-w5nz8" (OuterVolumeSpecName: "kube-api-access-w5nz8") pod "5ad60a08-e817-4118-8d0d-955d2bf63893" (UID: "5ad60a08-e817-4118-8d0d-955d2bf63893"). InnerVolumeSpecName "kube-api-access-w5nz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:57:49.317580 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.317533    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:49.317908 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.317885    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5nz8\" (UniqueName: \"kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-kube-api-access-w5nz8\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:49.318029 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.318016    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:49.318119 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.318108    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:49.318213 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.318203    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:49.318303 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.318292    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ad60a08-e817-4118-8d0d-955d2bf63893-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:49.318387 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.318376    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ad60a08-e817-4118-8d0d-955d2bf63893-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:49.318467 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.318458    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:49.318547 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.318537    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ad60a08-e817-4118-8d0d-955d2bf63893-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:57:49.509739 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.509623    2563 generic.go:356] "Generic (PLEG): container finished" podID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerID="99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665" exitCode=0
Sep 17 17:57:49.509983 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.509729    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" event={"ID":"5ad60a08-e817-4118-8d0d-955d2bf63893","Type":"ContainerDied","Data":"99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665"}
Sep 17 17:57:49.510212 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.509797    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"
Sep 17 17:57:49.510575 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.510181    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5" event={"ID":"5ad60a08-e817-4118-8d0d-955d2bf63893","Type":"ContainerDied","Data":"df1889dc504f46768470917b696b763c8dfac67bfc34dca5708f1a8bfa0f38c5"}
Sep 17 17:57:49.510575 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.510199    2563 scope.go:117] "RemoveContainer" containerID="99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665"
Sep 17 17:57:49.539094 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.539071    2563 scope.go:117] "RemoveContainer" containerID="f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e"
Sep 17 17:57:49.549440 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.549419    2563 scope.go:117] "RemoveContainer" containerID="99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665"
Sep 17 17:57:49.549866 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:57:49.549745    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665\": container with ID starting with 99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665 not found: ID does not exist" containerID="99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665"
Sep 17 17:57:49.549866 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.549779    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665"} err="failed to get container status \"99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665\": rpc error: code = NotFound desc = could not find container \"99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665\": container with ID starting with 99ac235801909e5f7c48a9e3e7865602ae4e7ffb46292a9692dd9a9931e25665 not found: ID does not exist"
Sep 17 17:57:49.549866 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.549797    2563 scope.go:117] "RemoveContainer" containerID="f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e"
Sep 17 17:57:49.550083 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:57:49.550063    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e\": container with ID starting with f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e not found: ID does not exist" containerID="f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e"
Sep 17 17:57:49.550142 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.550089    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e"} err="failed to get container status \"f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e\": rpc error: code = NotFound desc = could not find container \"f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e\": container with ID starting with f18ffdba3bd038d54329de90d94debc9fa30e646c1534ba3fc087079077edc4e not found: ID does not exist"
Sep 17 17:57:49.557631 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.557608    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"]
Sep 17 17:57:49.565476 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.565450    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-db7813-openshift-default-546768c8d6-hzds5"]
Sep 17 17:57:49.619548 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:49.619513    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" path="/var/lib/kubelet/pods/5ad60a08-e817-4118-8d0d-955d2bf63893/volumes"
Sep 17 17:57:58.575033 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.574999    2563 generic.go:356] "Generic (PLEG): container finished" podID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerID="58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3" exitCode=0
Sep 17 17:57:58.575530 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.575068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" event={"ID":"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00","Type":"ContainerDied","Data":"58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3"}
Sep 17 17:57:58.575530 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.575472    2563 scope.go:117] "RemoveContainer" containerID="58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3"
Sep 17 17:57:58.576827 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.576809    2563 generic.go:356] "Generic (PLEG): container finished" podID="286e0433-ebbd-4907-8118-bc896b32d290" containerID="67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec" exitCode=0
Sep 17 17:57:58.576903 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.576849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" event={"ID":"286e0433-ebbd-4907-8118-bc896b32d290","Type":"ContainerDied","Data":"67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec"}
Sep 17 17:57:58.576903 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.576848    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:57:58.576973 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.576917    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:57:58.576973 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.576950    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:57:58.577170 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.577158    2563 scope.go:117] "RemoveContainer" containerID="67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec"
Sep 17 17:57:58.578311 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.578280    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:57:58.578418 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.578341    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:57:58.578418 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:58.578374    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 17:57:59.585943 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:59.585902    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" event={"ID":"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00","Type":"ContainerStarted","Data":"519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6"}
Sep 17 17:57:59.589986 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:57:59.589949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" event={"ID":"286e0433-ebbd-4907-8118-bc896b32d290","Type":"ContainerStarted","Data":"d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55"}
Sep 17 17:58:00.065733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:00.065161    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:58:00.065733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:00.065290    2563 patch_prober.go:28] interesting pod/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 17 17:58:00.065733 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:00.065333    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 17 17:58:00.369817 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:00.369742    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:58:00.370043 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:00.370022    2563 patch_prober.go:28] interesting pod/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 17 17:58:00.370087 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:00.370070    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 17 17:58:01.064870 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:01.064831    2563 patch_prober.go:28] interesting pod/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 17 17:58:01.065285 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:01.064892    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 17 17:58:01.370504 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:01.370399    2563 patch_prober.go:28] interesting pod/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 17 17:58:01.370504 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:01.370466    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 17 17:58:02.064654 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:02.064620    2563 patch_prober.go:28] interesting pod/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 17 17:58:02.064861 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:02.064672    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 17 17:58:02.370744 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:02.370646    2563 patch_prober.go:28] interesting pod/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 17 17:58:02.370744 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:02.370726    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 17 17:58:03.064571 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:03.064529    2563 patch_prober.go:28] interesting pod/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 17 17:58:03.064780 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:03.064599    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 17 17:58:03.370101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:03.370019    2563 patch_prober.go:28] interesting pod/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 17 17:58:03.370101 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:03.370083    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 17 17:58:04.065371 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:04.065015    2563 patch_prober.go:28] interesting pod/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 17 17:58:04.065371 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:04.065068    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 17 17:58:04.370071 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:04.369992    2563 patch_prober.go:28] interesting pod/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 17 17:58:04.370071 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:04.370045    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 17 17:58:05.068954 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:05.068924    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:58:05.069410 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:05.069357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:58:05.070148 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:05.070128    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:58:05.316664 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:05.316623    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:58:05.375057 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:05.374976    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:58:05.652619 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:05.652539    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:58:08.976453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:08.976415    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"]
Sep 17 17:58:08.976912 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:08.976610    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy" containerID="cri-o://519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6" gracePeriod=30
Sep 17 17:58:14.231470 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.231442    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:58:14.350406 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350375    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-podinfo\") pod \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") "
Sep 17 17:58:14.350406 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350413    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-socket\") pod \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") "
Sep 17 17:58:14.350622 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350452    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-certs\") pod \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") "
Sep 17 17:58:14.350622 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350471    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzsn6\" (UniqueName: \"kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-kube-api-access-nzsn6\") pod \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") "
Sep 17 17:58:14.350622 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350508    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-data\") pod \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") "
Sep 17 17:58:14.350622 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350578    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-envoy\") pod \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") "
Sep 17 17:58:14.350843 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350628    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-credential-socket\") pod \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") "
Sep 17 17:58:14.350843 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350658    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-token\") pod \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") "
Sep 17 17:58:14.350843 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350683    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istiod-ca-cert\") pod \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\" (UID: \"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00\") "
Sep 17 17:58:14.350843 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350768    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" (UID: "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:14.351053 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350889    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" (UID: "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:14.351053 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.350990    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" (UID: "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:14.351226 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.351195    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" (UID: "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:14.351321 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.351274    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:14.351321 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.351297    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:14.351321 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.351314    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:14.351467 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.351430    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" (UID: "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:14.352728 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.352692    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" (UID: "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:58:14.352728 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.352715    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-kube-api-access-nzsn6" (OuterVolumeSpecName: "kube-api-access-nzsn6") pod "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" (UID: "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00"). InnerVolumeSpecName "kube-api-access-nzsn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:14.353181 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.353162    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" (UID: "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:14.353260 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.353180    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" (UID: "ec5a845e-b21f-4b2e-ad0d-08b9ec523e00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:14.451969 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.451940    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:14.451969 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.451965    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:14.451969 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.451974    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:14.452163 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.451982    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzsn6\" (UniqueName: \"kubernetes.io/projected/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-kube-api-access-nzsn6\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:14.452163 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.451991    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:14.452163 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.452001    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:14.703049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.702953    2563 generic.go:356] "Generic (PLEG): container finished" podID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerID="519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6" exitCode=0
Sep 17 17:58:14.703049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.703009    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"
Sep 17 17:58:14.703049 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.703032    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" event={"ID":"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00","Type":"ContainerDied","Data":"519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6"}
Sep 17 17:58:14.703327 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.703083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8" event={"ID":"ec5a845e-b21f-4b2e-ad0d-08b9ec523e00","Type":"ContainerDied","Data":"d040b1b626bec2252e79d5db2a5ee56bcac05718c2c81ca7ab3b808e661cfecf"}
Sep 17 17:58:14.703327 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.703108    2563 scope.go:117] "RemoveContainer" containerID="519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6"
Sep 17 17:58:14.713214 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.713193    2563 scope.go:117] "RemoveContainer" containerID="58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3"
Sep 17 17:58:14.721615 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.721596    2563 scope.go:117] "RemoveContainer" containerID="519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6"
Sep 17 17:58:14.721897 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:58:14.721877    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6\": container with ID starting with 519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6 not found: ID does not exist" containerID="519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6"
Sep 17 17:58:14.721941 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.721907    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6"} err="failed to get container status \"519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6\": rpc error: code = NotFound desc = could not find container \"519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6\": container with ID starting with 519aaab0cc1e6e1099da3a303d962a5148a9e0f2fec8bba618e9179350a5abc6 not found: ID does not exist"
Sep 17 17:58:14.721941 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.721926    2563 scope.go:117] "RemoveContainer" containerID="58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3"
Sep 17 17:58:14.722147 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:58:14.722127    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3\": container with ID starting with 58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3 not found: ID does not exist" containerID="58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3"
Sep 17 17:58:14.722184 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.722153    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3"} err="failed to get container status \"58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3\": rpc error: code = NotFound desc = could not find container \"58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3\": container with ID starting with 58eccb6f31708bd6027abbb8529a2d0f3fb9687c634fb8fcfc873fe5c4441ae3 not found: ID does not exist"
Sep 17 17:58:14.728884 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.728863    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"]
Sep 17 17:58:14.733448 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:14.733422    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ab64d6-openshift-default-d475f675d-sztf8"]
Sep 17 17:58:15.614809 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:15.614773    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" path="/var/lib/kubelet/pods/ec5a845e-b21f-4b2e-ad0d-08b9ec523e00/volumes"
Sep 17 17:58:16.143648 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:16.143614    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:58:33.490084 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:33.490052    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"]
Sep 17 17:58:33.490612 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:33.490245    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy" containerID="cri-o://d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55" gracePeriod=30
Sep 17 17:58:35.653674 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:35.653630    2563 patch_prober.go:28] interesting pod/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 17:58:35.654064 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:35.653731    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:58:38.744487 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.744465    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:58:38.808436 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.808399    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-credential-socket\") pod \"286e0433-ebbd-4907-8118-bc896b32d290\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") "
Sep 17 17:58:38.808618 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.808461    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286e0433-ebbd-4907-8118-bc896b32d290-istiod-ca-cert\") pod \"286e0433-ebbd-4907-8118-bc896b32d290\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") "
Sep 17 17:58:38.808618 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.808486    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-socket\") pod \"286e0433-ebbd-4907-8118-bc896b32d290\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") "
Sep 17 17:58:38.808618 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.808506    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-certs\") pod \"286e0433-ebbd-4907-8118-bc896b32d290\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") "
Sep 17 17:58:38.808618 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.808545    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286e0433-ebbd-4907-8118-bc896b32d290-istio-podinfo\") pod \"286e0433-ebbd-4907-8118-bc896b32d290\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") "
Sep 17 17:58:38.808924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.808652    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-data\") pod \"286e0433-ebbd-4907-8118-bc896b32d290\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") "
Sep 17 17:58:38.808924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.808750    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-envoy\") pod \"286e0433-ebbd-4907-8118-bc896b32d290\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") "
Sep 17 17:58:38.808924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.808760    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "286e0433-ebbd-4907-8118-bc896b32d290" (UID: "286e0433-ebbd-4907-8118-bc896b32d290"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:38.808924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.808802    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-istio-token\") pod \"286e0433-ebbd-4907-8118-bc896b32d290\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") "
Sep 17 17:58:38.808924 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.808867    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5qws\" (UniqueName: \"kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-kube-api-access-d5qws\") pod \"286e0433-ebbd-4907-8118-bc896b32d290\" (UID: \"286e0433-ebbd-4907-8118-bc896b32d290\") "
Sep 17 17:58:38.809206 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.809046    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-data" (OuterVolumeSpecName: "istio-data") pod "286e0433-ebbd-4907-8118-bc896b32d290" (UID: "286e0433-ebbd-4907-8118-bc896b32d290"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:38.809206 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.809061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/286e0433-ebbd-4907-8118-bc896b32d290-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "286e0433-ebbd-4907-8118-bc896b32d290" (UID: "286e0433-ebbd-4907-8118-bc896b32d290"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:38.809332 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.809310    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "286e0433-ebbd-4907-8118-bc896b32d290" (UID: "286e0433-ebbd-4907-8118-bc896b32d290"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:38.809392 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.809375    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "286e0433-ebbd-4907-8118-bc896b32d290" (UID: "286e0433-ebbd-4907-8118-bc896b32d290"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:38.809650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.809529    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:38.809650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.809555    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286e0433-ebbd-4907-8118-bc896b32d290-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:38.809650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.809570    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:38.809650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.809583    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:38.809650 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.809596    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:38.810997 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.810975    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/286e0433-ebbd-4907-8118-bc896b32d290-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "286e0433-ebbd-4907-8118-bc896b32d290" (UID: "286e0433-ebbd-4907-8118-bc896b32d290"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:58:38.811564 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.811541    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-kube-api-access-d5qws" (OuterVolumeSpecName: "kube-api-access-d5qws") pod "286e0433-ebbd-4907-8118-bc896b32d290" (UID: "286e0433-ebbd-4907-8118-bc896b32d290"). InnerVolumeSpecName "kube-api-access-d5qws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:38.811684 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.811637    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-istio-token" (OuterVolumeSpecName: "istio-token") pod "286e0433-ebbd-4907-8118-bc896b32d290" (UID: "286e0433-ebbd-4907-8118-bc896b32d290"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:38.811769 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.811734    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "286e0433-ebbd-4907-8118-bc896b32d290" (UID: "286e0433-ebbd-4907-8118-bc896b32d290"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:38.838804 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.838781    2563 generic.go:356] "Generic (PLEG): container finished" podID="286e0433-ebbd-4907-8118-bc896b32d290" containerID="d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55" exitCode=0
Sep 17 17:58:38.838971 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.838839    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"
Sep 17 17:58:38.838971 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.838871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" event={"ID":"286e0433-ebbd-4907-8118-bc896b32d290","Type":"ContainerDied","Data":"d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55"}
Sep 17 17:58:38.838971 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.838924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x" event={"ID":"286e0433-ebbd-4907-8118-bc896b32d290","Type":"ContainerDied","Data":"388859cf3afd34010a8d1d0f6ce98c6a5770024dcaef16346616edefe64cf8c9"}
Sep 17 17:58:38.838971 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.838946    2563 scope.go:117] "RemoveContainer" containerID="d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55"
Sep 17 17:58:38.849844 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.849823    2563 scope.go:117] "RemoveContainer" containerID="67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec"
Sep 17 17:58:38.858117 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.858100    2563 scope.go:117] "RemoveContainer" containerID="d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55"
Sep 17 17:58:38.858378 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:58:38.858360    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55\": container with ID starting with d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55 not found: ID does not exist" containerID="d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55"
Sep 17 17:58:38.858430 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.858385    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55"} err="failed to get container status \"d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55\": rpc error: code = NotFound desc = could not find container \"d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55\": container with ID starting with d591a45a36c619f0c0b5cdb8b236e0b1dd3ebe4219ee50975b8cc2ee0dd25d55 not found: ID does not exist"
Sep 17 17:58:38.858430 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.858402    2563 scope.go:117] "RemoveContainer" containerID="67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec"
Sep 17 17:58:38.858627 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:58:38.858608    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec\": container with ID starting with 67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec not found: ID does not exist" containerID="67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec"
Sep 17 17:58:38.858684 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.858636    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec"} err="failed to get container status \"67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec\": rpc error: code = NotFound desc = could not find container \"67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec\": container with ID starting with 67390fb930248df0530ad6abbe9ce8e76edb10e5d03fb012b56580883ecc11ec not found: ID does not exist"
Sep 17 17:58:38.873531 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.873508    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"]
Sep 17 17:58:38.881525 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.881505    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-08f4f7-openshift-default-c5ff49696-djz4x"]
Sep 17 17:58:38.910152 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.910125    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286e0433-ebbd-4907-8118-bc896b32d290-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:38.910152 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.910149    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286e0433-ebbd-4907-8118-bc896b32d290-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:38.910296 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.910162    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:38.910296 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:38.910175    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5qws\" (UniqueName: \"kubernetes.io/projected/286e0433-ebbd-4907-8118-bc896b32d290-kube-api-access-d5qws\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:39.614677 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:39.614645    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="286e0433-ebbd-4907-8118-bc896b32d290" path="/var/lib/kubelet/pods/286e0433-ebbd-4907-8118-bc896b32d290/volumes"
Sep 17 17:58:44.929646 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:44.929618    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"]
Sep 17 17:58:44.930068 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:44.929858    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh" podUID="c276e87a-0710-49bd-a09d-fdb30361eb0a" containerName="maas-api" containerID="cri-o://7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658" gracePeriod=30
Sep 17 17:58:45.195152 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.195088    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:58:45.268560 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.268529    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c276e87a-0710-49bd-a09d-fdb30361eb0a-openshift-service-ca\") pod \"c276e87a-0710-49bd-a09d-fdb30361eb0a\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") "
Sep 17 17:58:45.268738 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.268578    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-metrics-certs\") pod \"c276e87a-0710-49bd-a09d-fdb30361eb0a\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") "
Sep 17 17:58:45.268738 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.268621    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwzh8\" (UniqueName: \"kubernetes.io/projected/c276e87a-0710-49bd-a09d-fdb30361eb0a-kube-api-access-fwzh8\") pod \"c276e87a-0710-49bd-a09d-fdb30361eb0a\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") "
Sep 17 17:58:45.268840 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.268740    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-maas-api-tls\") pod \"c276e87a-0710-49bd-a09d-fdb30361eb0a\" (UID: \"c276e87a-0710-49bd-a09d-fdb30361eb0a\") "
Sep 17 17:58:45.269002 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.268975    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c276e87a-0710-49bd-a09d-fdb30361eb0a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c276e87a-0710-49bd-a09d-fdb30361eb0a" (UID: "c276e87a-0710-49bd-a09d-fdb30361eb0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:45.269232 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.269207    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c276e87a-0710-49bd-a09d-fdb30361eb0a-openshift-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:45.270813 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.270793    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c276e87a-0710-49bd-a09d-fdb30361eb0a" (UID: "c276e87a-0710-49bd-a09d-fdb30361eb0a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:58:45.270896 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.270844    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c276e87a-0710-49bd-a09d-fdb30361eb0a" (UID: "c276e87a-0710-49bd-a09d-fdb30361eb0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:58:45.270940 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.270916    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c276e87a-0710-49bd-a09d-fdb30361eb0a-kube-api-access-fwzh8" (OuterVolumeSpecName: "kube-api-access-fwzh8") pod "c276e87a-0710-49bd-a09d-fdb30361eb0a" (UID: "c276e87a-0710-49bd-a09d-fdb30361eb0a"). InnerVolumeSpecName "kube-api-access-fwzh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:45.370716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.370619    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-metrics-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:45.370716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.370656    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwzh8\" (UniqueName: \"kubernetes.io/projected/c276e87a-0710-49bd-a09d-fdb30361eb0a-kube-api-access-fwzh8\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:45.370716 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.370672    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c276e87a-0710-49bd-a09d-fdb30361eb0a-maas-api-tls\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:45.887530 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.887442    2563 generic.go:356] "Generic (PLEG): container finished" podID="c276e87a-0710-49bd-a09d-fdb30361eb0a" containerID="7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658" exitCode=0
Sep 17 17:58:45.887530 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.887506    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"
Sep 17 17:58:45.887530 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.887514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh" event={"ID":"c276e87a-0710-49bd-a09d-fdb30361eb0a","Type":"ContainerDied","Data":"7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658"}
Sep 17 17:58:45.887785 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.887574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh" event={"ID":"c276e87a-0710-49bd-a09d-fdb30361eb0a","Type":"ContainerDied","Data":"07ce4bce78f07406248cba525ba220fda925c919a6b17cdcbf4c129c6b3c6f10"}
Sep 17 17:58:45.887785 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.887598    2563 scope.go:117] "RemoveContainer" containerID="7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658"
Sep 17 17:58:45.896488 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.896468    2563 scope.go:117] "RemoveContainer" containerID="7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658"
Sep 17 17:58:45.896788 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:58:45.896767    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658\": container with ID starting with 7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658 not found: ID does not exist" containerID="7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658"
Sep 17 17:58:45.896847 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.896796    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658"} err="failed to get container status \"7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658\": rpc error: code = NotFound desc = could not find container \"7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658\": container with ID starting with 7f9d0ffe3b1c19cea2393f56c8d9560a4ac5065197e04d0587d9f29c761f1658 not found: ID does not exist"
Sep 17 17:58:45.945203 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.945179    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"]
Sep 17 17:58:45.949773 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:45.949753    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7e8755-6c666fccbb-flssh"]
Sep 17 17:58:46.387461 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:46.387427    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:58:47.616895 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:47.616858    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c276e87a-0710-49bd-a09d-fdb30361eb0a" path="/var/lib/kubelet/pods/c276e87a-0710-49bd-a09d-fdb30361eb0a/volumes"
Sep 17 17:58:53.397340 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:53.397308    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"]
Sep 17 17:58:53.397844 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:53.397559    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy" containerID="cri-o://8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e" gracePeriod=30
Sep 17 17:58:56.970329 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:56.970297    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 17:58:56.970696 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:56.970351    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:58:57.151662 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:57.151626    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"]
Sep 17 17:58:58.653427 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.653398    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:58:58.708643 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.708560    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-data\") pod \"9adc4faa-3182-4939-9e46-e7754461f9ac\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") "
Sep 17 17:58:58.708643 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.708595    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-envoy\") pod \"9adc4faa-3182-4939-9e46-e7754461f9ac\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") "
Sep 17 17:58:58.708643 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.708625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk8g2\" (UniqueName: \"kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-kube-api-access-gk8g2\") pod \"9adc4faa-3182-4939-9e46-e7754461f9ac\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") "
Sep 17 17:58:58.708952 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.708655    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-credential-socket\") pod \"9adc4faa-3182-4939-9e46-e7754461f9ac\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") "
Sep 17 17:58:58.708952 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.708691    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-token\") pod \"9adc4faa-3182-4939-9e46-e7754461f9ac\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") "
Sep 17 17:58:58.708952 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.708828    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-certs\") pod \"9adc4faa-3182-4939-9e46-e7754461f9ac\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") "
Sep 17 17:58:58.708952 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.708879    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-socket\") pod \"9adc4faa-3182-4939-9e46-e7754461f9ac\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") "
Sep 17 17:58:58.708952 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.708878    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-data" (OuterVolumeSpecName: "istio-data") pod "9adc4faa-3182-4939-9e46-e7754461f9ac" (UID: "9adc4faa-3182-4939-9e46-e7754461f9ac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:58.708952 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.708909    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9adc4faa-3182-4939-9e46-e7754461f9ac-istiod-ca-cert\") pod \"9adc4faa-3182-4939-9e46-e7754461f9ac\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") "
Sep 17 17:58:58.708952 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.708936    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-podinfo\") pod \"9adc4faa-3182-4939-9e46-e7754461f9ac\" (UID: \"9adc4faa-3182-4939-9e46-e7754461f9ac\") "
Sep 17 17:58:58.709291 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.708978    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9adc4faa-3182-4939-9e46-e7754461f9ac" (UID: "9adc4faa-3182-4939-9e46-e7754461f9ac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:58.709291 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.709147    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9adc4faa-3182-4939-9e46-e7754461f9ac" (UID: "9adc4faa-3182-4939-9e46-e7754461f9ac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:58.709291 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.709149    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9adc4faa-3182-4939-9e46-e7754461f9ac" (UID: "9adc4faa-3182-4939-9e46-e7754461f9ac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:58.709291 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.709270    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9adc4faa-3182-4939-9e46-e7754461f9ac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9adc4faa-3182-4939-9e46-e7754461f9ac" (UID: "9adc4faa-3182-4939-9e46-e7754461f9ac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:58.709864 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.709568    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9adc4faa-3182-4939-9e46-e7754461f9ac-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:58.709864 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.709594    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:58.709864 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.709608    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:58.709864 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.709623    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:58.709864 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.709637    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:58.711056 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.711030    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-kube-api-access-gk8g2" (OuterVolumeSpecName: "kube-api-access-gk8g2") pod "9adc4faa-3182-4939-9e46-e7754461f9ac" (UID: "9adc4faa-3182-4939-9e46-e7754461f9ac"). InnerVolumeSpecName "kube-api-access-gk8g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:58.711214 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.711191    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-token" (OuterVolumeSpecName: "istio-token") pod "9adc4faa-3182-4939-9e46-e7754461f9ac" (UID: "9adc4faa-3182-4939-9e46-e7754461f9ac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:58.711322 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.711302    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9adc4faa-3182-4939-9e46-e7754461f9ac" (UID: "9adc4faa-3182-4939-9e46-e7754461f9ac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:58.711395 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.711378    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9adc4faa-3182-4939-9e46-e7754461f9ac" (UID: "9adc4faa-3182-4939-9e46-e7754461f9ac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:58:58.810539 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.810513    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:58.810539 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.810536    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:58.810780 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.810545    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk8g2\" (UniqueName: \"kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-kube-api-access-gk8g2\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:58.810780 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.810555    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9adc4faa-3182-4939-9e46-e7754461f9ac-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:58:58.963525 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.963453    2563 generic.go:356] "Generic (PLEG): container finished" podID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerID="8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e" exitCode=0
Sep 17 17:58:58.963525 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.963501    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"
Sep 17 17:58:58.963525 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.963517    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" event={"ID":"9adc4faa-3182-4939-9e46-e7754461f9ac","Type":"ContainerDied","Data":"8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e"}
Sep 17 17:58:58.963779 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.963566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp" event={"ID":"9adc4faa-3182-4939-9e46-e7754461f9ac","Type":"ContainerDied","Data":"1250674735b9949abfd07941eff192e34d3054e80d3e0b076adc3fb8b264371b"}
Sep 17 17:58:58.963779 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.963592    2563 scope.go:117] "RemoveContainer" containerID="8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e"
Sep 17 17:58:58.973642 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.973620    2563 scope.go:117] "RemoveContainer" containerID="27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e"
Sep 17 17:58:58.982377 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.982363    2563 scope.go:117] "RemoveContainer" containerID="8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e"
Sep 17 17:58:58.982651 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:58:58.982633    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e\": container with ID starting with 8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e not found: ID does not exist" containerID="8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e"
Sep 17 17:58:58.982714 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.982660    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e"} err="failed to get container status \"8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e\": rpc error: code = NotFound desc = could not find container \"8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e\": container with ID starting with 8f0ed06d4e7e271f56a03dace7f39e7eeef74d9d220e650b9fe10826996c421e not found: ID does not exist"
Sep 17 17:58:58.982714 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.982678    2563 scope.go:117] "RemoveContainer" containerID="27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e"
Sep 17 17:58:58.982941 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:58:58.982923    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e\": container with ID starting with 27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e not found: ID does not exist" containerID="27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e"
Sep 17 17:58:58.982980 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:58.982948    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e"} err="failed to get container status \"27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e\": rpc error: code = NotFound desc = could not find container \"27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e\": container with ID starting with 27d4060e6d5bd1cbc4f0b64bf48f5c200e97b765f5b471090054f3b383acb77e not found: ID does not exist"
Sep 17 17:58:59.005054 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:59.005030    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"]
Sep 17 17:58:59.008301 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:59.008281    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7e8755-openshift-default-8757456c6-sb5xp"]
Sep 17 17:58:59.614494 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:58:59.614461    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" path="/var/lib/kubelet/pods/9adc4faa-3182-4939-9e46-e7754461f9ac/volumes"
Sep 17 17:59:04.042928 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:04.042878    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:59:04.789661 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:04.789622    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"]
Sep 17 17:59:04.789906 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:04.789868    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b" podUID="c9e39543-66f2-4fc1-96b4-93bbbb15f92a" containerName="maas-api" containerID="cri-o://52cebc4d2f3bae12f8e2ccc443e6d9a217f2f467f44ed2a9ccefd6cf9f78c0d7" gracePeriod=30
Sep 17 17:59:05.001897 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.001866    2563 generic.go:356] "Generic (PLEG): container finished" podID="c9e39543-66f2-4fc1-96b4-93bbbb15f92a" containerID="52cebc4d2f3bae12f8e2ccc443e6d9a217f2f467f44ed2a9ccefd6cf9f78c0d7" exitCode=0
Sep 17 17:59:05.002073 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.001940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b" event={"ID":"c9e39543-66f2-4fc1-96b4-93bbbb15f92a","Type":"ContainerDied","Data":"52cebc4d2f3bae12f8e2ccc443e6d9a217f2f467f44ed2a9ccefd6cf9f78c0d7"}
Sep 17 17:59:05.048287 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.048222    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:59:05.175657 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.175617    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-maas-api-tls\") pod \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") "
Sep 17 17:59:05.175657 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.175656    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-metrics-certs\") pod \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") "
Sep 17 17:59:05.175942 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.175691    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7vpj\" (UniqueName: \"kubernetes.io/projected/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-kube-api-access-f7vpj\") pod \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") "
Sep 17 17:59:05.175942 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.175826    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-openshift-service-ca\") pod \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\" (UID: \"c9e39543-66f2-4fc1-96b4-93bbbb15f92a\") "
Sep 17 17:59:05.176216 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.176187    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9e39543-66f2-4fc1-96b4-93bbbb15f92a" (UID: "c9e39543-66f2-4fc1-96b4-93bbbb15f92a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:05.177869 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.177837    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9e39543-66f2-4fc1-96b4-93bbbb15f92a" (UID: "c9e39543-66f2-4fc1-96b4-93bbbb15f92a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:59:05.177983 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.177899    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-kube-api-access-f7vpj" (OuterVolumeSpecName: "kube-api-access-f7vpj") pod "c9e39543-66f2-4fc1-96b4-93bbbb15f92a" (UID: "c9e39543-66f2-4fc1-96b4-93bbbb15f92a"). InnerVolumeSpecName "kube-api-access-f7vpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:05.177983 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.177924    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c9e39543-66f2-4fc1-96b4-93bbbb15f92a" (UID: "c9e39543-66f2-4fc1-96b4-93bbbb15f92a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:59:05.277685 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.277646    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-maas-api-tls\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:05.277685 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.277680    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-metrics-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:05.277685 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.277689    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7vpj\" (UniqueName: \"kubernetes.io/projected/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-kube-api-access-f7vpj\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:05.277685 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:05.277723    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9e39543-66f2-4fc1-96b4-93bbbb15f92a-openshift-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:06.009329 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:06.009245    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"
Sep 17 17:59:06.009329 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:06.009279    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b" event={"ID":"c9e39543-66f2-4fc1-96b4-93bbbb15f92a","Type":"ContainerDied","Data":"6b4e4c5f0ad4fd69d352a24e0b6b89fb4f4547589ab66556924c1f7db6e3dc6b"}
Sep 17 17:59:06.009522 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:06.009347    2563 scope.go:117] "RemoveContainer" containerID="52cebc4d2f3bae12f8e2ccc443e6d9a217f2f467f44ed2a9ccefd6cf9f78c0d7"
Sep 17 17:59:06.032490 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:06.032457    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"]
Sep 17 17:59:06.034386 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:06.034363    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ef41f8-c658f9758-d9l5b"]
Sep 17 17:59:07.614050 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:07.614015    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9e39543-66f2-4fc1-96b4-93bbbb15f92a" path="/var/lib/kubelet/pods/c9e39543-66f2-4fc1-96b4-93bbbb15f92a/volumes"
Sep 17 17:59:12.170931 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.170866    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr" podUID="75f802d0-1534-4cd9-ac25-979981d19c91" containerName="main" containerID="cri-o://3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f" gracePeriod=45
Sep 17 17:59:12.216580 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.216544    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"]
Sep 17 17:59:12.216837 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.216793    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy" containerID="cri-o://2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635" gracePeriod=30
Sep 17 17:59:12.446031 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.446003    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:59:12.553231 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.553198    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-model-cache\") pod \"75f802d0-1534-4cd9-ac25-979981d19c91\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") "
Sep 17 17:59:12.553411 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.553242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-tmp-dir\") pod \"75f802d0-1534-4cd9-ac25-979981d19c91\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") "
Sep 17 17:59:12.553411 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.553279    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-dshm\") pod \"75f802d0-1534-4cd9-ac25-979981d19c91\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") "
Sep 17 17:59:12.553411 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.553318    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7frb\" (UniqueName: \"kubernetes.io/projected/75f802d0-1534-4cd9-ac25-979981d19c91-kube-api-access-q7frb\") pod \"75f802d0-1534-4cd9-ac25-979981d19c91\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") "
Sep 17 17:59:12.553411 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.553375    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f802d0-1534-4cd9-ac25-979981d19c91-tls-certs\") pod \"75f802d0-1534-4cd9-ac25-979981d19c91\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") "
Sep 17 17:59:12.553648 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.553449    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-home\") pod \"75f802d0-1534-4cd9-ac25-979981d19c91\" (UID: \"75f802d0-1534-4cd9-ac25-979981d19c91\") "
Sep 17 17:59:12.553648 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.553517    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-model-cache" (OuterVolumeSpecName: "model-cache") pod "75f802d0-1534-4cd9-ac25-979981d19c91" (UID: "75f802d0-1534-4cd9-ac25-979981d19c91"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:12.553648 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.553531    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "75f802d0-1534-4cd9-ac25-979981d19c91" (UID: "75f802d0-1534-4cd9-ac25-979981d19c91"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:12.553832 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.553806    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-model-cache\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:12.553832 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.553824    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-tmp-dir\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:12.553939 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.553852    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-home" (OuterVolumeSpecName: "home") pod "75f802d0-1534-4cd9-ac25-979981d19c91" (UID: "75f802d0-1534-4cd9-ac25-979981d19c91"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:12.555652 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.555603    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f802d0-1534-4cd9-ac25-979981d19c91-kube-api-access-q7frb" (OuterVolumeSpecName: "kube-api-access-q7frb") pod "75f802d0-1534-4cd9-ac25-979981d19c91" (UID: "75f802d0-1534-4cd9-ac25-979981d19c91"). InnerVolumeSpecName "kube-api-access-q7frb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:12.555877 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.555687    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-dshm" (OuterVolumeSpecName: "dshm") pod "75f802d0-1534-4cd9-ac25-979981d19c91" (UID: "75f802d0-1534-4cd9-ac25-979981d19c91"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:12.556062 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.556022    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f802d0-1534-4cd9-ac25-979981d19c91-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "75f802d0-1534-4cd9-ac25-979981d19c91" (UID: "75f802d0-1534-4cd9-ac25-979981d19c91"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:59:12.654966 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.654932    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-home\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:12.654966 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.654959    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75f802d0-1534-4cd9-ac25-979981d19c91-dshm\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:12.655178 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.654989    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7frb\" (UniqueName: \"kubernetes.io/projected/75f802d0-1534-4cd9-ac25-979981d19c91-kube-api-access-q7frb\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:12.655178 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:12.654998    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f802d0-1534-4cd9-ac25-979981d19c91-tls-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:13.049130 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:13.049096    2563 generic.go:356] "Generic (PLEG): container finished" podID="75f802d0-1534-4cd9-ac25-979981d19c91" containerID="3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f" exitCode=0
Sep 17 17:59:13.049321 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:13.049159    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"
Sep 17 17:59:13.049321 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:13.049184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr" event={"ID":"75f802d0-1534-4cd9-ac25-979981d19c91","Type":"ContainerDied","Data":"3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f"}
Sep 17 17:59:13.049321 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:13.049232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr" event={"ID":"75f802d0-1534-4cd9-ac25-979981d19c91","Type":"ContainerDied","Data":"6ccb0b3739dc5ffe31333e1a82b822edf9cc33becfc3edf6ca5b16fcad92243c"}
Sep 17 17:59:13.049321 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:13.049252    2563 scope.go:117] "RemoveContainer" containerID="3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f"
Sep 17 17:59:13.058872 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:13.058853    2563 scope.go:117] "RemoveContainer" containerID="3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f"
Sep 17 17:59:13.059165 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:59:13.059141    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f\": container with ID starting with 3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f not found: ID does not exist" containerID="3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f"
Sep 17 17:59:13.059215 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:13.059175    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f"} err="failed to get container status \"3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f\": rpc error: code = NotFound desc = could not find container \"3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f\": container with ID starting with 3b0094c7a7cfb5ef4464cc632e5b0ca7b7edd2a96998ca2e20bcf1eb3a35792f not found: ID does not exist"
Sep 17 17:59:13.071630 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:13.071607    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"]
Sep 17 17:59:13.079453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:13.079431    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-8aeea1/distinct-2-w4-8aeea1-kserve-74d4f97699-6tgmr"]
Sep 17 17:59:13.618795 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:13.618764    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75f802d0-1534-4cd9-ac25-979981d19c91" path="/var/lib/kubelet/pods/75f802d0-1534-4cd9-ac25-979981d19c91/volumes"
Sep 17 17:59:14.913294 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:14.913265    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"]
Sep 17 17:59:14.913673 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:14.913476    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy" containerID="cri-o://4b0675a746b25e8518fa3ded5ba430e2129d096330006d0abb5f521723c618b7" gracePeriod=30
Sep 17 17:59:17.464453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.464429    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:59:17.500008 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.499948    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istiod-ca-cert\") pod \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") "
Sep 17 17:59:17.500008 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.499981    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-certs\") pod \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") "
Sep 17 17:59:17.500008 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500000    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pjsz\" (UniqueName: \"kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-kube-api-access-4pjsz\") pod \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") "
Sep 17 17:59:17.500265 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500031    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-token\") pod \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") "
Sep 17 17:59:17.500265 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500064    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-data\") pod \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") "
Sep 17 17:59:17.500265 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500080    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-podinfo\") pod \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") "
Sep 17 17:59:17.500265 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500095    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-envoy\") pod \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") "
Sep 17 17:59:17.500265 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500145    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-credential-socket\") pod \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") "
Sep 17 17:59:17.500265 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500231    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-socket\") pod \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\" (UID: \"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82\") "
Sep 17 17:59:17.500265 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500227    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" (UID: "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:17.500614 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500389    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" (UID: "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:17.500614 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500516    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" (UID: "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:17.500739 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500607    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" (UID: "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:17.500739 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500630    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:17.500739 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500650    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:17.500739 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500665    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:17.500739 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.500728    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" (UID: "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:17.503492 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.502675    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" (UID: "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:59:17.503492 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.502770    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" (UID: "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:17.503492 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.503338    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" (UID: "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:17.503492 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.503441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-kube-api-access-4pjsz" (OuterVolumeSpecName: "kube-api-access-4pjsz") pod "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" (UID: "1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82"). InnerVolumeSpecName "kube-api-access-4pjsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:17.601961 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.601929    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:17.601961 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.601955    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pjsz\" (UniqueName: \"kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-kube-api-access-4pjsz\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:17.601961 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.601968    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:17.602194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.601976    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:17.602194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.601985    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:17.602194 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:17.601993    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:18.078507 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.078470    2563 generic.go:356] "Generic (PLEG): container finished" podID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerID="2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635" exitCode=0
Sep 17 17:59:18.078679 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.078530    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"
Sep 17 17:59:18.078679 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.078557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" event={"ID":"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82","Type":"ContainerDied","Data":"2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635"}
Sep 17 17:59:18.078679 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.078638    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm" event={"ID":"1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82","Type":"ContainerDied","Data":"042a747a299e87dc16132181611b48566baba36e332170be1477beb0ca493f22"}
Sep 17 17:59:18.078679 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.078662    2563 scope.go:117] "RemoveContainer" containerID="2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635"
Sep 17 17:59:18.087499 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.087483    2563 scope.go:117] "RemoveContainer" containerID="5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec"
Sep 17 17:59:18.095572 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.095556    2563 scope.go:117] "RemoveContainer" containerID="2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635"
Sep 17 17:59:18.095856 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:59:18.095835    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635\": container with ID starting with 2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635 not found: ID does not exist" containerID="2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635"
Sep 17 17:59:18.095925 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.095864    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635"} err="failed to get container status \"2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635\": rpc error: code = NotFound desc = could not find container \"2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635\": container with ID starting with 2aeeca5a8a8f3d79a71c20dd36fe010751e213246134a6842609979d1b29c635 not found: ID does not exist"
Sep 17 17:59:18.095925 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.095882    2563 scope.go:117] "RemoveContainer" containerID="5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec"
Sep 17 17:59:18.096144 ip-10-0-131-245 kubenswrapper[2563]: E0917 17:59:18.096127    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec\": container with ID starting with 5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec not found: ID does not exist" containerID="5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec"
Sep 17 17:59:18.096182 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.096149    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec"} err="failed to get container status \"5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec\": rpc error: code = NotFound desc = could not find container \"5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec\": container with ID starting with 5b9008fdf712f01adcc7c0e89f0b416755776ce60d48723999299cc5c10e7fec not found: ID does not exist"
Sep 17 17:59:18.120410 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.120381    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"]
Sep 17 17:59:18.131626 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.131599    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ef41f8-openshift-default-798b746c9b-tcbbm"]
Sep 17 17:59:18.952787 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.952754    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 17:59:18.953139 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:18.952806    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:59:19.614397 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:19.614364    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" path="/var/lib/kubelet/pods/1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82/volumes"
Sep 17 17:59:20.093187 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.093160    2563 generic.go:356] "Generic (PLEG): container finished" podID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerID="4b0675a746b25e8518fa3ded5ba430e2129d096330006d0abb5f521723c618b7" exitCode=0
Sep 17 17:59:20.093566 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.093238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" event={"ID":"1a3e3975-eddf-4feb-8285-38aa901ccb71","Type":"ContainerDied","Data":"4b0675a746b25e8518fa3ded5ba430e2129d096330006d0abb5f521723c618b7"}
Sep 17 17:59:20.093566 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.093327    2563 scope.go:117] "RemoveContainer" containerID="8f3798f9f90199f95943959b76faec18155a9216dd5f74e204e655a46eb8819a"
Sep 17 17:59:20.158491 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.158467    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:59:20.226008 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.225932    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-certs\") pod \"1a3e3975-eddf-4feb-8285-38aa901ccb71\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") "
Sep 17 17:59:20.226008 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.225963    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-data\") pod \"1a3e3975-eddf-4feb-8285-38aa901ccb71\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") "
Sep 17 17:59:20.226008 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.225984    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-envoy\") pod \"1a3e3975-eddf-4feb-8285-38aa901ccb71\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") "
Sep 17 17:59:20.226254 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226028    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvwkr\" (UniqueName: \"kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-kube-api-access-zvwkr\") pod \"1a3e3975-eddf-4feb-8285-38aa901ccb71\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") "
Sep 17 17:59:20.226254 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226065    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-token\") pod \"1a3e3975-eddf-4feb-8285-38aa901ccb71\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") "
Sep 17 17:59:20.226254 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226100    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a3e3975-eddf-4feb-8285-38aa901ccb71-istiod-ca-cert\") pod \"1a3e3975-eddf-4feb-8285-38aa901ccb71\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") "
Sep 17 17:59:20.226254 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226124    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-socket\") pod \"1a3e3975-eddf-4feb-8285-38aa901ccb71\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") "
Sep 17 17:59:20.226254 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226185    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-podinfo\") pod \"1a3e3975-eddf-4feb-8285-38aa901ccb71\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") "
Sep 17 17:59:20.226254 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226223    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-credential-socket\") pod \"1a3e3975-eddf-4feb-8285-38aa901ccb71\" (UID: \"1a3e3975-eddf-4feb-8285-38aa901ccb71\") "
Sep 17 17:59:20.226579 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226262    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a3e3975-eddf-4feb-8285-38aa901ccb71" (UID: "1a3e3975-eddf-4feb-8285-38aa901ccb71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:20.226579 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226323    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a3e3975-eddf-4feb-8285-38aa901ccb71" (UID: "1a3e3975-eddf-4feb-8285-38aa901ccb71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:20.226579 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226532    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a3e3975-eddf-4feb-8285-38aa901ccb71" (UID: "1a3e3975-eddf-4feb-8285-38aa901ccb71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:20.226778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226625    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a3e3975-eddf-4feb-8285-38aa901ccb71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a3e3975-eddf-4feb-8285-38aa901ccb71" (UID: "1a3e3975-eddf-4feb-8285-38aa901ccb71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:20.226778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226638    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:20.226778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226658    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:20.226778 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226670    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:20.226990 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.226915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a3e3975-eddf-4feb-8285-38aa901ccb71" (UID: "1a3e3975-eddf-4feb-8285-38aa901ccb71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:20.228827 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.228800    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a3e3975-eddf-4feb-8285-38aa901ccb71" (UID: "1a3e3975-eddf-4feb-8285-38aa901ccb71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:20.229025 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.229004    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a3e3975-eddf-4feb-8285-38aa901ccb71" (UID: "1a3e3975-eddf-4feb-8285-38aa901ccb71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 17:59:20.229130 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.229097    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-kube-api-access-zvwkr" (OuterVolumeSpecName: "kube-api-access-zvwkr") pod "1a3e3975-eddf-4feb-8285-38aa901ccb71" (UID: "1a3e3975-eddf-4feb-8285-38aa901ccb71"). InnerVolumeSpecName "kube-api-access-zvwkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:20.229130 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.229104    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a3e3975-eddf-4feb-8285-38aa901ccb71" (UID: "1a3e3975-eddf-4feb-8285-38aa901ccb71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:20.327185 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.327146    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvwkr\" (UniqueName: \"kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-kube-api-access-zvwkr\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:20.327185 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.327180    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:20.327185 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.327190    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a3e3975-eddf-4feb-8285-38aa901ccb71-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:20.327185 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.327198    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:20.327453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.327206    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:20.327453 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:20.327215    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a3e3975-eddf-4feb-8285-38aa901ccb71-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 17:59:21.100104 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:21.100079    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"
Sep 17 17:59:21.100537 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:21.100105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx" event={"ID":"1a3e3975-eddf-4feb-8285-38aa901ccb71","Type":"ContainerDied","Data":"f785c4d5bbd43ad1a530b8c6cf6b9ec6b6e6df6ee33be6de1f3d710805fb2ee5"}
Sep 17 17:59:21.100537 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:21.100160    2563 scope.go:117] "RemoveContainer" containerID="4b0675a746b25e8518fa3ded5ba430e2129d096330006d0abb5f521723c618b7"
Sep 17 17:59:21.144487 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:21.144461    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"]
Sep 17 17:59:21.154958 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:21.154933    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-8aeea1-openshift-default-d898d55d-kltlx"]
Sep 17 17:59:21.613961 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:21.613928    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" path="/var/lib/kubelet/pods/1a3e3975-eddf-4feb-8285-38aa901ccb71/volumes"
Sep 17 17:59:22.367505 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:22.367476    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:59:34.170858 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:34.170781    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 17:59:56.964446 ip-10-0-131-245 kubenswrapper[2563]: I0917 17:59:56.964405    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:00:00.151269 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151232    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc"]
Sep 17 18:00:00.151651 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151632    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f802d0-1534-4cd9-ac25-979981d19c91" containerName="main"
Sep 17 18:00:00.151651 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151643    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f802d0-1534-4cd9-ac25-979981d19c91" containerName="main"
Sep 17 18:00:00.151651 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151653    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151658    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151664    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151671    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151676    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151682    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151688    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151693    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151715    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151721    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151727    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9e39543-66f2-4fc1-96b4-93bbbb15f92a" containerName="maas-api"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151732    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9e39543-66f2-4fc1-96b4-93bbbb15f92a" containerName="maas-api"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151741    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fce659e-069a-4163-997e-55cd799c2a74" containerName="main"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151746    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fce659e-069a-4163-997e-55cd799c2a74" containerName="main"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151754    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151759    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151771    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd639a0-cd56-4fed-a0b0-4ed9279f06fb" containerName="maas-api"
Sep 17 18:00:00.151772 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151776    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd639a0-cd56-4fed-a0b0-4ed9279f06fb" containerName="maas-api"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151785    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151790    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151797    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151802    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151808    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151812    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151817    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151823    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151829    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151834    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151842    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c276e87a-0710-49bd-a09d-fdb30361eb0a" containerName="maas-api"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151847    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c276e87a-0710-49bd-a09d-fdb30361eb0a" containerName="maas-api"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151854    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151859    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151917    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151923    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151930    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd639a0-cd56-4fed-a0b0-4ed9279f06fb" containerName="maas-api"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151936    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9adc4faa-3182-4939-9e46-e7754461f9ac" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151941    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c276e87a-0710-49bd-a09d-fdb30361eb0a" containerName="maas-api"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151946    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151951    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a3e3975-eddf-4feb-8285-38aa901ccb71" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151956    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="75f802d0-1534-4cd9-ac25-979981d19c91" containerName="main"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151961    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fce659e-069a-4163-997e-55cd799c2a74" containerName="main"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151965    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151969    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151979    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d56efb7-0dbb-4cb1-a50c-b497e2e4fa82" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151984    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9e39543-66f2-4fc1-96b4-93bbbb15f92a" containerName="maas-api"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151990    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy"
Sep 17 18:00:00.152284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.151996    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ad60a08-e817-4118-8d0d-955d2bf63893" containerName="istio-proxy"
Sep 17 18:00:00.155416 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.155400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc"
Sep 17 18:00:00.158171 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.158146    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 18:00:00.165028 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.165011    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc"
Sep 17 18:00:00.169460 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.169437    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc"]
Sep 17 18:00:00.442588 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:00.442561    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc"]
Sep 17 18:00:00.447954 ip-10-0-131-245 kubenswrapper[2563]: W0917 18:00:00.447927    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a498add_8736_4f40_aa35_a6ec3322fe3a.slice/crio-502af87ce826dd7cfbe23b3ec7f7316bee9512ec41419616dbbf8aa18082444e WatchSource:0}: Error finding container 502af87ce826dd7cfbe23b3ec7f7316bee9512ec41419616dbbf8aa18082444e: Status 404 returned error can't find the container with id 502af87ce826dd7cfbe23b3ec7f7316bee9512ec41419616dbbf8aa18082444e
Sep 17 18:00:01.304776 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:01.304743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc" event={"ID":"8a498add-8736-4f40-aa35-a6ec3322fe3a","Type":"ContainerStarted","Data":"ef2d125b84a673b80090a7d999d6cfd2d92b50c5eb3d34da5cb7eb6bd2d17245"}
Sep 17 18:00:01.305215 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:01.304804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc" event={"ID":"8a498add-8736-4f40-aa35-a6ec3322fe3a","Type":"ContainerStarted","Data":"502af87ce826dd7cfbe23b3ec7f7316bee9512ec41419616dbbf8aa18082444e"}
Sep 17 18:00:02.312105 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:02.312070    2563 generic.go:356] "Generic (PLEG): container finished" podID="8a498add-8736-4f40-aa35-a6ec3322fe3a" containerID="ef2d125b84a673b80090a7d999d6cfd2d92b50c5eb3d34da5cb7eb6bd2d17245" exitCode=0
Sep 17 18:00:02.312502 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:02.312158    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc" event={"ID":"8a498add-8736-4f40-aa35-a6ec3322fe3a","Type":"ContainerDied","Data":"ef2d125b84a673b80090a7d999d6cfd2d92b50c5eb3d34da5cb7eb6bd2d17245"}
Sep 17 18:00:03.453271 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:03.453242    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc"
Sep 17 18:00:04.325355 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:04.325327    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc"
Sep 17 18:00:04.325555 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:04.325326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc" event={"ID":"8a498add-8736-4f40-aa35-a6ec3322fe3a","Type":"ContainerDied","Data":"502af87ce826dd7cfbe23b3ec7f7316bee9512ec41419616dbbf8aa18082444e"}
Sep 17 18:00:04.325555 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:04.325451    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="502af87ce826dd7cfbe23b3ec7f7316bee9512ec41419616dbbf8aa18082444e"
Sep 17 18:00:19.256915 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:19.256879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:00:33.529466 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:33.529429    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:00:46.539489 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:00:46.539454    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:01:00.924281 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:00.924205    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:01:06.216183 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.216150    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"]
Sep 17 18:01:06.216609 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.216573    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a498add-8736-4f40-aa35-a6ec3322fe3a" containerName="cleanup"
Sep 17 18:01:06.216609 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.216586    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a498add-8736-4f40-aa35-a6ec3322fe3a" containerName="cleanup"
Sep 17 18:01:06.216682 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.216656    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a498add-8736-4f40-aa35-a6ec3322fe3a" containerName="cleanup"
Sep 17 18:01:06.216682 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.216664    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5a845e-b21f-4b2e-ad0d-08b9ec523e00" containerName="istio-proxy"
Sep 17 18:01:06.216682 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.216671    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="286e0433-ebbd-4907-8118-bc896b32d290" containerName="istio-proxy"
Sep 17 18:01:06.219928 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.219911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.222597 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.222574    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-abb363\"/\"rate-test-model-abb363-kserve-self-signed-certs\""
Sep 17 18:01:06.223118 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.223096    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-abb363\"/\"kube-root-ca.crt\""
Sep 17 18:01:06.223324 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.223307    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-abb363\"/\"default-dockercfg-k9lpm\""
Sep 17 18:01:06.223792 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.223779    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-abb363\"/\"openshift-service-ca.crt\""
Sep 17 18:01:06.243669 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.243648    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"]
Sep 17 18:01:06.340773 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.340737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-dshm\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.340947 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.340782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-tmp-dir\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.340947 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.340815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-model-cache\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.340947 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.340860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c13c3e8c-adb3-4b43-8811-302e070d985a-tls-certs\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.340947 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.340929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-home\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.341092 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.340957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x78g\" (UniqueName: \"kubernetes.io/projected/c13c3e8c-adb3-4b43-8811-302e070d985a-kube-api-access-5x78g\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.441528 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.441491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-dshm\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.441766 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.441543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-tmp-dir\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.441766 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.441584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-model-cache\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.441766 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.441641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c13c3e8c-adb3-4b43-8811-302e070d985a-tls-certs\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.441766 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.441731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-home\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.441766 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.441758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x78g\" (UniqueName: \"kubernetes.io/projected/c13c3e8c-adb3-4b43-8811-302e070d985a-kube-api-access-5x78g\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.442052 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.441972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-tmp-dir\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.442052 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.442009    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-model-cache\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.442052 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.442039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-home\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.443811 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.443787    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-dshm\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.444066 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.444050    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c13c3e8c-adb3-4b43-8811-302e070d985a-tls-certs\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.450830 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.450808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x78g\" (UniqueName: \"kubernetes.io/projected/c13c3e8c-adb3-4b43-8811-302e070d985a-kube-api-access-5x78g\") pod \"rate-test-model-abb363-kserve-f6554577f-pbl29\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") " pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.529328 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.529299    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:06.804219 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:06.804194    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"]
Sep 17 18:01:06.805910 ip-10-0-131-245 kubenswrapper[2563]: W0917 18:01:06.805879    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc13c3e8c_adb3_4b43_8811_302e070d985a.slice/crio-5c4f09d5885c06375cb181fb9b665ab05753390a13749e29258616185bcfd3c8 WatchSource:0}: Error finding container 5c4f09d5885c06375cb181fb9b665ab05753390a13749e29258616185bcfd3c8: Status 404 returned error can't find the container with id 5c4f09d5885c06375cb181fb9b665ab05753390a13749e29258616185bcfd3c8
Sep 17 18:01:07.664555 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:07.664524    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29" event={"ID":"c13c3e8c-adb3-4b43-8811-302e070d985a","Type":"ContainerStarted","Data":"08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291"}
Sep 17 18:01:07.664955 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:07.664563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29" event={"ID":"c13c3e8c-adb3-4b43-8811-302e070d985a","Type":"ContainerStarted","Data":"5c4f09d5885c06375cb181fb9b665ab05753390a13749e29258616185bcfd3c8"}
Sep 17 18:01:07.686037 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:07.685995    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29" podStartSLOduration=1.685978406 podStartE2EDuration="1.685978406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:01:07.685102689 +0000 UTC m=+1794.336008680" watchObservedRunningTime="2026-09-17 18:01:07.685978406 +0000 UTC m=+1794.336884399"
Sep 17 18:01:10.465976 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:10.465946    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:01:15.808983 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:15.808951    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 18:01:15.812873 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:15.812845    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 18:01:15.818367 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:15.818348    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 18:01:15.822107 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:15.822093    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 18:01:16.529782 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:16.529750    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:16.529977 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:16.529814    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:16.542139 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:16.542117    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:16.720994 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:16.720960    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:01:50.843823 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:01:50.843770    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:02:10.774206 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:10.774167    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:02:19.727686 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:19.727656    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:02:24.719248 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:24.719216    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"]
Sep 17 18:02:26.586673 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.586639    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"]
Sep 17 18:02:26.590279 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.590263    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.593443 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.593419    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-dba35d-openshift-default-dockercfg-8b56f\""
Sep 17 18:02:26.624297 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.624270    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"]
Sep 17 18:02:26.688437 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.688386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vklwc\" (UniqueName: \"kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-kube-api-access-vklwc\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.688691 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.688489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-data\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.688691 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.688531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-certs\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.688691 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.688557    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-podinfo\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.688691 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.688610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-credential-socket\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.688691 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.688633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-token\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.688691 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.688661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-socket\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.689250 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.688722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-envoy\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.689250 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.688841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c5ba574-e024-498e-99ce-6b20f924d1a2-istiod-ca-cert\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790007 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.789973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-certs\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790007 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-podinfo\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790254 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-credential-socket\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790254 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-token\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790254 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-socket\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790254 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-envoy\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790507 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790273    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c5ba574-e024-498e-99ce-6b20f924d1a2-istiod-ca-cert\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790507 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vklwc\" (UniqueName: \"kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-kube-api-access-vklwc\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790507 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-data\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790507 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-certs\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790753 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-socket\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790753 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-credential-socket\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.790884 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-data\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.791001 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.790980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c5ba574-e024-498e-99ce-6b20f924d1a2-istiod-ca-cert\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.792450 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.792429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-envoy\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.792575 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.792555    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-podinfo\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.805432 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.805408    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vklwc\" (UniqueName: \"kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-kube-api-access-vklwc\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.805520 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.805480    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-token\") pod \"e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") " pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:26.900664 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:26.900604    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:27.175980 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:27.175957    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"]
Sep 17 18:02:27.177918 ip-10-0-131-245 kubenswrapper[2563]: W0917 18:02:27.177893    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5ba574_e024_498e_99ce_6b20f924d1a2.slice/crio-bb6f72de80ee792a76273ea4efd2b31938560dc557eff29bd2a74c19546d146d WatchSource:0}: Error finding container bb6f72de80ee792a76273ea4efd2b31938560dc557eff29bd2a74c19546d146d: Status 404 returned error can't find the container with id bb6f72de80ee792a76273ea4efd2b31938560dc557eff29bd2a74c19546d146d
Sep 17 18:02:27.180002 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:27.179963    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:02:27.180081 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:27.180057    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:02:27.180120 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:27.180093    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:02:28.087867 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:28.087832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" event={"ID":"2c5ba574-e024-498e-99ce-6b20f924d1a2","Type":"ContainerStarted","Data":"56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878"}
Sep 17 18:02:28.088261 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:28.087894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" event={"ID":"2c5ba574-e024-498e-99ce-6b20f924d1a2","Type":"ContainerStarted","Data":"bb6f72de80ee792a76273ea4efd2b31938560dc557eff29bd2a74c19546d146d"}
Sep 17 18:02:28.111829 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:28.111496    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" podStartSLOduration=2.1114770800000002 podStartE2EDuration="2.11147708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:02:28.111287119 +0000 UTC m=+1874.762193147" watchObservedRunningTime="2026-09-17 18:02:28.11147708 +0000 UTC m=+1874.762383071"
Sep 17 18:02:28.901059 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:28.901026    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:28.905992 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:28.905964    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:29.093419 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:29.093392    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:29.094228 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:29.094205    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:30.153510 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:30.153475    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:02:39.738350 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:39.738278    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29" podUID="c13c3e8c-adb3-4b43-8811-302e070d985a" containerName="main" containerID="cri-o://08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291" gracePeriod=45
Sep 17 18:02:40.022204 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.022177    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:02:40.122318 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.122280    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x78g\" (UniqueName: \"kubernetes.io/projected/c13c3e8c-adb3-4b43-8811-302e070d985a-kube-api-access-5x78g\") pod \"c13c3e8c-adb3-4b43-8811-302e070d985a\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") "
Sep 17 18:02:40.122509 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.122350    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-tmp-dir\") pod \"c13c3e8c-adb3-4b43-8811-302e070d985a\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") "
Sep 17 18:02:40.122509 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.122384    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-dshm\") pod \"c13c3e8c-adb3-4b43-8811-302e070d985a\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") "
Sep 17 18:02:40.122509 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.122400    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-home\") pod \"c13c3e8c-adb3-4b43-8811-302e070d985a\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") "
Sep 17 18:02:40.122509 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.122430    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c13c3e8c-adb3-4b43-8811-302e070d985a-tls-certs\") pod \"c13c3e8c-adb3-4b43-8811-302e070d985a\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") "
Sep 17 18:02:40.122509 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.122469    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-model-cache\") pod \"c13c3e8c-adb3-4b43-8811-302e070d985a\" (UID: \"c13c3e8c-adb3-4b43-8811-302e070d985a\") "
Sep 17 18:02:40.122813 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.122620    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-home" (OuterVolumeSpecName: "home") pod "c13c3e8c-adb3-4b43-8811-302e070d985a" (UID: "c13c3e8c-adb3-4b43-8811-302e070d985a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:02:40.122813 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.122661    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c13c3e8c-adb3-4b43-8811-302e070d985a" (UID: "c13c3e8c-adb3-4b43-8811-302e070d985a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:02:40.122933 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.122818    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-tmp-dir\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:02:40.122933 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.122832    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-home\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:02:40.122933 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.122844    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-model-cache" (OuterVolumeSpecName: "model-cache") pod "c13c3e8c-adb3-4b43-8811-302e070d985a" (UID: "c13c3e8c-adb3-4b43-8811-302e070d985a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:02:40.124608 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.124587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-dshm" (OuterVolumeSpecName: "dshm") pod "c13c3e8c-adb3-4b43-8811-302e070d985a" (UID: "c13c3e8c-adb3-4b43-8811-302e070d985a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:02:40.124684 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.124647    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c13c3e8c-adb3-4b43-8811-302e070d985a-kube-api-access-5x78g" (OuterVolumeSpecName: "kube-api-access-5x78g") pod "c13c3e8c-adb3-4b43-8811-302e070d985a" (UID: "c13c3e8c-adb3-4b43-8811-302e070d985a"). InnerVolumeSpecName "kube-api-access-5x78g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:02:40.124747 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.124687    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c13c3e8c-adb3-4b43-8811-302e070d985a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c13c3e8c-adb3-4b43-8811-302e070d985a" (UID: "c13c3e8c-adb3-4b43-8811-302e070d985a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:02:40.151382 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.151351    2563 generic.go:356] "Generic (PLEG): container finished" podID="c13c3e8c-adb3-4b43-8811-302e070d985a" containerID="08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291" exitCode=0
Sep 17 18:02:40.151514 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.151382    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29" event={"ID":"c13c3e8c-adb3-4b43-8811-302e070d985a","Type":"ContainerDied","Data":"08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291"}
Sep 17 18:02:40.151514 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.151408    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"
Sep 17 18:02:40.151514 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.151435    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29" event={"ID":"c13c3e8c-adb3-4b43-8811-302e070d985a","Type":"ContainerDied","Data":"5c4f09d5885c06375cb181fb9b665ab05753390a13749e29258616185bcfd3c8"}
Sep 17 18:02:40.151514 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.151462    2563 scope.go:117] "RemoveContainer" containerID="08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291"
Sep 17 18:02:40.164923 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.164898    2563 scope.go:117] "RemoveContainer" containerID="08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291"
Sep 17 18:02:40.165470 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:02:40.165316    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291\": container with ID starting with 08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291 not found: ID does not exist" containerID="08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291"
Sep 17 18:02:40.165470 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.165354    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291"} err="failed to get container status \"08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291\": rpc error: code = NotFound desc = could not find container \"08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291\": container with ID starting with 08011b4ceecd2cd6aaf92e080e283cb2496c3ec8227adf05a15c94c81b535291 not found: ID does not exist"
Sep 17 18:02:40.180220 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.180195    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"]
Sep 17 18:02:40.199732 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.184340    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-abb363/rate-test-model-abb363-kserve-f6554577f-pbl29"]
Sep 17 18:02:40.223588 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.223557    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-dshm\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:02:40.223719 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.223602    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c13c3e8c-adb3-4b43-8811-302e070d985a-tls-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:02:40.223719 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.223612    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c13c3e8c-adb3-4b43-8811-302e070d985a-model-cache\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:02:40.223719 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:40.223621    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x78g\" (UniqueName: \"kubernetes.io/projected/c13c3e8c-adb3-4b43-8811-302e070d985a-kube-api-access-5x78g\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:02:41.615478 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:41.615443    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c13c3e8c-adb3-4b43-8811-302e070d985a" path="/var/lib/kubelet/pods/c13c3e8c-adb3-4b43-8811-302e070d985a/volumes"
Sep 17 18:02:42.256172 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:42.256134    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:02:45.135861 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:45.135824    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 18:02:45.136221 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:45.135907    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 18:02:46.186500 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:46.186459    2563 generic.go:356] "Generic (PLEG): container finished" podID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerID="56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878" exitCode=0
Sep 17 18:02:46.187083 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:46.186536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" event={"ID":"2c5ba574-e024-498e-99ce-6b20f924d1a2","Type":"ContainerDied","Data":"56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878"}
Sep 17 18:02:46.187083 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:46.187004    2563 scope.go:117] "RemoveContainer" containerID="56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878"
Sep 17 18:02:46.188133 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:46.188103    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:02:46.188244 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:46.188191    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:02:46.188297 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:46.188241    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:02:47.198726 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:47.198667    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" event={"ID":"2c5ba574-e024-498e-99ce-6b20f924d1a2","Type":"ContainerStarted","Data":"765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341"}
Sep 17 18:02:47.901645 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:47.901611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:47.902044 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:47.902017    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 17 18:02:47.902282 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:47.902237    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 17 18:02:48.901809 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:48.901340    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 17 18:02:48.901809 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:48.901403    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 17 18:02:49.901826 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:49.901779    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 17 18:02:49.902320 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:49.901861    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 17 18:02:50.901756 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:50.901693    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 17 18:02:50.901967 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:50.901793    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 17 18:02:51.906437 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:51.906405    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 17 18:02:51.907012 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:51.906974    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 17 18:02:52.904828 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:52.904797    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:52.905162 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:52.905144    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:52.905774 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:52.905758    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:02:56.409317 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.409284    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"]
Sep 17 18:02:56.409802 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.409714    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c13c3e8c-adb3-4b43-8811-302e070d985a" containerName="main"
Sep 17 18:02:56.409802 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.409726    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c13c3e8c-adb3-4b43-8811-302e070d985a" containerName="main"
Sep 17 18:02:56.409886 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.409810    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c13c3e8c-adb3-4b43-8811-302e070d985a" containerName="main"
Sep 17 18:02:56.412153 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.412138    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.417857 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.417835    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-b77ab2-openshift-default-dockercfg-nq76z\""
Sep 17 18:02:56.486820 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.486787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-credential-socket\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.486979 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.486853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26feed43-c33e-45ae-a560-0411173648d4-istiod-ca-cert\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.486979 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.486913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-envoy\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.487083 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.486988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26feed43-c33e-45ae-a560-0411173648d4-istio-podinfo\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.487083 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.487069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-certs\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.487167 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.487133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-data\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.487167 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.487158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-socket\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.487263 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.487175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-istio-token\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.487263 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.487201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpjhg\" (UniqueName: \"kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-kube-api-access-cpjhg\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.539058 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.539019    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"]
Sep 17 18:02:56.588547 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.588511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26feed43-c33e-45ae-a560-0411173648d4-istio-podinfo\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.588736 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.588582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-certs\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.588736 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.588629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-data\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.588736 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.588656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-socket\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.588736 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.588681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-istio-token\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.589044 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.588747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjhg\" (UniqueName: \"kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-kube-api-access-cpjhg\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.589044 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.589027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-credential-socket\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.589166 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.589056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-data\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.589166 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.589073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-certs\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.589166 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.589097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26feed43-c33e-45ae-a560-0411173648d4-istiod-ca-cert\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.589166 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.589130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-envoy\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.589326 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.589153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-socket\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.589326 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.589287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-credential-socket\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.589820 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.589792    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26feed43-c33e-45ae-a560-0411173648d4-istiod-ca-cert\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.591172 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.591153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-envoy\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.591266 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.591177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26feed43-c33e-45ae-a560-0411173648d4-istio-podinfo\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.609111 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.609088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-istio-token\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.620426 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.620397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpjhg\" (UniqueName: \"kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-kube-api-access-cpjhg\") pod \"e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") " pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:56.724470 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:56.724390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:57.150901 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:57.150869    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"]
Sep 17 18:02:57.175072 ip-10-0-131-245 kubenswrapper[2563]: W0917 18:02:57.175046    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26feed43_c33e_45ae_a560_0411173648d4.slice/crio-d1e8126573c2d1c38356d8ed56004876a32ad8287cd40e52ee69842f3ab6c91e WatchSource:0}: Error finding container d1e8126573c2d1c38356d8ed56004876a32ad8287cd40e52ee69842f3ab6c91e: Status 404 returned error can't find the container with id d1e8126573c2d1c38356d8ed56004876a32ad8287cd40e52ee69842f3ab6c91e
Sep 17 18:02:57.177230 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:57.177198    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:02:57.177305 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:57.177265    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:02:57.177305 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:57.177297    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:02:57.262412 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:57.262372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" event={"ID":"26feed43-c33e-45ae-a560-0411173648d4","Type":"ContainerStarted","Data":"151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4"}
Sep 17 18:02:57.262573 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:57.262447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" event={"ID":"26feed43-c33e-45ae-a560-0411173648d4","Type":"ContainerStarted","Data":"d1e8126573c2d1c38356d8ed56004876a32ad8287cd40e52ee69842f3ab6c91e"}
Sep 17 18:02:57.318340 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:57.318273    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" podStartSLOduration=1.318252679 podStartE2EDuration="1.318252679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:02:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:02:57.314018878 +0000 UTC m=+1903.964924871" watchObservedRunningTime="2026-09-17 18:02:57.318252679 +0000 UTC m=+1903.969158672"
Sep 17 18:02:57.724698 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:57.724668    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:58.729554 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:58.729524    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:59.273521 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:59.273486    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:02:59.274547 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:02:59.274527    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:03:02.385745 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.385682    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"]
Sep 17 18:03:02.389177 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.389155    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.398250 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.398226    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-b77ab2-serving-cert\""
Sep 17 18:03:02.423968 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.423937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"]
Sep 17 18:03:02.552802 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.552773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj5vw\" (UniqueName: \"kubernetes.io/projected/e6c76aa8-9cb0-4025-a319-37a586af2605-kube-api-access-wj5vw\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.552996 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.552852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-metrics-certs\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.552996 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.552871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.552996 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.552930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c76aa8-9cb0-4025-a319-37a586af2605-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.654041 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.653945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-metrics-certs\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.654041 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.653982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.654041 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.654035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c76aa8-9cb0-4025-a319-37a586af2605-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.654356 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.654065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj5vw\" (UniqueName: \"kubernetes.io/projected/e6c76aa8-9cb0-4025-a319-37a586af2605-kube-api-access-wj5vw\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.654804 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.654783    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c76aa8-9cb0-4025-a319-37a586af2605-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.656534 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.656500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.656628 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.656570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-metrics-certs\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.673861 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.673833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj5vw\" (UniqueName: \"kubernetes.io/projected/e6c76aa8-9cb0-4025-a319-37a586af2605-kube-api-access-wj5vw\") pod \"maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.699807 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.699780    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:02.998441 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:02.998416    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"]
Sep 17 18:03:03.000728 ip-10-0-131-245 kubenswrapper[2563]: W0917 18:03:03.000689    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c76aa8_9cb0_4025_a319_37a586af2605.slice/crio-ba692af8f8c5dcde40940552a4559a94a0311cd1b839f108c36fd218eaddef8f WatchSource:0}: Error finding container ba692af8f8c5dcde40940552a4559a94a0311cd1b839f108c36fd218eaddef8f: Status 404 returned error can't find the container with id ba692af8f8c5dcde40940552a4559a94a0311cd1b839f108c36fd218eaddef8f
Sep 17 18:03:03.002267 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:03.002248    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 18:03:03.295649 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:03.295611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9" event={"ID":"e6c76aa8-9cb0-4025-a319-37a586af2605","Type":"ContainerStarted","Data":"ba692af8f8c5dcde40940552a4559a94a0311cd1b839f108c36fd218eaddef8f"}
Sep 17 18:03:04.302959 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:04.302925    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9" event={"ID":"e6c76aa8-9cb0-4025-a319-37a586af2605","Type":"ContainerStarted","Data":"8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d"}
Sep 17 18:03:04.303351 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:04.303053    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:04.353686 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:04.353628    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9" podStartSLOduration=2.007718722 podStartE2EDuration="2.353610789s" totalImagesPullingTime="345.892067ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:03:04.351240123 +0000 UTC m=+1911.002146114" watchObservedRunningTime="2026-09-17 18:03:04.353610789 +0000 UTC m=+1911.004516781"
Sep 17 18:03:07.225280 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:07.225240    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:03:10.314517 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:10.314487    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:03:18.387936 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:18.387901    2563 generic.go:356] "Generic (PLEG): container finished" podID="26feed43-c33e-45ae-a560-0411173648d4" containerID="151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4" exitCode=0
Sep 17 18:03:18.388297 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:18.387971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" event={"ID":"26feed43-c33e-45ae-a560-0411173648d4","Type":"ContainerDied","Data":"151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4"}
Sep 17 18:03:18.388365 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:18.388351    2563 scope.go:117] "RemoveContainer" containerID="151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4"
Sep 17 18:03:18.389519 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:18.389487    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:03:18.389577 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:18.389563    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:03:18.389614 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:18.389600    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:03:19.400040 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:19.399997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" event={"ID":"26feed43-c33e-45ae-a560-0411173648d4","Type":"ContainerStarted","Data":"10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1"}
Sep 17 18:03:19.724952 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:19.724863    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:03:19.725226 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:19.725202    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 17 18:03:19.725280 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:19.725260    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 17 18:03:20.725462 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:20.725420    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 17 18:03:20.725898 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:20.725489    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 17 18:03:21.724794 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:21.724758    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 17 18:03:21.724980 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:21.724815    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 17 18:03:22.725601 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:22.725559    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 17 18:03:22.726031 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:22.725621    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 17 18:03:23.725444 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:23.725407    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 17 18:03:23.725630 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:23.725464    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 17 18:03:24.729076 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:24.729042    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:03:24.729462 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:24.729357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:03:24.730142 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:24.730126    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:03:54.265018 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:03:54.264978    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:04:15.449239 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:15.449198    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:04:22.746530 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.746490    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"]
Sep 17 18:04:22.749890 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.749869    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.753363 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.753339    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-58f131-openshift-default-dockercfg-m6gkj\""
Sep 17 18:04:22.767284 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.767254    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"]
Sep 17 18:04:22.826548 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.826479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-credential-socket\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.826763 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.826567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-data\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.826763 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.826604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/010df205-b692-4547-8a40-d419392fa394-istiod-ca-cert\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.826763 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.826627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-certs\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.826763 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.826648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-envoy\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.826763 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.826715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-socket\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.827048 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.826777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/010df205-b692-4547-8a40-d419392fa394-istio-podinfo\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.827048 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.826819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-istio-token\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.827048 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.826844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bq46\" (UniqueName: \"kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-kube-api-access-4bq46\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.927421 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.927393    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-socket\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.927594 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.927445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/010df205-b692-4547-8a40-d419392fa394-istio-podinfo\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.927594 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.927482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-istio-token\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.927594 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.927498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bq46\" (UniqueName: \"kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-kube-api-access-4bq46\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.927594 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.927558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-credential-socket\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.927854 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.927619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-data\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.927854 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.927655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/010df205-b692-4547-8a40-d419392fa394-istiod-ca-cert\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.927854 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.927684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-certs\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.927854 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.927735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-envoy\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.928085 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.927873    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-socket\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.928410 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.928379    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-data\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.928529 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.928448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-credential-socket\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.928529 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.928497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/010df205-b692-4547-8a40-d419392fa394-istiod-ca-cert\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.928529 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.928509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-certs\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.930106 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.930088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-envoy\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.930162 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.930105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/010df205-b692-4547-8a40-d419392fa394-istio-podinfo\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.966623 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.966592    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-istio-token\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:22.966787 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:22.966755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bq46\" (UniqueName: \"kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-kube-api-access-4bq46\") pod \"e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") " pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:23.061780 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:23.061751    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:23.348982 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:23.348958    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"]
Sep 17 18:04:23.350753 ip-10-0-131-245 kubenswrapper[2563]: W0917 18:04:23.350727    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010df205_b692_4547_8a40_d419392fa394.slice/crio-8911c9c97abbaf731e135a1709bfd7f2c735c7907ee8ef6a786116106a46a535 WatchSource:0}: Error finding container 8911c9c97abbaf731e135a1709bfd7f2c735c7907ee8ef6a786116106a46a535: Status 404 returned error can't find the container with id 8911c9c97abbaf731e135a1709bfd7f2c735c7907ee8ef6a786116106a46a535
Sep 17 18:04:23.352995 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:23.352962    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:04:23.353068 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:23.353029    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:04:23.353068 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:23.353058    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:04:23.749240 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:23.749144    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" event={"ID":"010df205-b692-4547-8a40-d419392fa394","Type":"ContainerStarted","Data":"4c5d56d795404a88f19f88a3671b015f0b03c8b89b3b43d3ecadd62fcdab4651"}
Sep 17 18:04:23.749240 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:23.749195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" event={"ID":"010df205-b692-4547-8a40-d419392fa394","Type":"ContainerStarted","Data":"8911c9c97abbaf731e135a1709bfd7f2c735c7907ee8ef6a786116106a46a535"}
Sep 17 18:04:23.786683 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:23.786627    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" podStartSLOduration=1.786609699 podStartE2EDuration="1.786609699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:04:23.786043976 +0000 UTC m=+1990.436949973" watchObservedRunningTime="2026-09-17 18:04:23.786609699 +0000 UTC m=+1990.437515742"
Sep 17 18:04:24.062398 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:24.062368    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:24.068255 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:24.068230    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:24.754026 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:24.753995    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:24.754692 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:24.754674    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:30.195905 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.195867    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"]
Sep 17 18:04:30.199265 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.199246    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.202187 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.202162    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-58f131-serving-cert\""
Sep 17 18:04:30.216592 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.216569    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"]
Sep 17 18:04:30.301726 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.299096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdq8t\" (UniqueName: \"kubernetes.io/projected/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-kube-api-access-jdq8t\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.301726 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.299188    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.301726 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.299249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.301726 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.299286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.400189 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.400157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdq8t\" (UniqueName: \"kubernetes.io/projected/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-kube-api-access-jdq8t\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.400359 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.400202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.400359 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.400267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.400359 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.400308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.400516 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:04:30.400420    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-serving-cert: secret "maas-api-e2e-ipp-cleanup-58f131-serving-cert" not found
Sep 17 18:04:30.400516 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:04:30.400479    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-maas-api-tls podName:e43a8788-a5d7-47ba-9abc-6244f7f8bda2 nodeName:}" failed. No retries permitted until 2026-09-17 18:04:30.900461486 +0000 UTC m=+1997.551367460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr" (UID: "e43a8788-a5d7-47ba-9abc-6244f7f8bda2") : secret "maas-api-e2e-ipp-cleanup-58f131-serving-cert" not found
Sep 17 18:04:30.401061 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.401036    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.402588 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.402569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.427152 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.427121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdq8t\" (UniqueName: \"kubernetes.io/projected/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-kube-api-access-jdq8t\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.906377 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.906343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:30.908881 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:30.908854    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:31.109957 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:31.109925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:31.411843 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:31.411816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"]
Sep 17 18:04:31.413756 ip-10-0-131-245 kubenswrapper[2563]: W0917 18:04:31.413729    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43a8788_a5d7_47ba_9abc_6244f7f8bda2.slice/crio-682867ef8647c90e7ed79123849a7524a815cbc74ecc9d314c1e0465987353c2 WatchSource:0}: Error finding container 682867ef8647c90e7ed79123849a7524a815cbc74ecc9d314c1e0465987353c2: Status 404 returned error can't find the container with id 682867ef8647c90e7ed79123849a7524a815cbc74ecc9d314c1e0465987353c2
Sep 17 18:04:31.792540 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:31.792507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr" event={"ID":"e43a8788-a5d7-47ba-9abc-6244f7f8bda2","Type":"ContainerStarted","Data":"682867ef8647c90e7ed79123849a7524a815cbc74ecc9d314c1e0465987353c2"}
Sep 17 18:04:32.799339 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:32.799300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr" event={"ID":"e43a8788-a5d7-47ba-9abc-6244f7f8bda2","Type":"ContainerStarted","Data":"48f0679ef8ac78f2169e60112dd805bef3ba9f953678912b63581f34ec98b97d"}
Sep 17 18:04:32.799787 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:32.799374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:32.835995 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:32.835939    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr" podStartSLOduration=2.44948792 podStartE2EDuration="2.835922121s" totalImagesPullingTime="386.434201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:04:32.832826274 +0000 UTC m=+1999.483732278" watchObservedRunningTime="2026-09-17 18:04:32.835922121 +0000 UTC m=+1999.486828113"
Sep 17 18:04:35.460851 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:35.460816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:04:38.811999 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:38.811965    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:04:44.864108 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:44.864076    2563 generic.go:356] "Generic (PLEG): container finished" podID="010df205-b692-4547-8a40-d419392fa394" containerID="4c5d56d795404a88f19f88a3671b015f0b03c8b89b3b43d3ecadd62fcdab4651" exitCode=0
Sep 17 18:04:44.864471 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:44.864147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" event={"ID":"010df205-b692-4547-8a40-d419392fa394","Type":"ContainerDied","Data":"4c5d56d795404a88f19f88a3671b015f0b03c8b89b3b43d3ecadd62fcdab4651"}
Sep 17 18:04:44.864548 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:44.864534    2563 scope.go:117] "RemoveContainer" containerID="4c5d56d795404a88f19f88a3671b015f0b03c8b89b3b43d3ecadd62fcdab4651"
Sep 17 18:04:44.865692 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:44.865668    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:04:44.865764 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:44.865749    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:04:44.865804 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:44.865780    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 18:04:45.871431 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:45.871393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" event={"ID":"010df205-b692-4547-8a40-d419392fa394","Type":"ContainerStarted","Data":"9e6f82758ea7eb150ef617188de2542a7d1f3593d3e1e8a515c1488f7966c0a3"}
Sep 17 18:04:46.062346 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:46.062304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:46.062672 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:46.062648    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 17 18:04:46.062774 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:46.062725    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 17 18:04:47.062989 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:47.062948    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 17 18:04:47.063448 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:47.063009    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 17 18:04:48.062667 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:48.062627    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 17 18:04:48.062893 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:48.062741    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 17 18:04:49.062159 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:49.062115    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 17 18:04:49.062549 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:49.062192    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 17 18:04:50.063139 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:50.063101    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 17 18:04:50.063535 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:50.063167    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 17 18:04:51.062153 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:51.062117    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 17 18:04:51.062342 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:51.062182    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 17 18:04:52.067111 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:52.067079    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:52.067474 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:52.067363    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:04:52.067990 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:04:52.067972    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:05:08.773010 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:08.772971    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"]
Sep 17 18:05:08.773568 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:08.773175    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr" podUID="e43a8788-a5d7-47ba-9abc-6244f7f8bda2" containerName="maas-api" containerID="cri-o://48f0679ef8ac78f2169e60112dd805bef3ba9f953678912b63581f34ec98b97d" gracePeriod=30
Sep 17 18:05:08.805391 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:08.805357    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr" podUID="e43a8788-a5d7-47ba-9abc-6244f7f8bda2" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.74:8443/health\": dial tcp 10.133.0.74:8443: connect: connection refused"
Sep 17 18:05:09.011191 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.011155    2563 generic.go:356] "Generic (PLEG): container finished" podID="e43a8788-a5d7-47ba-9abc-6244f7f8bda2" containerID="48f0679ef8ac78f2169e60112dd805bef3ba9f953678912b63581f34ec98b97d" exitCode=0
Sep 17 18:05:09.011388 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.011207    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr" event={"ID":"e43a8788-a5d7-47ba-9abc-6244f7f8bda2","Type":"ContainerDied","Data":"48f0679ef8ac78f2169e60112dd805bef3ba9f953678912b63581f34ec98b97d"}
Sep 17 18:05:09.030875 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.030811    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:05:09.131931 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.131892    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-openshift-service-ca\") pod \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") "
Sep 17 18:05:09.132092 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.132004    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-maas-api-tls\") pod \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") "
Sep 17 18:05:09.132092 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.132042    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdq8t\" (UniqueName: \"kubernetes.io/projected/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-kube-api-access-jdq8t\") pod \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") "
Sep 17 18:05:09.132092 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.132075    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-metrics-certs\") pod \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\" (UID: \"e43a8788-a5d7-47ba-9abc-6244f7f8bda2\") "
Sep 17 18:05:09.132296 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.132269    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e43a8788-a5d7-47ba-9abc-6244f7f8bda2" (UID: "e43a8788-a5d7-47ba-9abc-6244f7f8bda2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:05:09.134192 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.134160    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e43a8788-a5d7-47ba-9abc-6244f7f8bda2" (UID: "e43a8788-a5d7-47ba-9abc-6244f7f8bda2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:05:09.134322 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.134210    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-kube-api-access-jdq8t" (OuterVolumeSpecName: "kube-api-access-jdq8t") pod "e43a8788-a5d7-47ba-9abc-6244f7f8bda2" (UID: "e43a8788-a5d7-47ba-9abc-6244f7f8bda2"). InnerVolumeSpecName "kube-api-access-jdq8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:05:09.134322 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.134210    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e43a8788-a5d7-47ba-9abc-6244f7f8bda2" (UID: "e43a8788-a5d7-47ba-9abc-6244f7f8bda2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:05:09.233175 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.233133    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-maas-api-tls\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:09.233175 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.233168    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdq8t\" (UniqueName: \"kubernetes.io/projected/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-kube-api-access-jdq8t\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:09.233175 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.233177    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-metrics-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:09.233175 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:09.233186    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e43a8788-a5d7-47ba-9abc-6244f7f8bda2-openshift-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:10.017665 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:10.017583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr" event={"ID":"e43a8788-a5d7-47ba-9abc-6244f7f8bda2","Type":"ContainerDied","Data":"682867ef8647c90e7ed79123849a7524a815cbc74ecc9d314c1e0465987353c2"}
Sep 17 18:05:10.017665 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:10.017601    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"
Sep 17 18:05:10.017665 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:10.017643    2563 scope.go:117] "RemoveContainer" containerID="48f0679ef8ac78f2169e60112dd805bef3ba9f953678912b63581f34ec98b97d"
Sep 17 18:05:10.057659 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:10.057630    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"]
Sep 17 18:05:10.061449 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:10.061420    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-58f131-6746b58878-4jsmr"]
Sep 17 18:05:11.614628 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:11.614587    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e43a8788-a5d7-47ba-9abc-6244f7f8bda2" path="/var/lib/kubelet/pods/e43a8788-a5d7-47ba-9abc-6244f7f8bda2/volumes"
Sep 17 18:05:13.197727 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:13.197659    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:05:17.867523 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:17.867488    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"]
Sep 17 18:05:17.868033 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:17.867717    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy" containerID="cri-o://9e6f82758ea7eb150ef617188de2542a7d1f3593d3e1e8a515c1488f7966c0a3" gracePeriod=30
Sep 17 18:05:22.071966 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:22.071912    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 17 18:05:22.072628 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:22.072589    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:05:23.089055 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.089016    2563 generic.go:356] "Generic (PLEG): container finished" podID="010df205-b692-4547-8a40-d419392fa394" containerID="9e6f82758ea7eb150ef617188de2542a7d1f3593d3e1e8a515c1488f7966c0a3" exitCode=0
Sep 17 18:05:23.089445 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.089093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" event={"ID":"010df205-b692-4547-8a40-d419392fa394","Type":"ContainerDied","Data":"9e6f82758ea7eb150ef617188de2542a7d1f3593d3e1e8a515c1488f7966c0a3"}
Sep 17 18:05:23.089445 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.089184    2563 scope.go:117] "RemoveContainer" containerID="4c5d56d795404a88f19f88a3671b015f0b03c8b89b3b43d3ecadd62fcdab4651"
Sep 17 18:05:23.118685 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.118665    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:05:23.174840 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.174756    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-istio-token\") pod \"010df205-b692-4547-8a40-d419392fa394\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") "
Sep 17 18:05:23.174840 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.174796    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/010df205-b692-4547-8a40-d419392fa394-istiod-ca-cert\") pod \"010df205-b692-4547-8a40-d419392fa394\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") "
Sep 17 18:05:23.175062 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175015    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-envoy\") pod \"010df205-b692-4547-8a40-d419392fa394\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") "
Sep 17 18:05:23.175132 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175067    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-credential-socket\") pod \"010df205-b692-4547-8a40-d419392fa394\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") "
Sep 17 18:05:23.175132 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175088    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-data\") pod \"010df205-b692-4547-8a40-d419392fa394\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") "
Sep 17 18:05:23.175132 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175114    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bq46\" (UniqueName: \"kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-kube-api-access-4bq46\") pod \"010df205-b692-4547-8a40-d419392fa394\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") "
Sep 17 18:05:23.175292 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175151    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-certs\") pod \"010df205-b692-4547-8a40-d419392fa394\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") "
Sep 17 18:05:23.175292 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175201    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-socket\") pod \"010df205-b692-4547-8a40-d419392fa394\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") "
Sep 17 18:05:23.175392 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175205    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010df205-b692-4547-8a40-d419392fa394-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "010df205-b692-4547-8a40-d419392fa394" (UID: "010df205-b692-4547-8a40-d419392fa394"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:05:23.175392 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175296    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/010df205-b692-4547-8a40-d419392fa394-istio-podinfo\") pod \"010df205-b692-4547-8a40-d419392fa394\" (UID: \"010df205-b692-4547-8a40-d419392fa394\") "
Sep 17 18:05:23.175487 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175458    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "010df205-b692-4547-8a40-d419392fa394" (UID: "010df205-b692-4547-8a40-d419392fa394"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:05:23.175615 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175553    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "010df205-b692-4547-8a40-d419392fa394" (UID: "010df205-b692-4547-8a40-d419392fa394"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:05:23.175615 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175575    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-data" (OuterVolumeSpecName: "istio-data") pod "010df205-b692-4547-8a40-d419392fa394" (UID: "010df205-b692-4547-8a40-d419392fa394"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:05:23.175778 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175761    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/010df205-b692-4547-8a40-d419392fa394-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:23.175843 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175771    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "010df205-b692-4547-8a40-d419392fa394" (UID: "010df205-b692-4547-8a40-d419392fa394"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:05:23.175843 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175783    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:23.175843 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175797    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:23.175843 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.175810    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:23.177325 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.177297    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "010df205-b692-4547-8a40-d419392fa394" (UID: "010df205-b692-4547-8a40-d419392fa394"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:05:23.177738 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.177717    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-istio-token" (OuterVolumeSpecName: "istio-token") pod "010df205-b692-4547-8a40-d419392fa394" (UID: "010df205-b692-4547-8a40-d419392fa394"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:05:23.177818 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.177736    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-kube-api-access-4bq46" (OuterVolumeSpecName: "kube-api-access-4bq46") pod "010df205-b692-4547-8a40-d419392fa394" (UID: "010df205-b692-4547-8a40-d419392fa394"). InnerVolumeSpecName "kube-api-access-4bq46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:05:23.177818 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.177754    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/010df205-b692-4547-8a40-d419392fa394-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "010df205-b692-4547-8a40-d419392fa394" (UID: "010df205-b692-4547-8a40-d419392fa394"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 18:05:23.277210 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.277176    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/010df205-b692-4547-8a40-d419392fa394-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:23.277210 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.277204    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:23.277210 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.277213    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:23.277440 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.277221    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bq46\" (UniqueName: \"kubernetes.io/projected/010df205-b692-4547-8a40-d419392fa394-kube-api-access-4bq46\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:23.277440 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:23.277231    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/010df205-b692-4547-8a40-d419392fa394-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:05:24.095906 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:24.095876    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"
Sep 17 18:05:24.095906 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:24.095898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt" event={"ID":"010df205-b692-4547-8a40-d419392fa394","Type":"ContainerDied","Data":"8911c9c97abbaf731e135a1709bfd7f2c735c7907ee8ef6a786116106a46a535"}
Sep 17 18:05:24.096367 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:24.095951    2563 scope.go:117] "RemoveContainer" containerID="9e6f82758ea7eb150ef617188de2542a7d1f3593d3e1e8a515c1488f7966c0a3"
Sep 17 18:05:24.123960 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:24.123934    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"]
Sep 17 18:05:24.129339 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:24.129315    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-58f131-openshift-default-5c699475f6-bltjt"]
Sep 17 18:05:25.613733 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:25.613682    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="010df205-b692-4547-8a40-d419392fa394" path="/var/lib/kubelet/pods/010df205-b692-4547-8a40-d419392fa394/volumes"
Sep 17 18:05:35.155982 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:35.155893    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:05:49.249972 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:05:49.249941    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:06:15.848625 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:15.848591    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 18:06:15.852485 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:15.852461    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 18:06:15.857835 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:15.857818    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 18:06:15.861329 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:15.861312    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 18:06:29.059414 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:29.059376    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"]
Sep 17 18:06:29.059873 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:29.059650    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy" containerID="cri-o://765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341" gracePeriod=30
Sep 17 18:06:34.314299 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.314262    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:06:34.399828 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.399746    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-credential-socket\") pod \"2c5ba574-e024-498e-99ce-6b20f924d1a2\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") "
Sep 17 18:06:34.399970 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.399828    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vklwc\" (UniqueName: \"kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-kube-api-access-vklwc\") pod \"2c5ba574-e024-498e-99ce-6b20f924d1a2\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") "
Sep 17 18:06:34.399970 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.399873    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-certs\") pod \"2c5ba574-e024-498e-99ce-6b20f924d1a2\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") "
Sep 17 18:06:34.399970 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.399902    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-token\") pod \"2c5ba574-e024-498e-99ce-6b20f924d1a2\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") "
Sep 17 18:06:34.400125 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400102    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c5ba574-e024-498e-99ce-6b20f924d1a2-istiod-ca-cert\") pod \"2c5ba574-e024-498e-99ce-6b20f924d1a2\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") "
Sep 17 18:06:34.400205 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400163    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-envoy\") pod \"2c5ba574-e024-498e-99ce-6b20f924d1a2\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") "
Sep 17 18:06:34.400205 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400198    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-podinfo\") pod \"2c5ba574-e024-498e-99ce-6b20f924d1a2\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") "
Sep 17 18:06:34.400315 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400236    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-socket\") pod \"2c5ba574-e024-498e-99ce-6b20f924d1a2\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") "
Sep 17 18:06:34.400315 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400277    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-data\") pod \"2c5ba574-e024-498e-99ce-6b20f924d1a2\" (UID: \"2c5ba574-e024-498e-99ce-6b20f924d1a2\") "
Sep 17 18:06:34.400315 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400278    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c5ba574-e024-498e-99ce-6b20f924d1a2" (UID: "2c5ba574-e024-498e-99ce-6b20f924d1a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:06:34.400315 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400301    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c5ba574-e024-498e-99ce-6b20f924d1a2" (UID: "2c5ba574-e024-498e-99ce-6b20f924d1a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:06:34.400570 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400546    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c5ba574-e024-498e-99ce-6b20f924d1a2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c5ba574-e024-498e-99ce-6b20f924d1a2" (UID: "2c5ba574-e024-498e-99ce-6b20f924d1a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:06:34.400685 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400661    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c5ba574-e024-498e-99ce-6b20f924d1a2-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:34.400778 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400691    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:34.400778 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400730    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:34.400893 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.400820    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c5ba574-e024-498e-99ce-6b20f924d1a2" (UID: "2c5ba574-e024-498e-99ce-6b20f924d1a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:06:34.401211 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.401176    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c5ba574-e024-498e-99ce-6b20f924d1a2" (UID: "2c5ba574-e024-498e-99ce-6b20f924d1a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:06:34.402295 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.402264    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c5ba574-e024-498e-99ce-6b20f924d1a2" (UID: "2c5ba574-e024-498e-99ce-6b20f924d1a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:06:34.402408 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.402370    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c5ba574-e024-498e-99ce-6b20f924d1a2" (UID: "2c5ba574-e024-498e-99ce-6b20f924d1a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:06:34.402468 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.402417    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c5ba574-e024-498e-99ce-6b20f924d1a2" (UID: "2c5ba574-e024-498e-99ce-6b20f924d1a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 18:06:34.402524 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.402506    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-kube-api-access-vklwc" (OuterVolumeSpecName: "kube-api-access-vklwc") pod "2c5ba574-e024-498e-99ce-6b20f924d1a2" (UID: "2c5ba574-e024-498e-99ce-6b20f924d1a2"). InnerVolumeSpecName "kube-api-access-vklwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:06:34.478884 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.478855    2563 generic.go:356] "Generic (PLEG): container finished" podID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerID="765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341" exitCode=0
Sep 17 18:06:34.478994 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.478918    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"
Sep 17 18:06:34.478994 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.478943    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" event={"ID":"2c5ba574-e024-498e-99ce-6b20f924d1a2","Type":"ContainerDied","Data":"765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341"}
Sep 17 18:06:34.479071 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.479023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp" event={"ID":"2c5ba574-e024-498e-99ce-6b20f924d1a2","Type":"ContainerDied","Data":"bb6f72de80ee792a76273ea4efd2b31938560dc557eff29bd2a74c19546d146d"}
Sep 17 18:06:34.479071 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.479047    2563 scope.go:117] "RemoveContainer" containerID="765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341"
Sep 17 18:06:34.488139 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.488127    2563 scope.go:117] "RemoveContainer" containerID="56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878"
Sep 17 18:06:34.495690 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.495676    2563 scope.go:117] "RemoveContainer" containerID="765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341"
Sep 17 18:06:34.495981 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:06:34.495965    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341\": container with ID starting with 765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341 not found: ID does not exist" containerID="765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341"
Sep 17 18:06:34.496025 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.495987    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341"} err="failed to get container status \"765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341\": rpc error: code = NotFound desc = could not find container \"765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341\": container with ID starting with 765d5ccc2ae5f40438997e8d3ae1e614800686a577358162835027a4748f8341 not found: ID does not exist"
Sep 17 18:06:34.496025 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.496003    2563 scope.go:117] "RemoveContainer" containerID="56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878"
Sep 17 18:06:34.496244 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:06:34.496226    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878\": container with ID starting with 56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878 not found: ID does not exist" containerID="56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878"
Sep 17 18:06:34.496295 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.496251    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878"} err="failed to get container status \"56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878\": rpc error: code = NotFound desc = could not find container \"56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878\": container with ID starting with 56d71ce43fd75388554e7bdefda856435ef1d1e43dfb7aa90fcf2587d211b878 not found: ID does not exist"
Sep 17 18:06:34.501866 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.501846    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:34.501944 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.501868    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:34.501944 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.501877    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vklwc\" (UniqueName: \"kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-kube-api-access-vklwc\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:34.501944 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.501886    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:34.501944 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.501894    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:34.501944 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.501901    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c5ba574-e024-498e-99ce-6b20f924d1a2-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:34.505823 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.505801    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"]
Sep 17 18:06:34.508255 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:34.508235    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-dba35d-openshift-default-545986b75b-zvfbp"]
Sep 17 18:06:35.615208 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:35.615168    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" path="/var/lib/kubelet/pods/2c5ba574-e024-498e-99ce-6b20f924d1a2/volumes"
Sep 17 18:06:40.215283 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.215246    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"]
Sep 17 18:06:40.215807 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.215499    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9" podUID="e6c76aa8-9cb0-4025-a319-37a586af2605" containerName="maas-api" containerID="cri-o://8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d" gracePeriod=30
Sep 17 18:06:40.309681 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.309641    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9" podUID="e6c76aa8-9cb0-4025-a319-37a586af2605" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.72:8443/health\": dial tcp 10.133.0.72:8443: connect: connection refused"
Sep 17 18:06:40.468419 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.468357    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:06:40.511690 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.511665    2563 generic.go:356] "Generic (PLEG): container finished" podID="e6c76aa8-9cb0-4025-a319-37a586af2605" containerID="8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d" exitCode=0
Sep 17 18:06:40.511854 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.511725    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"
Sep 17 18:06:40.511854 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.511740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9" event={"ID":"e6c76aa8-9cb0-4025-a319-37a586af2605","Type":"ContainerDied","Data":"8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d"}
Sep 17 18:06:40.511854 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.511784    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9" event={"ID":"e6c76aa8-9cb0-4025-a319-37a586af2605","Type":"ContainerDied","Data":"ba692af8f8c5dcde40940552a4559a94a0311cd1b839f108c36fd218eaddef8f"}
Sep 17 18:06:40.511854 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.511806    2563 scope.go:117] "RemoveContainer" containerID="8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d"
Sep 17 18:06:40.527660 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.527636    2563 scope.go:117] "RemoveContainer" containerID="8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d"
Sep 17 18:06:40.528289 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:06:40.528208    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d\": container with ID starting with 8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d not found: ID does not exist" containerID="8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d"
Sep 17 18:06:40.528289 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.528244    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d"} err="failed to get container status \"8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d\": rpc error: code = NotFound desc = could not find container \"8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d\": container with ID starting with 8669e5dee8b1e22f3a4c36897521c7042d68d8003da5790badc354d3fbdc9c7d not found: ID does not exist"
Sep 17 18:06:40.564004 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.563976    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj5vw\" (UniqueName: \"kubernetes.io/projected/e6c76aa8-9cb0-4025-a319-37a586af2605-kube-api-access-wj5vw\") pod \"e6c76aa8-9cb0-4025-a319-37a586af2605\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") "
Sep 17 18:06:40.564196 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.564030    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c76aa8-9cb0-4025-a319-37a586af2605-openshift-service-ca\") pod \"e6c76aa8-9cb0-4025-a319-37a586af2605\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") "
Sep 17 18:06:40.564196 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.564062    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-metrics-certs\") pod \"e6c76aa8-9cb0-4025-a319-37a586af2605\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") "
Sep 17 18:06:40.564196 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.564109    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-maas-api-tls\") pod \"e6c76aa8-9cb0-4025-a319-37a586af2605\" (UID: \"e6c76aa8-9cb0-4025-a319-37a586af2605\") "
Sep 17 18:06:40.564561 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.564524    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6c76aa8-9cb0-4025-a319-37a586af2605-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6c76aa8-9cb0-4025-a319-37a586af2605" (UID: "e6c76aa8-9cb0-4025-a319-37a586af2605"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:06:40.566288 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.566264    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e6c76aa8-9cb0-4025-a319-37a586af2605" (UID: "e6c76aa8-9cb0-4025-a319-37a586af2605"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:06:40.566643 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.566616    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6c76aa8-9cb0-4025-a319-37a586af2605" (UID: "e6c76aa8-9cb0-4025-a319-37a586af2605"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:06:40.566758 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.566670    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6c76aa8-9cb0-4025-a319-37a586af2605-kube-api-access-wj5vw" (OuterVolumeSpecName: "kube-api-access-wj5vw") pod "e6c76aa8-9cb0-4025-a319-37a586af2605" (UID: "e6c76aa8-9cb0-4025-a319-37a586af2605"). InnerVolumeSpecName "kube-api-access-wj5vw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:06:40.665380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.665335    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-maas-api-tls\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:40.665380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.665380    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj5vw\" (UniqueName: \"kubernetes.io/projected/e6c76aa8-9cb0-4025-a319-37a586af2605-kube-api-access-wj5vw\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:40.665626 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.665395    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c76aa8-9cb0-4025-a319-37a586af2605-openshift-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:40.665626 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.665408    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c76aa8-9cb0-4025-a319-37a586af2605-metrics-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:40.840799 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.840768    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"]
Sep 17 18:06:40.843759 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:40.843736    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77ab2-5f45bfc4b5-2hrv9"]
Sep 17 18:06:41.616147 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:41.616106    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6c76aa8-9cb0-4025-a319-37a586af2605" path="/var/lib/kubelet/pods/e6c76aa8-9cb0-4025-a319-37a586af2605/volumes"
Sep 17 18:06:43.663346 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:43.663310    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:06:48.738989 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:48.738954    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"]
Sep 17 18:06:48.739502 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:48.739208    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy" containerID="cri-o://10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1" gracePeriod=30
Sep 17 18:06:53.982811 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:53.982785    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:06:54.092651 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.092621    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpjhg\" (UniqueName: \"kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-kube-api-access-cpjhg\") pod \"26feed43-c33e-45ae-a560-0411173648d4\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") "
Sep 17 18:06:54.092842 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.092673    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26feed43-c33e-45ae-a560-0411173648d4-istio-podinfo\") pod \"26feed43-c33e-45ae-a560-0411173648d4\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") "
Sep 17 18:06:54.092842 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.092727    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-data\") pod \"26feed43-c33e-45ae-a560-0411173648d4\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") "
Sep 17 18:06:54.092923 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.092867    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-envoy\") pod \"26feed43-c33e-45ae-a560-0411173648d4\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") "
Sep 17 18:06:54.092923 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.092919    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-credential-socket\") pod \"26feed43-c33e-45ae-a560-0411173648d4\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") "
Sep 17 18:06:54.093013 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.092940    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-istio-token\") pod \"26feed43-c33e-45ae-a560-0411173648d4\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") "
Sep 17 18:06:54.093013 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.092959    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-certs\") pod \"26feed43-c33e-45ae-a560-0411173648d4\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") "
Sep 17 18:06:54.093013 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.092964    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "26feed43-c33e-45ae-a560-0411173648d4" (UID: "26feed43-c33e-45ae-a560-0411173648d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:06:54.093175 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.093025    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-socket\") pod \"26feed43-c33e-45ae-a560-0411173648d4\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") "
Sep 17 18:06:54.093175 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.093063    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26feed43-c33e-45ae-a560-0411173648d4-istiod-ca-cert\") pod \"26feed43-c33e-45ae-a560-0411173648d4\" (UID: \"26feed43-c33e-45ae-a560-0411173648d4\") "
Sep 17 18:06:54.093296 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.093228    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26feed43-c33e-45ae-a560-0411173648d4" (UID: "26feed43-c33e-45ae-a560-0411173648d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:06:54.093431 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.093372    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26feed43-c33e-45ae-a560-0411173648d4" (UID: "26feed43-c33e-45ae-a560-0411173648d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:06:54.093544 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.093404    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26feed43-c33e-45ae-a560-0411173648d4" (UID: "26feed43-c33e-45ae-a560-0411173648d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:06:54.093544 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.093531    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:54.093648 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.093551    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:54.093648 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.093555    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26feed43-c33e-45ae-a560-0411173648d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26feed43-c33e-45ae-a560-0411173648d4" (UID: "26feed43-c33e-45ae-a560-0411173648d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:06:54.093648 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.093567    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:54.093648 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.093581    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:54.095044 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.095018    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26feed43-c33e-45ae-a560-0411173648d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26feed43-c33e-45ae-a560-0411173648d4" (UID: "26feed43-c33e-45ae-a560-0411173648d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 18:06:54.095147 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.095024    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "26feed43-c33e-45ae-a560-0411173648d4" (UID: "26feed43-c33e-45ae-a560-0411173648d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:06:54.095394 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.095366    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26feed43-c33e-45ae-a560-0411173648d4" (UID: "26feed43-c33e-45ae-a560-0411173648d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:06:54.095496 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.095393    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-kube-api-access-cpjhg" (OuterVolumeSpecName: "kube-api-access-cpjhg") pod "26feed43-c33e-45ae-a560-0411173648d4" (UID: "26feed43-c33e-45ae-a560-0411173648d4"). InnerVolumeSpecName "kube-api-access-cpjhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:06:54.194490 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.194464    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26feed43-c33e-45ae-a560-0411173648d4-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:54.194490 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.194485    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpjhg\" (UniqueName: \"kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-kube-api-access-cpjhg\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:54.194655 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.194495    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26feed43-c33e-45ae-a560-0411173648d4-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:54.194655 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.194504    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26feed43-c33e-45ae-a560-0411173648d4-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:54.194655 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.194512    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26feed43-c33e-45ae-a560-0411173648d4-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:06:54.591866 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.591833    2563 generic.go:356] "Generic (PLEG): container finished" podID="26feed43-c33e-45ae-a560-0411173648d4" containerID="10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1" exitCode=0
Sep 17 18:06:54.592048 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.591881    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"
Sep 17 18:06:54.592048 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.591889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" event={"ID":"26feed43-c33e-45ae-a560-0411173648d4","Type":"ContainerDied","Data":"10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1"}
Sep 17 18:06:54.592048 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.591932    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh" event={"ID":"26feed43-c33e-45ae-a560-0411173648d4","Type":"ContainerDied","Data":"d1e8126573c2d1c38356d8ed56004876a32ad8287cd40e52ee69842f3ab6c91e"}
Sep 17 18:06:54.592048 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.591952    2563 scope.go:117] "RemoveContainer" containerID="10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1"
Sep 17 18:06:54.602270 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.602253    2563 scope.go:117] "RemoveContainer" containerID="151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4"
Sep 17 18:06:54.610401 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.610385    2563 scope.go:117] "RemoveContainer" containerID="10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1"
Sep 17 18:06:54.610652 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:06:54.610635    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1\": container with ID starting with 10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1 not found: ID does not exist" containerID="10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1"
Sep 17 18:06:54.610722 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.610659    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1"} err="failed to get container status \"10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1\": rpc error: code = NotFound desc = could not find container \"10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1\": container with ID starting with 10dd631df3bce4981d7685d09abcb992a3dda9076912d3e8587dd7c5b59454f1 not found: ID does not exist"
Sep 17 18:06:54.610722 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.610675    2563 scope.go:117] "RemoveContainer" containerID="151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4"
Sep 17 18:06:54.610955 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:06:54.610936    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4\": container with ID starting with 151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4 not found: ID does not exist" containerID="151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4"
Sep 17 18:06:54.611009 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.610964    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4"} err="failed to get container status \"151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4\": rpc error: code = NotFound desc = could not find container \"151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4\": container with ID starting with 151946c8d9667c5511d0883831b4ddfccf34dcb4fd4908708bebb80109cdbac4 not found: ID does not exist"
Sep 17 18:06:54.629693 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.629665    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"]
Sep 17 18:06:54.635636 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:54.635608    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-b77ab2-openshift-default-7f765f6bdb-bsknh"]
Sep 17 18:06:55.613436 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:55.613403    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26feed43-c33e-45ae-a560-0411173648d4" path="/var/lib/kubelet/pods/26feed43-c33e-45ae-a560-0411173648d4/volumes"
Sep 17 18:06:59.923867 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:59.923788    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc"]
Sep 17 18:06:59.927488 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:06:59.927462    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-abb363-29827800-5p8wc"]
Sep 17 18:07:01.614414 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:01.614380    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a498add-8736-4f40-aa35-a6ec3322fe3a" path="/var/lib/kubelet/pods/8a498add-8736-4f40-aa35-a6ec3322fe3a/volumes"
Sep 17 18:07:03.479155 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:03.479118    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:07:09.193378 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:09.193340    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"]
Sep 17 18:07:09.193797 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:09.193524    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy" containerID="cri-o://f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97" gracePeriod=30
Sep 17 18:07:14.033796 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.033738    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 18:07:14.034161 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.033816    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:07:14.444453 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.444427    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 18:07:14.597124 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597023    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-credential-socket\") pod \"396d08c5-df17-4dc1-8ba5-e7440e14158a\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") "
Sep 17 18:07:14.597124 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597075    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj99x\" (UniqueName: \"kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-kube-api-access-mj99x\") pod \"396d08c5-df17-4dc1-8ba5-e7440e14158a\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") "
Sep 17 18:07:14.597124 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597095    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-socket\") pod \"396d08c5-df17-4dc1-8ba5-e7440e14158a\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") "
Sep 17 18:07:14.597124 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597130    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-data\") pod \"396d08c5-df17-4dc1-8ba5-e7440e14158a\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") "
Sep 17 18:07:14.597472 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597156    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-token\") pod \"396d08c5-df17-4dc1-8ba5-e7440e14158a\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") "
Sep 17 18:07:14.597472 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597239    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-podinfo\") pod \"396d08c5-df17-4dc1-8ba5-e7440e14158a\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") "
Sep 17 18:07:14.597472 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597266    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-certs\") pod \"396d08c5-df17-4dc1-8ba5-e7440e14158a\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") "
Sep 17 18:07:14.597472 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597340    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "396d08c5-df17-4dc1-8ba5-e7440e14158a" (UID: "396d08c5-df17-4dc1-8ba5-e7440e14158a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:07:14.597472 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597427    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/396d08c5-df17-4dc1-8ba5-e7440e14158a-istiod-ca-cert\") pod \"396d08c5-df17-4dc1-8ba5-e7440e14158a\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") "
Sep 17 18:07:14.597472 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597467    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-envoy\") pod \"396d08c5-df17-4dc1-8ba5-e7440e14158a\" (UID: \"396d08c5-df17-4dc1-8ba5-e7440e14158a\") "
Sep 17 18:07:14.597779 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597457    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-data" (OuterVolumeSpecName: "istio-data") pod "396d08c5-df17-4dc1-8ba5-e7440e14158a" (UID: "396d08c5-df17-4dc1-8ba5-e7440e14158a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:07:14.597779 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597474    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "396d08c5-df17-4dc1-8ba5-e7440e14158a" (UID: "396d08c5-df17-4dc1-8ba5-e7440e14158a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:07:14.597779 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597594    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "396d08c5-df17-4dc1-8ba5-e7440e14158a" (UID: "396d08c5-df17-4dc1-8ba5-e7440e14158a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:07:14.597936 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597802    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396d08c5-df17-4dc1-8ba5-e7440e14158a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "396d08c5-df17-4dc1-8ba5-e7440e14158a" (UID: "396d08c5-df17-4dc1-8ba5-e7440e14158a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:07:14.597980 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597934    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:14.597980 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597954    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/396d08c5-df17-4dc1-8ba5-e7440e14158a-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:14.597980 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597967    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:14.598096 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597981    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:14.598096 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.597994    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:14.599468 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.599435    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "396d08c5-df17-4dc1-8ba5-e7440e14158a" (UID: "396d08c5-df17-4dc1-8ba5-e7440e14158a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 18:07:14.599468 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.599451    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "396d08c5-df17-4dc1-8ba5-e7440e14158a" (UID: "396d08c5-df17-4dc1-8ba5-e7440e14158a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:07:14.599715 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.599680    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-kube-api-access-mj99x" (OuterVolumeSpecName: "kube-api-access-mj99x") pod "396d08c5-df17-4dc1-8ba5-e7440e14158a" (UID: "396d08c5-df17-4dc1-8ba5-e7440e14158a"). InnerVolumeSpecName "kube-api-access-mj99x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:07:14.599822 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.599690    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-token" (OuterVolumeSpecName: "istio-token") pod "396d08c5-df17-4dc1-8ba5-e7440e14158a" (UID: "396d08c5-df17-4dc1-8ba5-e7440e14158a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:07:14.698516 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.698489    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj99x\" (UniqueName: \"kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-kube-api-access-mj99x\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:14.698516 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.698511    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:14.698516 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.698521    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:14.698735 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.698529    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/396d08c5-df17-4dc1-8ba5-e7440e14158a-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:14.698885 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.698863    2563 generic.go:356] "Generic (PLEG): container finished" podID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerID="f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97" exitCode=0
Sep 17 18:07:14.698936 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.698915    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"
Sep 17 18:07:14.698990 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.698952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" event={"ID":"396d08c5-df17-4dc1-8ba5-e7440e14158a","Type":"ContainerDied","Data":"f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97"}
Sep 17 18:07:14.699045 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.699022    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v" event={"ID":"396d08c5-df17-4dc1-8ba5-e7440e14158a","Type":"ContainerDied","Data":"2675a4ebb7911e53ebe16762d79b34726fb464df89d6e9cab35b346b42d6ea69"}
Sep 17 18:07:14.699096 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.699059    2563 scope.go:117] "RemoveContainer" containerID="f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97"
Sep 17 18:07:14.707982 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.707966    2563 scope.go:117] "RemoveContainer" containerID="bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8"
Sep 17 18:07:14.715863 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.715832    2563 scope.go:117] "RemoveContainer" containerID="f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97"
Sep 17 18:07:14.716085 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:07:14.716068    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97\": container with ID starting with f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97 not found: ID does not exist" containerID="f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97"
Sep 17 18:07:14.716145 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.716092    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97"} err="failed to get container status \"f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97\": rpc error: code = NotFound desc = could not find container \"f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97\": container with ID starting with f8a486b7932360c7d7c5a5af8fe433553273ee2061ad53f6fe119df588e69d97 not found: ID does not exist"
Sep 17 18:07:14.716145 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.716109    2563 scope.go:117] "RemoveContainer" containerID="bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8"
Sep 17 18:07:14.716339 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:07:14.716323    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8\": container with ID starting with bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8 not found: ID does not exist" containerID="bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8"
Sep 17 18:07:14.716386 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.716344    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8"} err="failed to get container status \"bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8\": rpc error: code = NotFound desc = could not find container \"bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8\": container with ID starting with bd589d74967e59a883a1098ddf8e6c10597fe89651bc2823f92ffdf86aa7ddb8 not found: ID does not exist"
Sep 17 18:07:14.740579 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.740558    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"]
Sep 17 18:07:14.748030 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:14.748012    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-abb363-openshift-default-6567656b74-fls6v"]
Sep 17 18:07:15.613669 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:15.613638    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" path="/var/lib/kubelet/pods/396d08c5-df17-4dc1-8ba5-e7440e14158a/volumes"
Sep 17 18:07:15.964406 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:15.964312    2563 scope.go:117] "RemoveContainer" containerID="ef2d125b84a673b80090a7d999d6cfd2d92b50c5eb3d34da5cb7eb6bd2d17245"
Sep 17 18:07:20.455651 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.455614    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"]
Sep 17 18:07:20.456121 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.455868    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf" podUID="ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba" containerName="maas-api" containerID="cri-o://a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b" gracePeriod=30
Sep 17 18:07:20.721015 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.720991    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 18:07:20.730009 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.729982    2563 generic.go:356] "Generic (PLEG): container finished" podID="ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba" containerID="a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b" exitCode=0
Sep 17 18:07:20.730128 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.730024    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"
Sep 17 18:07:20.730128 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.730065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf" event={"ID":"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba","Type":"ContainerDied","Data":"a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b"}
Sep 17 18:07:20.730128 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.730125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf" event={"ID":"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba","Type":"ContainerDied","Data":"36ee8867fb0c2c5c9457ab344bf972e6c50413a97ef1bd1406375a4cd3db6562"}
Sep 17 18:07:20.730260 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.730151    2563 scope.go:117] "RemoveContainer" containerID="a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b"
Sep 17 18:07:20.738481 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.738464    2563 scope.go:117] "RemoveContainer" containerID="a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b"
Sep 17 18:07:20.738749 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:07:20.738733    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b\": container with ID starting with a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b not found: ID does not exist" containerID="a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b"
Sep 17 18:07:20.738818 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.738761    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b"} err="failed to get container status \"a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b\": rpc error: code = NotFound desc = could not find container \"a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b\": container with ID starting with a62f2399d5167fecf8d148032e3357bb47c139dbb94ef7b6c43d05c5b6ad890b not found: ID does not exist"
Sep 17 18:07:20.855605 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.855577    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-openshift-service-ca\") pod \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") "
Sep 17 18:07:20.855605 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.855610    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-maas-api-tls\") pod \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") "
Sep 17 18:07:20.855881 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.855661    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkfz7\" (UniqueName: \"kubernetes.io/projected/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-kube-api-access-qkfz7\") pod \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") "
Sep 17 18:07:20.855881 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.855835    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-metrics-certs\") pod \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\" (UID: \"ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba\") "
Sep 17 18:07:20.856055 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.856028    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba" (UID: "ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:07:20.856174 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.856161    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-openshift-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:20.857793 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.857758    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba" (UID: "ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:07:20.857888 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.857818    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba" (UID: "ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:07:20.857888 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.857854    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-kube-api-access-qkfz7" (OuterVolumeSpecName: "kube-api-access-qkfz7") pod "ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba" (UID: "ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba"). InnerVolumeSpecName "kube-api-access-qkfz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:07:20.957029 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.956946    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-maas-api-tls\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:20.957029 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.956974    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkfz7\" (UniqueName: \"kubernetes.io/projected/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-kube-api-access-qkfz7\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:20.957029 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:20.956985    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba-metrics-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:21.088279 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:21.088243    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"]
Sep 17 18:07:21.093132 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:21.093109    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7b7c8c-844b87ddbf-z8wpf"]
Sep 17 18:07:21.613394 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:21.613363    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba" path="/var/lib/kubelet/pods/ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba/volumes"
Sep 17 18:07:23.381522 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:23.381486    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:07:29.268088 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:29.268053    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"]
Sep 17 18:07:29.268555 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:29.268255    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy" containerID="cri-o://e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604" gracePeriod=30
Sep 17 18:07:34.522869 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.522841    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 18:07:34.579570 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.579477    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-envoy\") pod \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") "
Sep 17 18:07:34.579570 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.579524    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-token\") pod \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") "
Sep 17 18:07:34.579838 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.579604    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-data\") pod \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") "
Sep 17 18:07:34.579838 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.579666    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-podinfo\") pod \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") "
Sep 17 18:07:34.579838 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.579696    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-socket\") pod \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") "
Sep 17 18:07:34.579838 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.579774    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istiod-ca-cert\") pod \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") "
Sep 17 18:07:34.579838 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.579798    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5pz7\" (UniqueName: \"kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-kube-api-access-d5pz7\") pod \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") "
Sep 17 18:07:34.579838 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.579830    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-credential-socket\") pod \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") "
Sep 17 18:07:34.580171 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.579876    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-certs\") pod \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\" (UID: \"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1\") "
Sep 17 18:07:34.580268 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.580245    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" (UID: "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:07:34.580338 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.580269    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" (UID: "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:07:34.580395 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.580344    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-data" (OuterVolumeSpecName: "istio-data") pod "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" (UID: "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:07:34.580464 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.580443    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" (UID: "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:07:34.580517 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.580459    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" (UID: "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:07:34.581932 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.581901    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-token" (OuterVolumeSpecName: "istio-token") pod "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" (UID: "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:07:34.582042 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.581941    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" (UID: "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 18:07:34.582433 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.582417    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" (UID: "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:07:34.582684 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.582660    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-kube-api-access-d5pz7" (OuterVolumeSpecName: "kube-api-access-d5pz7") pod "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" (UID: "001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1"). InnerVolumeSpecName "kube-api-access-d5pz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:07:34.681427 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.681372    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-data\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:34.681427 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.681420    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-podinfo\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:34.681427 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.681435    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:34.681683 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.681450    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istiod-ca-cert\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:34.681683 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.681462    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5pz7\" (UniqueName: \"kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-kube-api-access-d5pz7\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:34.681683 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.681474    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-credential-socket\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:34.681683 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.681485    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-workload-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:34.681683 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.681496    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-envoy\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:34.681683 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.681506    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1-istio-token\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:07:34.764737 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.764691    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:07:34.807523 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.807492    2563 generic.go:356] "Generic (PLEG): container finished" podID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerID="e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604" exitCode=0
Sep 17 18:07:34.807665 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.807542    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"
Sep 17 18:07:34.807665 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.807582    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" event={"ID":"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1","Type":"ContainerDied","Data":"e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604"}
Sep 17 18:07:34.807665 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.807639    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch" event={"ID":"001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1","Type":"ContainerDied","Data":"9470ef6ecc1a178147c94a910b9cd2b1bb0ff8f8924945e141e179ff219cab8e"}
Sep 17 18:07:34.807825 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.807665    2563 scope.go:117] "RemoveContainer" containerID="e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604"
Sep 17 18:07:34.817414 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.817400    2563 scope.go:117] "RemoveContainer" containerID="b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a"
Sep 17 18:07:34.825082 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.825068    2563 scope.go:117] "RemoveContainer" containerID="e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604"
Sep 17 18:07:34.825350 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:07:34.825331    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604\": container with ID starting with e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604 not found: ID does not exist" containerID="e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604"
Sep 17 18:07:34.825400 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.825359    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604"} err="failed to get container status \"e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604\": rpc error: code = NotFound desc = could not find container \"e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604\": container with ID starting with e5aa87eb220fa15c81298c05fd0088bdffad57dbf9c83df27fd3666682676604 not found: ID does not exist"
Sep 17 18:07:34.825400 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.825376    2563 scope.go:117] "RemoveContainer" containerID="b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a"
Sep 17 18:07:34.825635 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:07:34.825616    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a\": container with ID starting with b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a not found: ID does not exist" containerID="b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a"
Sep 17 18:07:34.825687 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.825640    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a"} err="failed to get container status \"b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a\": rpc error: code = NotFound desc = could not find container \"b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a\": container with ID starting with b444faaf67c7f2dbd54ef5c32a7c8dbc556b961510335092ee174569bb68109a not found: ID does not exist"
Sep 17 18:07:34.843092 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.843040    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"]
Sep 17 18:07:34.857986 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:34.857965    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7b7c8c-openshift-default-6ccb5db4cd-446ch"]
Sep 17 18:07:35.615950 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:07:35.615913    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" path="/var/lib/kubelet/pods/001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1/volumes"
Sep 17 18:08:56.650999 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:08:56.650968    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:09:36.988015 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:09:36.987981    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:09:45.434533 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:09:45.434496    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:09:53.045028 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:09:53.044988    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:10:11.448820 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:10:11.448786    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:10:19.739493 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:10:19.739455    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:11:15.879852 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:11:15.879826    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 18:11:15.884285 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:11:15.884265    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 18:11:15.890612 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:11:15.890594    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 18:11:15.894240 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:11:15.894218    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2fxq_a716c236-02eb-4a29-8500-b99f47fb2abe/ovn-acl-logging/0.log"
Sep 17 18:11:43.624858 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:11:43.624767    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:11:51.840013 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:11:51.839974    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:11:57.937779 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:11:57.937741    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:12:07.242135 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:07.242098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:12:22.631674 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:22.631638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:12:36.622279 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:36.622239    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:12:45.127925 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:45.127885    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:12:53.043631 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.043591    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"]
Sep 17 18:12:53.044057 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.043982    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43a8788-a5d7-47ba-9abc-6244f7f8bda2" containerName="maas-api"
Sep 17 18:12:53.044057 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.043995    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43a8788-a5d7-47ba-9abc-6244f7f8bda2" containerName="maas-api"
Sep 17 18:12:53.044057 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044013    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy"
Sep 17 18:12:53.044057 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044018    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy"
Sep 17 18:12:53.044057 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044028    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy"
Sep 17 18:12:53.044057 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044035    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy"
Sep 17 18:12:53.044057 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044043    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy"
Sep 17 18:12:53.044057 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044049    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy"
Sep 17 18:12:53.044057 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044057    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy"
Sep 17 18:12:53.044057 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044062    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044068    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044073    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044080    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044084    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044090    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044095    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044100    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044105    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044116    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044121    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044126    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba" containerName="maas-api"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044130    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba" containerName="maas-api"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044137    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044144    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044150    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6c76aa8-9cb0-4025-a319-37a586af2605" containerName="maas-api"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044155    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c76aa8-9cb0-4025-a319-37a586af2605" containerName="maas-api"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044217    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044225    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef5e5e37-fa9e-41b6-9ca1-32a4f8a547ba" containerName="maas-api"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044230    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6c76aa8-9cb0-4025-a319-37a586af2605" containerName="maas-api"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044237    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044241    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044247    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044253    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044260    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c5ba574-e024-498e-99ce-6b20f924d1a2" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044264    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="26feed43-c33e-45ae-a560-0411173648d4" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044270    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="010df205-b692-4547-8a40-d419392fa394" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044276    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="001c690c-8c85-4d2b-a9f8-ee4d4c16fbc1" containerName="istio-proxy"
Sep 17 18:12:53.044380 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.044281    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43a8788-a5d7-47ba-9abc-6244f7f8bda2" containerName="maas-api"
Sep 17 18:12:53.047392 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.047374    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.050300 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.050273    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 17 18:12:53.050300 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.050295    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mzh7j\""
Sep 17 18:12:53.050487 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.050277    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 18:12:53.050487 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.050317    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 18:12:53.050487 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.050327    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 18:12:53.055770 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.055688    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"]
Sep 17 18:12:53.058841 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.058822    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"]
Sep 17 18:12:53.059238 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.059226    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="396d08c5-df17-4dc1-8ba5-e7440e14158a" containerName="istio-proxy"
Sep 17 18:12:53.062178 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.062160    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.071999 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.071977    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"]
Sep 17 18:12:53.128671 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.128639    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:12:53.254723 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.248982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shmz8\" (UniqueName: \"kubernetes.io/projected/9a51fa01-ef25-4578-89ab-7499b46c1795-kube-api-access-shmz8\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.254723 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.249034    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2031add2-7a07-4fd1-b741-e9c22f24e9d6-openshift-service-ca\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.254723 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.249067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a51fa01-ef25-4578-89ab-7499b46c1795-openshift-service-ca\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.254723 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.249098    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2031add2-7a07-4fd1-b741-e9c22f24e9d6-metrics-certs\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.254723 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.249154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-metrics-certs\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.254723 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.249189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2031add2-7a07-4fd1-b741-e9c22f24e9d6-maas-api-tls\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.254723 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.249241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xs72\" (UniqueName: \"kubernetes.io/projected/2031add2-7a07-4fd1-b741-e9c22f24e9d6-kube-api-access-6xs72\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.254723 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.249294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-maas-api-tls\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.349715 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.349668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a51fa01-ef25-4578-89ab-7499b46c1795-openshift-service-ca\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.349834 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.349733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2031add2-7a07-4fd1-b741-e9c22f24e9d6-metrics-certs\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.349834 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.349776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-metrics-certs\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.349834 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.349802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2031add2-7a07-4fd1-b741-e9c22f24e9d6-maas-api-tls\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.350001 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.349842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xs72\" (UniqueName: \"kubernetes.io/projected/2031add2-7a07-4fd1-b741-e9c22f24e9d6-kube-api-access-6xs72\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.350001 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.349887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-maas-api-tls\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.350001 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.349973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shmz8\" (UniqueName: \"kubernetes.io/projected/9a51fa01-ef25-4578-89ab-7499b46c1795-kube-api-access-shmz8\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.350164 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.350038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2031add2-7a07-4fd1-b741-e9c22f24e9d6-openshift-service-ca\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.350544 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.350518    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a51fa01-ef25-4578-89ab-7499b46c1795-openshift-service-ca\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.350876 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.350852    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2031add2-7a07-4fd1-b741-e9c22f24e9d6-openshift-service-ca\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.352335 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.352310    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2031add2-7a07-4fd1-b741-e9c22f24e9d6-maas-api-tls\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.352422 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.352390    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-metrics-certs\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.352480 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.352464    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-maas-api-tls\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.352552 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.352532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2031add2-7a07-4fd1-b741-e9c22f24e9d6-metrics-certs\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.357276 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.357253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xs72\" (UniqueName: \"kubernetes.io/projected/2031add2-7a07-4fd1-b741-e9c22f24e9d6-kube-api-access-6xs72\") pod \"maas-api-65c5475bc5-zpfpp\" (UID: \"2031add2-7a07-4fd1-b741-e9c22f24e9d6\") " pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.357444 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.357426    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shmz8\" (UniqueName: \"kubernetes.io/projected/9a51fa01-ef25-4578-89ab-7499b46c1795-kube-api-access-shmz8\") pod \"maas-api-6c99d599cf-45hnh\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") " pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.359553 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.359532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:53.372513 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.372492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:53.635883 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.635856    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"]
Sep 17 18:12:53.638571 ip-10-0-131-245 kubenswrapper[2563]: W0917 18:12:53.638543    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a51fa01_ef25_4578_89ab_7499b46c1795.slice/crio-d659c41e0362ad22844264a056223aea9ec0ae0cbaa8e99a7e7c72ce404efe56 WatchSource:0}: Error finding container d659c41e0362ad22844264a056223aea9ec0ae0cbaa8e99a7e7c72ce404efe56: Status 404 returned error can't find the container with id d659c41e0362ad22844264a056223aea9ec0ae0cbaa8e99a7e7c72ce404efe56
Sep 17 18:12:53.639882 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.639865    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 18:12:53.648768 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:53.648744    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"]
Sep 17 18:12:53.650958 ip-10-0-131-245 kubenswrapper[2563]: W0917 18:12:53.650936    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2031add2_7a07_4fd1_b741_e9c22f24e9d6.slice/crio-4642c626a64d9ae4fdce4e81a6bda6d4532583581363a42e037b6aca3d4dba80 WatchSource:0}: Error finding container 4642c626a64d9ae4fdce4e81a6bda6d4532583581363a42e037b6aca3d4dba80: Status 404 returned error can't find the container with id 4642c626a64d9ae4fdce4e81a6bda6d4532583581363a42e037b6aca3d4dba80
Sep 17 18:12:54.372064 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:54.371976    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh" event={"ID":"9a51fa01-ef25-4578-89ab-7499b46c1795","Type":"ContainerStarted","Data":"bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7"}
Sep 17 18:12:54.372473 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:54.372125    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:12:54.372473 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:54.372183    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh" event={"ID":"9a51fa01-ef25-4578-89ab-7499b46c1795","Type":"ContainerStarted","Data":"d659c41e0362ad22844264a056223aea9ec0ae0cbaa8e99a7e7c72ce404efe56"}
Sep 17 18:12:54.373581 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:54.373555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp" event={"ID":"2031add2-7a07-4fd1-b741-e9c22f24e9d6","Type":"ContainerStarted","Data":"77eb4884b96877092d39f89657d93626cdaa3e7ba03b35e166fb50a0632bde30"}
Sep 17 18:12:54.373695 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:54.373589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp" event={"ID":"2031add2-7a07-4fd1-b741-e9c22f24e9d6","Type":"ContainerStarted","Data":"4642c626a64d9ae4fdce4e81a6bda6d4532583581363a42e037b6aca3d4dba80"}
Sep 17 18:12:54.373695 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:54.373675    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:12:54.389267 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:54.389219    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh" podStartSLOduration=0.929599572 podStartE2EDuration="1.389207326s" totalImagesPullingTime="459.607754ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:54.387617057 +0000 UTC m=+2501.038523049" watchObservedRunningTime="2026-09-17 18:12:54.389207326 +0000 UTC m=+2501.040113317"
Sep 17 18:12:54.404979 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:12:54.404936    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp" podStartSLOduration=0.934509268 podStartE2EDuration="1.404924342s" totalImagesPullingTime="470.415074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:54.403311024 +0000 UTC m=+2501.054217017" watchObservedRunningTime="2026-09-17 18:12:54.404924342 +0000 UTC m=+2501.055830335"
Sep 17 18:13:00.384263 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.384183    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65c5475bc5-zpfpp"
Sep 17 18:13:00.384645 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.384492    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:13:00.449202 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.449167    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"]
Sep 17 18:13:00.449383 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.449355    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh" podUID="9a51fa01-ef25-4578-89ab-7499b46c1795" containerName="maas-api" containerID="cri-o://bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7" gracePeriod=30
Sep 17 18:13:00.617828 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.617548    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:13:00.699256 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.699233    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:13:00.718916 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.718889    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shmz8\" (UniqueName: \"kubernetes.io/projected/9a51fa01-ef25-4578-89ab-7499b46c1795-kube-api-access-shmz8\") pod \"9a51fa01-ef25-4578-89ab-7499b46c1795\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") "
Sep 17 18:13:00.719069 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.718976    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-maas-api-tls\") pod \"9a51fa01-ef25-4578-89ab-7499b46c1795\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") "
Sep 17 18:13:00.719069 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.719037    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-metrics-certs\") pod \"9a51fa01-ef25-4578-89ab-7499b46c1795\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") "
Sep 17 18:13:00.719206 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.719088    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a51fa01-ef25-4578-89ab-7499b46c1795-openshift-service-ca\") pod \"9a51fa01-ef25-4578-89ab-7499b46c1795\" (UID: \"9a51fa01-ef25-4578-89ab-7499b46c1795\") "
Sep 17 18:13:00.720013 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.719980    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a51fa01-ef25-4578-89ab-7499b46c1795-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a51fa01-ef25-4578-89ab-7499b46c1795" (UID: "9a51fa01-ef25-4578-89ab-7499b46c1795"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:13:00.721364 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.721337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a51fa01-ef25-4578-89ab-7499b46c1795-kube-api-access-shmz8" (OuterVolumeSpecName: "kube-api-access-shmz8") pod "9a51fa01-ef25-4578-89ab-7499b46c1795" (UID: "9a51fa01-ef25-4578-89ab-7499b46c1795"). InnerVolumeSpecName "kube-api-access-shmz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:13:00.721511 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.721463    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a51fa01-ef25-4578-89ab-7499b46c1795" (UID: "9a51fa01-ef25-4578-89ab-7499b46c1795"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:13:00.723425 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.723398    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9a51fa01-ef25-4578-89ab-7499b46c1795" (UID: "9a51fa01-ef25-4578-89ab-7499b46c1795"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:13:00.820519 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.820479    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-maas-api-tls\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:13:00.820519 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.820515    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a51fa01-ef25-4578-89ab-7499b46c1795-metrics-certs\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:13:00.820519 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.820524    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a51fa01-ef25-4578-89ab-7499b46c1795-openshift-service-ca\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:13:00.820519 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:00.820533    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shmz8\" (UniqueName: \"kubernetes.io/projected/9a51fa01-ef25-4578-89ab-7499b46c1795-kube-api-access-shmz8\") on node \"ip-10-0-131-245.ec2.internal\" DevicePath \"\""
Sep 17 18:13:01.409855 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:01.409820    2563 generic.go:356] "Generic (PLEG): container finished" podID="9a51fa01-ef25-4578-89ab-7499b46c1795" containerID="bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7" exitCode=0
Sep 17 18:13:01.410345 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:01.409869    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"
Sep 17 18:13:01.410345 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:01.409916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh" event={"ID":"9a51fa01-ef25-4578-89ab-7499b46c1795","Type":"ContainerDied","Data":"bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7"}
Sep 17 18:13:01.410345 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:01.409985    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh" event={"ID":"9a51fa01-ef25-4578-89ab-7499b46c1795","Type":"ContainerDied","Data":"d659c41e0362ad22844264a056223aea9ec0ae0cbaa8e99a7e7c72ce404efe56"}
Sep 17 18:13:01.410345 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:01.410018    2563 scope.go:117] "RemoveContainer" containerID="bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7"
Sep 17 18:13:01.420372 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:01.420354    2563 scope.go:117] "RemoveContainer" containerID="bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7"
Sep 17 18:13:01.420680 ip-10-0-131-245 kubenswrapper[2563]: E0917 18:13:01.420661    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7\": container with ID starting with bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7 not found: ID does not exist" containerID="bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7"
Sep 17 18:13:01.420774 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:01.420689    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7"} err="failed to get container status \"bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7\": rpc error: code = NotFound desc = could not find container \"bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7\": container with ID starting with bd69f24bb835045371203661492341f2cea6dec331a0e9b630182ea828377bd7 not found: ID does not exist"
Sep 17 18:13:01.431350 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:01.431325    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"]
Sep 17 18:13:01.434456 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:01.434424    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c99d599cf-45hnh"]
Sep 17 18:13:01.616398 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:01.616360    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a51fa01-ef25-4578-89ab-7499b46c1795" path="/var/lib/kubelet/pods/9a51fa01-ef25-4578-89ab-7499b46c1795/volumes"
Sep 17 18:13:07.524061 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:07.524023    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:13:15.529658 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:15.529618    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:13:21.038032 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:21.037992    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw9l6"]
Sep 17 18:13:29.191339 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:29.191311    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wzc29_f3649c3a-4c63-4b7d-b0ad-2a062722e10c/manager/0.log"
Sep 17 18:13:29.304038 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:29.304009    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-584f5b8894-jp4sp_8c8f8652-a87c-4124-868c-9123ebc11e6d/copy-manifests/0.log"
Sep 17 18:13:29.311052 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:29.311033    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-584f5b8894-jp4sp_8c8f8652-a87c-4124-868c-9123ebc11e6d/manager/0.log"
Sep 17 18:13:29.977690 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:29.977663    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-65c5475bc5-zpfpp_2031add2-7a07-4fd1-b741-e9c22f24e9d6/maas-api/0.log"
Sep 17 18:13:30.085222 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:30.085191    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29827785-997xs_4c17a5f8-c2b0-4d38-b0b8-9a88d2e8ec53/cleanup/0.log"
Sep 17 18:13:31.642461 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:31.642434    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-xw9l6_d5011632-8f68-47a3-a2a4-db05e5533b06/limitador/0.log"
Sep 17 18:13:32.093232 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:32.093207    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl_0ce9be34-3680-42d5-8821-55f2e003bba4/istio-proxy/0.log"
Sep 17 18:13:32.207801 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:32.207773    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xx257_fb2c40fe-3483-4da9-a529-9676c8394b23/discovery/0.log"
Sep 17 18:13:32.526578 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:32.526550    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fdnt5_79abe069-9c02-44c6-9ba7-cc58175e7fb6/istio-proxy/1.log"
Sep 17 18:13:42.242737 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:42.242690    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5fvs6_124f3ca2-a7c1-4341-9057-cbdee0290438/global-pull-secret-syncer/0.log"
Sep 17 18:13:42.446640 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:42.446616    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t5gp8_7fe879ea-0463-4647-8190-5cb7552bb02f/konnectivity-agent/0.log"
Sep 17 18:13:42.466348 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:42.466324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-245.ec2.internal_254195a29b049715cb5595a99d80b7be/haproxy/0.log"
Sep 17 18:13:47.789996 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:47.789965    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-xw9l6_d5011632-8f68-47a3-a2a4-db05e5533b06/limitador/0.log"
Sep 17 18:13:49.972056 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:49.971973    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wnxgl_5aa2c310-216c-4556-b5b7-777a436ce594/node-exporter/0.log"
Sep 17 18:13:49.995833 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:49.995810    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wnxgl_5aa2c310-216c-4556-b5b7-777a436ce594/kube-rbac-proxy/0.log"
Sep 17 18:13:50.015072 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.015050    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wnxgl_5aa2c310-216c-4556-b5b7-777a436ce594/init-textfile/0.log"
Sep 17 18:13:50.040977 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.040955    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-tbk7j_9651fa47-3e0a-4b86-a331-f5cedc9978af/kube-rbac-proxy-main/0.log"
Sep 17 18:13:50.069602 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.069587    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-tbk7j_9651fa47-3e0a-4b86-a331-f5cedc9978af/kube-rbac-proxy-self/0.log"
Sep 17 18:13:50.095543 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.095524    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-tbk7j_9651fa47-3e0a-4b86-a331-f5cedc9978af/openshift-state-metrics/0.log"
Sep 17 18:13:50.158071 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.158046    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ecd11254-7aca-42ce-a040-1f4f7f665757/prometheus/0.log"
Sep 17 18:13:50.180193 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.180163    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ecd11254-7aca-42ce-a040-1f4f7f665757/config-reloader/0.log"
Sep 17 18:13:50.204204 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.204178    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ecd11254-7aca-42ce-a040-1f4f7f665757/thanos-sidecar/0.log"
Sep 17 18:13:50.228731 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.228644    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ecd11254-7aca-42ce-a040-1f4f7f665757/kube-rbac-proxy-web/0.log"
Sep 17 18:13:50.251311 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.251287    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ecd11254-7aca-42ce-a040-1f4f7f665757/kube-rbac-proxy/0.log"
Sep 17 18:13:50.283515 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.283489    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ecd11254-7aca-42ce-a040-1f4f7f665757/kube-rbac-proxy-thanos/0.log"
Sep 17 18:13:50.303892 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.303865    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ecd11254-7aca-42ce-a040-1f4f7f665757/init-config-reloader/0.log"
Sep 17 18:13:50.332304 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.332281    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-6cq72_e0ca7a25-2717-45be-bcbb-3184cf094aa1/prometheus-operator/0.log"
Sep 17 18:13:50.377735 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.377693    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-6cq72_e0ca7a25-2717-45be-bcbb-3184cf094aa1/kube-rbac-proxy/0.log"
Sep 17 18:13:50.443885 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.443855    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-wzmsk_5cfe22e0-8a35-4f49-9a18-a009adf23c4d/prometheus-operator-admission-webhook/0.log"
Sep 17 18:13:50.537427 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.537398    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fd79995c4-824hq_05f1ae65-f7f4-40b4-956e-1fd6c251baac/telemeter-client/0.log"
Sep 17 18:13:50.567352 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.567330    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fd79995c4-824hq_05f1ae65-f7f4-40b4-956e-1fd6c251baac/reload/0.log"
Sep 17 18:13:50.588925 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.588904    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fd79995c4-824hq_05f1ae65-f7f4-40b4-956e-1fd6c251baac/kube-rbac-proxy/0.log"
Sep 17 18:13:50.628125 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.628102    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774c75bcc5-8xxqk_4e0af69b-0c53-4681-810f-20d2f1202428/thanos-query/0.log"
Sep 17 18:13:50.650641 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.650622    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774c75bcc5-8xxqk_4e0af69b-0c53-4681-810f-20d2f1202428/kube-rbac-proxy-web/0.log"
Sep 17 18:13:50.675091 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.675073    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774c75bcc5-8xxqk_4e0af69b-0c53-4681-810f-20d2f1202428/kube-rbac-proxy/0.log"
Sep 17 18:13:50.697358 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.697337    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774c75bcc5-8xxqk_4e0af69b-0c53-4681-810f-20d2f1202428/prom-label-proxy/0.log"
Sep 17 18:13:50.731267 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.731248    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774c75bcc5-8xxqk_4e0af69b-0c53-4681-810f-20d2f1202428/kube-rbac-proxy-rules/0.log"
Sep 17 18:13:50.753547 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:50.753524    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774c75bcc5-8xxqk_4e0af69b-0c53-4681-810f-20d2f1202428/kube-rbac-proxy-metrics/0.log"
Sep 17 18:13:52.624050 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.624026    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/1.log"
Sep 17 18:13:52.628592 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.628573    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8jsfv_44bdd433-c035-4a3a-998c-989c92d5bb50/console-operator/2.log"
Sep 17 18:13:52.745000 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.744969    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"]
Sep 17 18:13:52.745672 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.745463    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a51fa01-ef25-4578-89ab-7499b46c1795" containerName="maas-api"
Sep 17 18:13:52.745672 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.745484    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a51fa01-ef25-4578-89ab-7499b46c1795" containerName="maas-api"
Sep 17 18:13:52.745672 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.745599    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a51fa01-ef25-4578-89ab-7499b46c1795" containerName="maas-api"
Sep 17 18:13:52.749039 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.749022    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.751164 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.751140    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8kb2r\"/\"openshift-service-ca.crt\""
Sep 17 18:13:52.751977 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.751955    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8kb2r\"/\"kube-root-ca.crt\""
Sep 17 18:13:52.752128 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.752109    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8kb2r\"/\"default-dockercfg-dkft9\""
Sep 17 18:13:52.756946 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.756928    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"]
Sep 17 18:13:52.812673 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.812644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-podres\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.812823 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.812684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv44n\" (UniqueName: \"kubernetes.io/projected/d122bce8-8752-4178-959d-50988646e541-kube-api-access-dv44n\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.812823 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.812774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-lib-modules\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.812823 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.812806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-proc\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.812943 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.812886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-sys\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.913690 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.913620    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-sys\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.913690 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.913658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-podres\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.913871 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.913722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv44n\" (UniqueName: \"kubernetes.io/projected/d122bce8-8752-4178-959d-50988646e541-kube-api-access-dv44n\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.913871 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.913770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-sys\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.913871 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.913776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-lib-modules\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.913871 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.913817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-podres\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.913871 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.913820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-proc\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.913871 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.913856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-proc\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.914082 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.913877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d122bce8-8752-4178-959d-50988646e541-lib-modules\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:52.921977 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:52.921962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv44n\" (UniqueName: \"kubernetes.io/projected/d122bce8-8752-4178-959d-50988646e541-kube-api-access-dv44n\") pod \"perf-node-gather-daemonset-rzlnw\" (UID: \"d122bce8-8752-4178-959d-50988646e541\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:53.059656 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:53.059619    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:53.227296 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:53.227215    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c66548b85-49xvz_cfd8cc64-571c-4c7e-b673-6d92640791c5/console/0.log"
Sep 17 18:13:53.266086 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:53.266063    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-b5g8t_0ba03747-7a71-4e16-9a60-c7ce6e487a35/download-server/0.log"
Sep 17 18:13:53.337113 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:53.337054    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"]
Sep 17 18:13:53.339394 ip-10-0-131-245 kubenswrapper[2563]: W0917 18:13:53.339366    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd122bce8_8752_4178_959d_50988646e541.slice/crio-9155d63c4a3925ba1052919f6da07b2ca817bcf27a4c7803c43322508b185584 WatchSource:0}: Error finding container 9155d63c4a3925ba1052919f6da07b2ca817bcf27a4c7803c43322508b185584: Status 404 returned error can't find the container with id 9155d63c4a3925ba1052919f6da07b2ca817bcf27a4c7803c43322508b185584
Sep 17 18:13:53.672016 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:53.671983    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw" event={"ID":"d122bce8-8752-4178-959d-50988646e541","Type":"ContainerStarted","Data":"4aedbd19c3b70bcfa434f3b11281021e214cb7311a86189e6404b82972d45294"}
Sep 17 18:13:53.672488 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:53.672036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw" event={"ID":"d122bce8-8752-4178-959d-50988646e541","Type":"ContainerStarted","Data":"9155d63c4a3925ba1052919f6da07b2ca817bcf27a4c7803c43322508b185584"}
Sep 17 18:13:53.672488 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:53.672064    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:13:53.688185 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:53.688132    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw" podStartSLOduration=1.688117246 podStartE2EDuration="1.688117246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:13:53.686196927 +0000 UTC m=+2560.337102972" watchObservedRunningTime="2026-09-17 18:13:53.688117246 +0000 UTC m=+2560.339023229"
Sep 17 18:13:53.925828 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:53.925740    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-c4xqf_d5989aee-c598-43e3-a028-6338582bfa6e/volume-data-source-validator/0.log"
Sep 17 18:13:55.034680 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:55.034653    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c7tsd_d2703893-5d20-4d4f-88d0-a6f5e28da54b/dns/0.log"
Sep 17 18:13:55.052811 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:55.052785    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c7tsd_d2703893-5d20-4d4f-88d0-a6f5e28da54b/kube-rbac-proxy/0.log"
Sep 17 18:13:55.165649 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:55.165624    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8dcd2_45dcbf30-6c5f-44a5-a37c-74825385a0de/dns-node-resolver/0.log"
Sep 17 18:13:55.784335 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:55.784305    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-96rtm_72664012-dccc-49e5-b790-333fd5db999f/node-ca/0.log"
Sep 17 18:13:56.759231 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:56.759201    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl_0ce9be34-3680-42d5-8821-55f2e003bba4/istio-proxy/0.log"
Sep 17 18:13:57.193575 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:57.193546    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xx257_fb2c40fe-3483-4da9-a529-9676c8394b23/discovery/0.log"
Sep 17 18:13:57.265958 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:57.265933    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fdnt5_79abe069-9c02-44c6-9ba7-cc58175e7fb6/istio-proxy/0.log"
Sep 17 18:13:57.268507 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:57.268487    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fdnt5_79abe069-9c02-44c6-9ba7-cc58175e7fb6/istio-proxy/1.log"
Sep 17 18:13:58.243887 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:58.243859    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-97vgb_83175e6e-f6e0-49dc-986b-b05ebe54fbef/serve-healthcheck-canary/0.log"
Sep 17 18:13:58.842222 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:58.842194    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npr75_badc9616-73e0-4ec8-a359-cd87b537e4f0/kube-rbac-proxy/0.log"
Sep 17 18:13:58.860194 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:58.860173    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npr75_badc9616-73e0-4ec8-a359-cd87b537e4f0/exporter/0.log"
Sep 17 18:13:58.879861 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:58.879838    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npr75_badc9616-73e0-4ec8-a359-cd87b537e4f0/extractor/0.log"
Sep 17 18:13:59.686529 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:13:59.686500    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-rzlnw"
Sep 17 18:14:01.716997 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:01.716967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wzc29_f3649c3a-4c63-4b7d-b0ad-2a062722e10c/manager/0.log"
Sep 17 18:14:01.739986 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:01.739958    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-584f5b8894-jp4sp_8c8f8652-a87c-4124-868c-9123ebc11e6d/manager/0.log"
Sep 17 18:14:01.760016 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:01.759991    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-584f5b8894-jp4sp_8c8f8652-a87c-4124-868c-9123ebc11e6d/copy-manifests/0.log"
Sep 17 18:14:02.842961 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:02.842930    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl_0ce9be34-3680-42d5-8821-55f2e003bba4/istio-proxy/0.log"
Sep 17 18:14:03.280933 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:03.280903    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xx257_fb2c40fe-3483-4da9-a529-9676c8394b23/discovery/0.log"
Sep 17 18:14:03.344654 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:03.344623    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fdnt5_79abe069-9c02-44c6-9ba7-cc58175e7fb6/istio-proxy/0.log"
Sep 17 18:14:03.347555 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:03.347534    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fdnt5_79abe069-9c02-44c6-9ba7-cc58175e7fb6/istio-proxy/1.log"
Sep 17 18:14:03.372441 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:03.372369    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79bc5f98c4-smrdx_891ec8f4-0be7-4d97-935a-be700d9b0dd7/manager/0.log"
Sep 17 18:14:03.397106 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:03.397082    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2vk47_f22677f5-11fa-4785-a6c0-8ce74d16a008/openshift-lws-operator/0.log"
Sep 17 18:14:05.038053 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:05.038020    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-72ppl_0ce9be34-3680-42d5-8821-55f2e003bba4/istio-proxy/0.log"
Sep 17 18:14:05.481371 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:05.481276    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xx257_fb2c40fe-3483-4da9-a529-9676c8394b23/discovery/0.log"
Sep 17 18:14:05.569909 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:05.569873    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fdnt5_79abe069-9c02-44c6-9ba7-cc58175e7fb6/istio-proxy/0.log"
Sep 17 18:14:05.572856 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:05.572833    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fdnt5_79abe069-9c02-44c6-9ba7-cc58175e7fb6/istio-proxy/1.log"
Sep 17 18:14:10.018485 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:10.018457    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6t8mv_5fe498d7-a0fc-4320-8898-5f3161cf97f0/kube-multus-additional-cni-plugins/0.log"
Sep 17 18:14:10.044932 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:10.044911    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6t8mv_5fe498d7-a0fc-4320-8898-5f3161cf97f0/egress-router-binary-copy/0.log"
Sep 17 18:14:10.068990 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:10.068966    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6t8mv_5fe498d7-a0fc-4320-8898-5f3161cf97f0/cni-plugins/0.log"
Sep 17 18:14:10.090190 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:10.090169    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6t8mv_5fe498d7-a0fc-4320-8898-5f3161cf97f0/bond-cni-plugin/0.log"
Sep 17 18:14:10.110118 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:10.110097    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6t8mv_5fe498d7-a0fc-4320-8898-5f3161cf97f0/routeoverride-cni/0.log"
Sep 17 18:14:10.130359 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:10.130340    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6t8mv_5fe498d7-a0fc-4320-8898-5f3161cf97f0/whereabouts-cni-bincopy/0.log"
Sep 17 18:14:10.150461 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:10.150443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6t8mv_5fe498d7-a0fc-4320-8898-5f3161cf97f0/whereabouts-cni/0.log"
Sep 17 18:14:10.534491 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:10.534460    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qzxbl_7d5fa0d2-4bb4-4db1-9728-53c98bcb5c9d/kube-multus/0.log"
Sep 17 18:14:10.698762 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:10.698732    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xhm5z_adef32ee-aef3-4bdd-a6df-62f66b8b7466/network-metrics-daemon/0.log"
Sep 17 18:14:10.718092 ip-10-0-131-245 kubenswrapper[2563]: I0917 18:14:10.718071    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xhm5z_adef32ee-aef3-4bdd-a6df-62f66b8b7466/kube-rbac-proxy/0.log"