Sep 16 14:02:19.864296 ip-10-0-139-140 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 14:02:19.864308 ip-10-0-139-140 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 14:02:19.864314 ip-10-0-139-140 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 14:02:19.864479 ip-10-0-139-140 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 14:02:30.013397 ip-10-0-139-140 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 14:02:30.013412 ip-10-0-139-140 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d696c589c95c484eb37bb80b24687814 --
Sep 16 14:04:20.604864 ip-10-0-139-140 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 14:04:20.932444 ip-10-0-139-140 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:04:20.932444 ip-10-0-139-140 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 14:04:20.932444 ip-10-0-139-140 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:04:20.932444 ip-10-0-139-140 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 14:04:20.932444 ip-10-0-139-140 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:04:20.934624 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.934522    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 14:04:20.939735 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939714    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:04:20.939735 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939731    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:04:20.939735 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939735    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:04:20.939735 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939738    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:04:20.939735 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939741    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939744    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939748    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939751    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939754    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939757    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939759    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939762    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939765    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939768    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939770    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939773    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939776    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939778    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939781    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939783    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939786    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939790    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939795    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:04:20.939916 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939798    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939801    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939803    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939806    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939809    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939813    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939816    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939819    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939822    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939826    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939829    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939832    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939835    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939837    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939840    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939843    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939846    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939849    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939852    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:04:20.940376 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939854    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939857    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939860    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939862    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939865    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939868    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939871    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939874    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939876    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939879    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939881    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939884    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939886    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939889    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939893    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939895    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939898    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939900    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939903    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939906    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939908    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:04:20.940857 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939911    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939913    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939915    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939918    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939921    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939924    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939927    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939931    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939934    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939936    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939939    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939942    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939944    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939947    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939950    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939954    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939957    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939960    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939963    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:04:20.941364 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939965    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939969    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939971    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939974    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939976    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939979    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939981    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939984    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939986    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939989    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939991    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939994    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939996    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.939999    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.940001    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.940004    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.940006    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941288    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941296    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941299    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:04:20.941952 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941303    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941306    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941309    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941313    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941316    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941319    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941321    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941324    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941327    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941330    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941332    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941335    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941337    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941340    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941343    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941346    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941349    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941351    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941354    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941356    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:04:20.942439 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941359    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941361    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941364    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941367    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941369    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941372    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941375    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941378    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941381    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941383    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941386    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941389    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941392    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941395    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941397    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941400    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941402    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941405    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941407    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941410    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:04:20.942966 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941412    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941415    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941417    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941420    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941422    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941425    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941427    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941430    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941435    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941438    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941442    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941446    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941449    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941451    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941454    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941456    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941459    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941462    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941465    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:04:20.943460 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941468    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941470    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941473    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941476    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941479    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941481    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941484    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941487    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941489    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941492    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941494    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941497    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941500    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941502    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941505    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941507    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941510    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941512    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941514    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941517    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:04:20.943951 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941519    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941522    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941525    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941528    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941531    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941534    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941537    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941539    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941542    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941561    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941568    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941573    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941578    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941581    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941584    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941587    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941590    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941960    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941965    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941968    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:04:20.944446 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941971    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941974    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941976    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941979    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941982    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941985    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941987    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941990    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941993    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941996    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.941998    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942001    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942003    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942007    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942010    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942012    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942014    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942017    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942019    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:04:20.944955 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942023    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942027    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942031    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942035    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942038    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942041    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942044    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942048    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942052    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942054    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942058    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942060    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942063    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942066    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942068    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942071    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942073    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942076    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942078    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942081    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:04:20.945421 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942083    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942086    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942088    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942091    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942093    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942096    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942098    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942101    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942104    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942106    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942109    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942111    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942114    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942116    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942119    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942121    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942124    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942126    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942129    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942131    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:04:20.945919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942133    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942138    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942140    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942143    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942146    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942148    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942151    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942153    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942156    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942158    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942161    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942163    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942166    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942168    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942170    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942173    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942175    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942178    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942180    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942183    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:04:20.946410 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942187    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942189    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942192    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942195    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942197    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942199    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942202    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942204    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942207    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942209    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942212    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942214    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942217    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942219    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942222    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942224    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942227    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942296    2579 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942330    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942336    2579 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942341    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 14:04:20.946954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942345    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942348    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942352    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942356    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942359    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942362    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942365    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942369    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942372    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942375    2579 flags.go:64] FLAG: --cgroup-root=""
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942378    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942381    2579 flags.go:64] FLAG: --client-ca-file=""
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942384    2579 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942387    2579 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942391    2579 flags.go:64] FLAG: --cluster-domain=""
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942394    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942396    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942399    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942403    2579 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942407    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942410    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942413    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942416    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942419    2579 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 14:04:20.947469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942422    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942425    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942428    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942431    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942435    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942438    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942441    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942444    2579 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942447    2579 flags.go:64] FLAG: --enable-server="true"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942450    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942455    2579 flags.go:64] FLAG: --event-burst="100"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942458    2579 flags.go:64] FLAG: --event-qps="50"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942461    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942464    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942467    2579 flags.go:64] FLAG: --eviction-hard=""
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942470    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942473    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942476    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942479    2579 flags.go:64] FLAG: --eviction-soft=""
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942482    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942485    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942488    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942491    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942494    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942497    2579 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 14:04:20.948068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942500    2579 flags.go:64] FLAG: --feature-gates=""
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942507    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942510    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942513    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942516    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942519    2579 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942523    2579 flags.go:64] FLAG: --help="false"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942526    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-139-140.ec2.internal"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942530    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942533    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942536    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942539    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942556    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942560    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942563    2579 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942566    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942569    2579 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942572    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942575    2579 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942578    2579 flags.go:64] FLAG: --kube-reserved=""
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942581    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942584    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942587    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942590    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 14:04:20.948708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942593    2579 flags.go:64] FLAG: --lock-file=""
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942596    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942599    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942602    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942607    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942610    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942613    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942616    2579 flags.go:64] FLAG: --logging-format="text"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942619    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942624    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942626    2579 flags.go:64] FLAG: --manifest-url=""
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942629    2579 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942634    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942637    2579 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942641    2579 flags.go:64] FLAG: --max-pods="110"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942644    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942649    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942652    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942655    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942658    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942661    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942663    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942670    2579 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942673    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942676    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 14:04:20.949628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942679    2579 flags.go:64] FLAG: --pod-cidr=""
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942682    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942688    2579 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942691    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942694    2579 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942697    2579 flags.go:64] FLAG: --port="10250"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942700    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942703    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02184966f1c5c66cc"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942706    2579 flags.go:64] FLAG: --qos-reserved=""
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942709    2579 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942712    2579 flags.go:64] FLAG: --register-node="true"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942715    2579 flags.go:64] FLAG: --register-with-taints=""
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942719    2579 flags.go:64] FLAG: --registry-burst="10"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942722    2579 flags.go:64] FLAG: --registry-qps="5"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942725    2579 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942728    2579 flags.go:64] FLAG: --reserved-memory=""
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942732    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942736    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942739    2579 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942742    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942745    2579 flags.go:64] FLAG: --runonce="false"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942748    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942751    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942755    2579 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942758    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 14:04:20.950693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942761    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942764    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942767    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942770    2579 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942773    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942776    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942779    2579 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942782    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942785    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942788    2579 flags.go:64] FLAG: --system-cgroups=""
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942791    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942796    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942799    2579 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942802    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942806    2579 flags.go:64] FLAG: --tls-min-version=""
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942809    2579 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942812    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942815    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942818    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942821    2579 flags.go:64] FLAG: --v="2"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942824    2579 flags.go:64] FLAG: --version="false"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942829    2579 flags.go:64] FLAG: --vmodule=""
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942833    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.942836    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 14:04:20.951649 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942952    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942955    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942958    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942960    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942963    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942966    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942971    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942973    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942976    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942979    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942981    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942985    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942987    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942990    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942993    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942995    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.942998    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943001    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943004    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943006    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:04:20.952365 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943009    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943012    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943015    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943017    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943020    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943022    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943025    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943028    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943030    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943033    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943036    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943039    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943043    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943046    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943048    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943051    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943054    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943057    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943061    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943064    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:04:20.953267 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943066    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943069    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943072    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943074    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943077    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943081    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943085    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943088    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943091    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943094    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943097    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943099    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943102    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943104    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943107    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943111    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943114    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943117    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943120    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:04:20.953930 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943122    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943125    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943127    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943130    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943133    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943139    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943141    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943144    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943146    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943149    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943152    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943156    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943159    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943162    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943164    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943167    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943170    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943174    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943177    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943180    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:04:20.954681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943183    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943185    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943188    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943191    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943194    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943196    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943199    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943201    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943204    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943207    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943209    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943212    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943214    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943217    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943219    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943222    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943225    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943229    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943231    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:04:20.955497 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.943234    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.943723    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.951286    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.951304    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.952109    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.952122    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952209    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952218    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952223    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952228    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952232    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952237    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952241    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952246    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:04:20.956247 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952251    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952255    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952260    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952264    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952268    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952274    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952278    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952282    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952286    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952290    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952295    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952299    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952303    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952307    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952312    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952316    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952320    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952324    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952329    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952333    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:04:20.956632 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952338    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952345    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952349    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952354    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952358    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952362    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952365    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952370    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952376    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952381    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952385    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952390    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952395    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952400    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952404    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952409    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952413    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952417    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952422    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:04:20.957170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952428    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952434    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952438    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952442    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952446    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952451    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952455    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952459    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952463    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952467    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952471    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952475    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952480    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952486    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952493    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952498    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952503    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952507    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952511    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:04:20.957667 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952515    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952519    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952524    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952528    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952532    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952536    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952541    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952564    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952568    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952572    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952576    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952580    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952584    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952589    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952593    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952597    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952601    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952605    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952609    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952613    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:04:20.958168 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952618    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952623    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952627    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952631    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952635    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952639    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952643    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952648    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952652    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952657    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952661    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952665    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952670    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.952678    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952887    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:04:20.958703 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952895    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952901    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952905    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952910    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952915    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952919    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952923    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952928    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952932    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952936    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952940    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952945    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952949    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952953    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952957    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952961    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952965    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952969    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952973    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952977    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:04:20.959252 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952981    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952985    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952989    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952994    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.952998    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953003    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953007    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953011    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953016    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953020    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953024    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953028    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953032    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953036    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953040    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953044    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953048    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953052    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953057    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953062    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:04:20.960089 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953066    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953070    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953074    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953078    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953083    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953087    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953090    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953095    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953099    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953103    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953107    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953112    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953119    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953125    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953130    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953134    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953139    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953144    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953149    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:04:20.960946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953154    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953159    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953164    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953168    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953172    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953176    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953180    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953184    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953188    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953195    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953200    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953205    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953209    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953214    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953220    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953225    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953230    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953235    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953239    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:04:20.961620 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953243    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953247    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953251    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953255    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953259    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953263    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953267    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953272    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953275    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953279    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953283    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953287    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953291    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953295    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953299    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953304    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953309    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953313    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953317    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:04:20.962142 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:20.953321    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:04:20.962941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.953329    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:04:20.962941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.953473    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 14:04:20.962941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.955993    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 14:04:20.962941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.956969    2579 server.go:1019] "Starting client certificate rotation"
Sep 16 14:04:20.962941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.957071    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 14:04:20.962941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.957105    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 14:04:20.962941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.959530    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 14:04:20.962941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.961298    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 14:04:20.972018 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.972001    2579 log.go:25] "Validated CRI v1 runtime API"
Sep 16 14:04:20.974664 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.974649    2579 log.go:25] "Validated CRI v1 image API"
Sep 16 14:04:20.975534 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.975505    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 14:04:20.980345 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.980327    2579 fs.go:135] Filesystem UUIDs: map[668b644b-3fdc-4b78-9e43-b298828a8b5e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b8818dd1-731d-4203-9781-94249acbeed9:/dev/nvme0n1p3]
Sep 16 14:04:20.980424 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.980344    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 14:04:20.986138 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.986025    2579 manager.go:216] Machine: {Timestamp:2026-09-16 14:04:20.98416327 +0000 UTC m=+0.283573528 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093228 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe5dd28b4cdac3544930fb4d1703a SystemUUID:ec2fe5dd-28b4-cdac-3544-930fb4d1703a BootID:d696c589-c95c-484e-b37b-b80b24687814 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e6:e6:2e:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e6:e6:2e:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:db:1e:91:ed:46 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 14:04:20.986138 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.986133    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 14:04:20.986250 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.986212    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 14:04:20.988791 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.988762    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 14:04:20.988976 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.988793    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-140.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 14:04:20.989569 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.989558    2579 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 14:04:20.989607 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.989570    2579 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 14:04:20.989607 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.989578    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 14:04:20.989607 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.989591    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 14:04:20.990420 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.990410    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 14:04:20.994252 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.994241    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 14:04:20.994363 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.994355    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 14:04:20.994884 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.994873    2579 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 14:04:20.994923 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.994894    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 14:04:20.994923 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.994909    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 14:04:20.994923 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.994918    2579 kubelet.go:398] "Adding apiserver pod source"
Sep 16 14:04:20.995017 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.994926    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 14:04:20.995302 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.995291    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 14:04:20.995341 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.995309    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 14:04:20.997079 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.997055    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 14:04:20.999522 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.999505    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 14:04:20.999622 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.999539    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 14:04:20.999677 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:20.999536    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 14:04:21.001113 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001100    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 14:04:21.001172 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001117    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 14:04:21.001172 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001123    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 14:04:21.001172 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001129    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 14:04:21.001172 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001137    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 14:04:21.001172 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001143    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 14:04:21.001172 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001156    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 14:04:21.001172 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001161    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 14:04:21.001350 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001172    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 14:04:21.001350 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001188    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 14:04:21.001350 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001199    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 14:04:21.001350 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.001207    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 14:04:21.002062 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.002048    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 14:04:21.002094 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.002066    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 14:04:21.007527 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.007506    2579 server.go:1268] "Started kubelet"
Sep 16 14:04:21.007747 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.007715    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 14:04:21.007886 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.007702    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 14:04:21.007961 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.007915    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 14:04:21.008460 ip-10-0-139-140 systemd[1]: Started Kubernetes Kubelet.
Sep 16 14:04:21.010117 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.010104    2579 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 14:04:21.010403 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.010387    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 14:04:21.010839 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.010819    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-140.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 14:04:21.010916 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.010837    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 14:04:21.011107 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.011083    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 14:04:21.012516 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.012499    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 14:04:21.014571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.014542    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 14:04:21.014571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.014565    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 14:04:21.014917 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.014896    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:21.015262 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.015245    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 14:04:21.015262 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.015247    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 14:04:21.015403 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.015273    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 14:04:21.015484 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.015470    2579 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 14:04:21.015535 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.015484    2579 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 14:04:21.016490 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.015576    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fcef29f01  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.007466241 +0000 UTC m=+0.306876498,LastTimestamp:2026-09-16 14:04:21.007466241 +0000 UTC m=+0.306876498,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.016615 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.016494    2579 factory.go:55] Registering systemd factory
Sep 16 14:04:21.016615 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.016508    2579 factory.go:223] Registration of the systemd container factory successfully
Sep 16 14:04:21.017761 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.016921    2579 factory.go:153] Registering CRI-O factory
Sep 16 14:04:21.017761 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.016931    2579 factory.go:223] Registration of the crio container factory successfully
Sep 16 14:04:21.017761 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.016971    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 14:04:21.017761 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.016985    2579 factory.go:103] Registering Raw factory
Sep 16 14:04:21.017761 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.016995    2579 manager.go:1196] Started watching for new ooms in manager
Sep 16 14:04:21.017761 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.017573    2579 manager.go:349] Starting recovery of all containers
Sep 16 14:04:21.027567 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.027516    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 14:04:21.028009 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.027985    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 14:04:21.029831 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.029816    2579 manager.go:354] Recovery completed
Sep 16 14:04:21.035368 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.035353    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:04:21.037181 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.037150    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:04:21.037271 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.037195    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:04:21.037271 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.037210    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:04:21.037971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.037816    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 14:04:21.038039 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.037978    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 14:04:21.038039 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.037997    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 14:04:21.038102 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.037831    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:04:21.038849 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.038832    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:04:21.038911 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.038864    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:04:21.038911 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.038878    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:04:21.040184 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.040173    2579 policy_none.go:49] "None policy: Start"
Sep 16 14:04:21.040219 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.040190    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 14:04:21.040219 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.040200    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 14:04:21.042119 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.042105    2579 policy_none.go:47] "Start"
Sep 16 14:04:21.045005 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.044921    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b808d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037181139 +0000 UTC m=+0.336591398,LastTimestamp:2026-09-16 14:04:21.037181139 +0000 UTC m=+0.336591398,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.061504 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.061438    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b85723  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037201187 +0000 UTC m=+0.336611446,LastTimestamp:2026-09-16 14:04:21.037201187 +0000 UTC m=+0.336611446,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.069023    2579 manager.go:337] "Starting Device Plugin manager"
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.069054    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.069063    2579 server.go:87] "Starting device plugin registration server"
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.069351    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.069362    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.069471    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.069618    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.069628    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.070103    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.070141    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.072316    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b88d97  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037215127 +0000 UTC m=+0.336625387,LastTimestamp:2026-09-16 14:04:21.037215127 +0000 UTC m=+0.336625387,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.091687 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.082941    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-140.ec2.internal.18d5d21fd0b808d3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b808d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037181139 +0000 UTC m=+0.336591398,LastTimestamp:2026-09-16 14:04:21.038848815 +0000 UTC m=+0.338259075,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.106772 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.106700    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-140.ec2.internal.18d5d21fd0b85723\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b85723  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037201187 +0000 UTC m=+0.336611446,LastTimestamp:2026-09-16 14:04:21.038870844 +0000 UTC m=+0.338281104,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.108806 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.108781    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 14:04:21.109953 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.109935    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 14:04:21.110026 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.109979    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 14:04:21.110026 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.110002    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 14:04:21.110119 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.110096    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 14:04:21.119183 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.119160    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 16 14:04:21.120119 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.120057    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-140.ec2.internal.18d5d21fd0b88d97\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b88d97  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037215127 +0000 UTC m=+0.336625387,LastTimestamp:2026-09-16 14:04:21.038882701 +0000 UTC m=+0.338292963,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.130584 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.130502    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd36343a4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.081957284 +0000 UTC m=+0.381367529,LastTimestamp:2026-09-16 14:04:21.081957284 +0000 UTC m=+0.381367529,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.169656 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.169637    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:04:21.170487 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.170472    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:04:21.170575 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.170500    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:04:21.170575 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.170513    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:04:21.170575 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.170542    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.187384 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.187258    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-140.ec2.internal.18d5d21fd0b808d3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b808d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037181139 +0000 UTC m=+0.336591398,LastTimestamp:2026-09-16 14:04:21.170487129 +0000 UTC m=+0.469897386,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.198306 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.198282    2579 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-139-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.207975 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.207912    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-140.ec2.internal.18d5d21fd0b85723\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b85723  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037201187 +0000 UTC m=+0.336611446,LastTimestamp:2026-09-16 14:04:21.1705055 +0000 UTC m=+0.469915760,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.210417 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.210386    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal"]
Sep 16 14:04:21.210489 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.210418    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-140.ec2.internal.18d5d21fd0b88d97\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b88d97  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037215127 +0000 UTC m=+0.336625387,LastTimestamp:2026-09-16 14:04:21.170519162 +0000 UTC m=+0.469929421,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.210489 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.210468    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:04:21.211288 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.211272    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:04:21.211360 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.211306    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:04:21.211360 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.211322    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:04:21.213616 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.213603    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:04:21.213736 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.213723    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.213791 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.213751    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:04:21.214325 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.214305    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:04:21.214416 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.214339    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:04:21.214416 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.214362    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:04:21.214671 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.214654    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:04:21.214755 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.214683    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:04:21.214755 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.214697    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:04:21.216256 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.216227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c6d1b33687c0d99c8bd06c017ca0016-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"0c6d1b33687c0d99c8bd06c017ca0016\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.216335 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.216260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c6d1b33687c0d99c8bd06c017ca0016-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"0c6d1b33687c0d99c8bd06c017ca0016\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.216335 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.216274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/615418bae492da132dc002c225bf9501-config\") pod \"kube-apiserver-proxy-ip-10-0-139-140.ec2.internal\" (UID: \"615418bae492da132dc002c225bf9501\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.217218 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.217204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.217263 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.217230    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:04:21.217929 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.217914    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:04:21.218008 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.217967    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:04:21.218008 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.217985    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:04:21.219817 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.219763    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-140.ec2.internal.18d5d21fd0b808d3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b808d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037181139 +0000 UTC m=+0.336591398,LastTimestamp:2026-09-16 14:04:21.211288813 +0000 UTC m=+0.510699076,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.239123 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.239095    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-140.ec2.internal\" not found" node="ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.239363 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.239341    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms"
Sep 16 14:04:21.239363 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.239295    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-140.ec2.internal.18d5d21fd0b85723\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b85723  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037201187 +0000 UTC m=+0.336611446,LastTimestamp:2026-09-16 14:04:21.211313451 +0000 UTC m=+0.510723710,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.243588 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.243572    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-140.ec2.internal\" not found" node="ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.248405 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.248352    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-140.ec2.internal.18d5d21fd0b88d97\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b88d97  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037215127 +0000 UTC m=+0.336625387,LastTimestamp:2026-09-16 14:04:21.211328609 +0000 UTC m=+0.510738866,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.265027 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.265008    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b2xzr"
Sep 16 14:04:21.282265 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.282204    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-140.ec2.internal.18d5d21fd0b808d3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b808d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037181139 +0000 UTC m=+0.336591398,LastTimestamp:2026-09-16 14:04:21.214323976 +0000 UTC m=+0.513734234,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.293654 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.293634    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b2xzr"
Sep 16 14:04:21.298909 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.298854    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-140.ec2.internal.18d5d21fd0b85723\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18d5d21fd0b85723  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-09-16 14:04:21.037201187 +0000 UTC m=+0.336611446,LastTimestamp:2026-09-16 14:04:21.214346114 +0000 UTC m=+0.513756374,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}"
Sep 16 14:04:21.317284 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.317261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/615418bae492da132dc002c225bf9501-config\") pod \"kube-apiserver-proxy-ip-10-0-139-140.ec2.internal\" (UID: \"615418bae492da132dc002c225bf9501\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.317368 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.317289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c6d1b33687c0d99c8bd06c017ca0016-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"0c6d1b33687c0d99c8bd06c017ca0016\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.317368 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.317304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c6d1b33687c0d99c8bd06c017ca0016-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"0c6d1b33687c0d99c8bd06c017ca0016\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.317368 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.317329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c6d1b33687c0d99c8bd06c017ca0016-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"0c6d1b33687c0d99c8bd06c017ca0016\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.317368 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.317349    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/615418bae492da132dc002c225bf9501-config\") pod \"kube-apiserver-proxy-ip-10-0-139-140.ec2.internal\" (UID: \"615418bae492da132dc002c225bf9501\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.317511 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.317371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c6d1b33687c0d99c8bd06c017ca0016-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"0c6d1b33687c0d99c8bd06c017ca0016\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.398484 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.398450    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:04:21.400951 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.400928    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:04:21.401047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.400963    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:04:21.401047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.400978    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:04:21.401047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.401003    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.411401 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.411385    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.411493 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.411409    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-140.ec2.internal\": node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:21.462634 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.462580    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:21.542062 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.542042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.547018 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.546779    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:21.563277 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.563256    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:21.663596 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.663569    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:21.764074 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.764008    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:21.854997 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.854969    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:04:21.864523 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.864495    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:21.956928 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.956905    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 14:04:21.957385 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:21.957078    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 14:04:21.965186 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:21.965165    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:22.065388 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:22.065365    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:22.066648 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:22.066614    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615418bae492da132dc002c225bf9501.slice/crio-ae66aed6817d89944ed63f47cd165ac1c3c402848b2ea6af33e46a53c3bfc80e WatchSource:0}: Error finding container ae66aed6817d89944ed63f47cd165ac1c3c402848b2ea6af33e46a53c3bfc80e: Status 404 returned error can't find the container with id ae66aed6817d89944ed63f47cd165ac1c3c402848b2ea6af33e46a53c3bfc80e
Sep 16 14:04:22.071111 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.071095    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:04:22.086441 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.086423    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:04:22.094139 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.094119    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:04:22.094944 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.094926    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:04:22.095034 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.094961    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:04:22.095034 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.094978    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:04:22.113639 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.113598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" event={"ID":"615418bae492da132dc002c225bf9501","Type":"ContainerStarted","Data":"ae66aed6817d89944ed63f47cd165ac1c3c402848b2ea6af33e46a53c3bfc80e"}
Sep 16 14:04:22.166989 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:22.166965    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:22.270843 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:22.270819    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found"
Sep 16 14:04:22.299446 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.299412    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 13:59:22 +0000 UTC" deadline="2028-06-05 15:18:12.72990966 +0000 UTC"
Sep 16 14:04:22.299522 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.299445    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15073h13m50.430469524s"
Sep 16 14:04:22.356780 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.356706    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:04:22.417112 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.417086    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:22.428794 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.428774    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 14:04:22.429719 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.429706    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal"
Sep 16 14:04:22.444045 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.444023    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 14:04:22.571836 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.571805    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:04:22.604981 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:22.604950    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6d1b33687c0d99c8bd06c017ca0016.slice/crio-b429a07b6e9f934f0eff64f3d5b7ca28fe71f3e2c98e14f3de2604111c6232b9 WatchSource:0}: Error finding container b429a07b6e9f934f0eff64f3d5b7ca28fe71f3e2c98e14f3de2604111c6232b9: Status 404 returned error can't find the container with id b429a07b6e9f934f0eff64f3d5b7ca28fe71f3e2c98e14f3de2604111c6232b9
Sep 16 14:04:22.996046 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:22.995978    2579 apiserver.go:52] "Watching apiserver"
Sep 16 14:04:23.005018 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.004990    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 14:04:23.005407 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.005386    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-vdsdt","openshift-ovn-kubernetes/ovnkube-node-kvt4l","kube-system/konnectivity-agent-bshdp","openshift-image-registry/node-ca-rx59j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal","openshift-multus/multus-lkzv6","openshift-network-diagnostics/network-check-target-gq5pp","openshift-network-operator/iptables-alerter-c5qg8","kube-system/global-pull-secret-syncer-dv2zf","kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp","openshift-cluster-node-tuning-operator/tuned-xgskb","openshift-dns/node-resolver-btn76","openshift-multus/multus-additional-cni-plugins-gwvrg"]
Sep 16 14:04:23.008009 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.007990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:23.008089 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.008061    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:23.010255 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.010238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.012394 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.012369    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:23.013916 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.013897    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 14:04:23.013916 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.013898    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 14:04:23.014062 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.013954    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 14:04:23.014197 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.014178    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-grknj\""
Sep 16 14:04:23.014704 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.014689    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rx59j"
Sep 16 14:04:23.015328 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.015306    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 14:04:23.015419 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.015327    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 14:04:23.015509 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.015488    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hfsls\""
Sep 16 14:04:23.015657 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.015637    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 14:04:23.018327 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.017521    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 14:04:23.018327 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.017759    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.018327 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.017998    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4fxz6\""
Sep 16 14:04:23.019382 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.018553    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 14:04:23.019382 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.018579    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 14:04:23.020738 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.020717    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.023160 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.023144    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:23.023253 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.023205    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:23.023723 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.023698    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 14:04:23.023802 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.023763    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 14:04:23.023901 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.023884    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 14:04:23.023982 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.023921    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mgvg9\""
Sep 16 14:04:23.023982 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.023884    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 14:04:23.024144 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.023884    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xj5ng\""
Sep 16 14:04:23.024144 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.024061    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 14:04:23.024406 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.024390    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 14:04:23.025463 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.025445    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btn76"
Sep 16 14:04:23.026430 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026414    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-socket-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.026517 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026443    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-device-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.026517 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhzml\" (UniqueName: \"kubernetes.io/projected/5fb4988c-a391-4702-929a-62089b153bd9-kube-api-access-hhzml\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.026517 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b2310b8-b4db-4fa7-8d8d-d31e27a81665-serviceca\") pod \"node-ca-rx59j\" (UID: \"2b2310b8-b4db-4fa7-8d8d-d31e27a81665\") " pod="openshift-image-registry/node-ca-rx59j"
Sep 16 14:04:23.026729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.026729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026548    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-registration-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.026729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.026729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-sys-fs\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.026729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b2310b8-b4db-4fa7-8d8d-d31e27a81665-host\") pod \"node-ca-rx59j\" (UID: \"2b2310b8-b4db-4fa7-8d8d-d31e27a81665\") " pod="openshift-image-registry/node-ca-rx59j"
Sep 16 14:04:23.026729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66575877-fa65-47fe-b600-9c9f1d5eb268-system-cni-dir\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.026954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66575877-fa65-47fe-b600-9c9f1d5eb268-cnibin\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.026954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88pts\" (UniqueName: \"kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts\") pod \"network-check-target-gq5pp\" (UID: \"b655a103-09b9-4934-8c20-c44fae75cf19\") " pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:23.026954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cba36ab5-17fb-458a-b1ac-4329c74a478a-konnectivity-ca\") pod \"konnectivity-agent-bshdp\" (UID: \"cba36ab5-17fb-458a-b1ac-4329c74a478a\") " pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:23.026954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xctwp\" (UniqueName: \"kubernetes.io/projected/2b2310b8-b4db-4fa7-8d8d-d31e27a81665-kube-api-access-xctwp\") pod \"node-ca-rx59j\" (UID: \"2b2310b8-b4db-4fa7-8d8d-d31e27a81665\") " pod="openshift-image-registry/node-ca-rx59j"
Sep 16 14:04:23.026954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66575877-fa65-47fe-b600-9c9f1d5eb268-cni-binary-copy\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.026954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66575877-fa65-47fe-b600-9c9f1d5eb268-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.026954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66575877-fa65-47fe-b600-9c9f1d5eb268-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.026954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/66575877-fa65-47fe-b600-9c9f1d5eb268-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.026954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cba36ab5-17fb-458a-b1ac-4329c74a478a-agent-certs\") pod \"konnectivity-agent-bshdp\" (UID: \"cba36ab5-17fb-458a-b1ac-4329c74a478a\") " pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:23.026954 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.026900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4s55\" (UniqueName: \"kubernetes.io/projected/66575877-fa65-47fe-b600-9c9f1d5eb268-kube-api-access-g4s55\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.027921 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.027906    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.028800 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.028778    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 14:04:23.028957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.028944    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 14:04:23.029014 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.028942    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-swwlx\""
Sep 16 14:04:23.030112 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.030096    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 14:04:23.030347 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.030327    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 14:04:23.030347 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.030332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c5qg8"
Sep 16 14:04:23.031338 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.031318    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 14:04:23.032048 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.032032    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 14:04:23.032115 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.032069    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 14:04:23.032693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.032628    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9cqmq\""
Sep 16 14:04:23.032693 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.032660    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 14:04:23.032827 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.032702    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 14:04:23.032945 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.032930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:23.033018 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.032998    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:23.034705 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.034689    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 14:04:23.035083 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.035050    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:04:23.035211 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.035196    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tpfr6\""
Sep 16 14:04:23.035284 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.035227    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.038527 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.038512    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 14:04:23.044868 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.044847    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:04:23.044958 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.044938    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d6ttt\""
Sep 16 14:04:23.045389 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.045375    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 14:04:23.072432 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.072413    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gl895"
Sep 16 14:04:23.091610 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.091584    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gl895"
Sep 16 14:04:23.117397 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.117369    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 14:04:23.119248 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.119214    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" event={"ID":"0c6d1b33687c0d99c8bd06c017ca0016","Type":"ContainerStarted","Data":"b429a07b6e9f934f0eff64f3d5b7ca28fe71f3e2c98e14f3de2604111c6232b9"}
Sep 16 14:04:23.128006 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.127971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66575877-fa65-47fe-b600-9c9f1d5eb268-cni-binary-copy\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.128114 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-sysctl-d\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.128114 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-sys\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.128114 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-node-log\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.128114 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2eaccbd-4b52-4347-9153-840ca5cd0017-env-overrides\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.128339 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cba36ab5-17fb-458a-b1ac-4329c74a478a-agent-certs\") pod \"konnectivity-agent-bshdp\" (UID: \"cba36ab5-17fb-458a-b1ac-4329c74a478a\") " pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:23.128339 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-cni-dir\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.128339 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4gh5\" (UniqueName: \"kubernetes.io/projected/e473b1f3-e471-4931-bbcb-01aa22cdc91e-kube-api-access-g4gh5\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.128339 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-kubernetes\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.128339 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhzml\" (UniqueName: \"kubernetes.io/projected/5fb4988c-a391-4702-929a-62089b153bd9-kube-api-access-hhzml\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.128339 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:23.128667 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-lib-modules\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.128667 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-run-netns\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.128667 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2eaccbd-4b52-4347-9153-840ca5cd0017-ovnkube-script-lib\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.128667 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66575877-fa65-47fe-b600-9c9f1d5eb268-system-cni-dir\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.128667 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-sysctl-conf\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.128667 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128634    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66575877-fa65-47fe-b600-9c9f1d5eb268-cni-binary-copy\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.128971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128686    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66575877-fa65-47fe-b600-9c9f1d5eb268-system-cni-dir\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.128971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128695    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 14:04:23.128971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-var-lib-cni-multus\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.128971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-conf-dir\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.128971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-run-multus-certs\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.128971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.128971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3cc021e-bde8-4cc2-b169-b940b65af6a1-iptables-alerter-script\") pod \"iptables-alerter-c5qg8\" (UID: \"f3cc021e-bde8-4cc2-b169-b940b65af6a1\") " pod="openshift-network-operator/iptables-alerter-c5qg8"
Sep 16 14:04:23.128971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cba36ab5-17fb-458a-b1ac-4329c74a478a-konnectivity-ca\") pod \"konnectivity-agent-bshdp\" (UID: \"cba36ab5-17fb-458a-b1ac-4329c74a478a\") " pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:23.128971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.128963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4s55\" (UniqueName: \"kubernetes.io/projected/66575877-fa65-47fe-b600-9c9f1d5eb268-kube-api-access-g4s55\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-tuned\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e473b1f3-e471-4931-bbcb-01aa22cdc91e-cni-binary-copy\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-run-systemd\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129080    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-var-lib-openvswitch\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129104    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9176e0ae-8c42-4247-9a57-e0260a972717-dbus\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-run-ovn\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2eaccbd-4b52-4347-9153-840ca5cd0017-ovn-node-metrics-cert\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kj75\" (UniqueName: \"kubernetes.io/projected/f3cc021e-bde8-4cc2-b169-b940b65af6a1-kube-api-access-7kj75\") pod \"iptables-alerter-c5qg8\" (UID: \"f3cc021e-bde8-4cc2-b169-b940b65af6a1\") " pod="openshift-network-operator/iptables-alerter-c5qg8"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-device-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-systemd\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9176e0ae-8c42-4247-9a57-e0260a972717-kubelet-config\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-device-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.129439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129429    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-run-openvswitch\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-cni-netd\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-daemon-config\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-etc-kubernetes\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-registration-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129534    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cba36ab5-17fb-458a-b1ac-4329c74a478a-konnectivity-ca\") pod \"konnectivity-agent-bshdp\" (UID: \"cba36ab5-17fb-458a-b1ac-4329c74a478a\") " pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b2310b8-b4db-4fa7-8d8d-d31e27a81665-host\") pod \"node-ca-rx59j\" (UID: \"2b2310b8-b4db-4fa7-8d8d-d31e27a81665\") " pod="openshift-image-registry/node-ca-rx59j"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129613    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-registration-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129661    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/66575877-fa65-47fe-b600-9c9f1d5eb268-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129725    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-modprobe-d\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129758    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b2310b8-b4db-4fa7-8d8d-d31e27a81665-host\") pod \"node-ca-rx59j\" (UID: \"2b2310b8-b4db-4fa7-8d8d-d31e27a81665\") " pod="openshift-image-registry/node-ca-rx59j"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k262c\" (UniqueName: \"kubernetes.io/projected/280b9b34-af5f-4eb3-aca5-27e6bcb9220c-kube-api-access-k262c\") pod \"node-resolver-btn76\" (UID: \"280b9b34-af5f-4eb3-aca5-27e6bcb9220c\") " pod="openshift-dns/node-resolver-btn76"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129870    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-log-socket\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctwp\" (UniqueName: \"kubernetes.io/projected/2b2310b8-b4db-4fa7-8d8d-d31e27a81665-kube-api-access-xctwp\") pod \"node-ca-rx59j\" (UID: \"2b2310b8-b4db-4fa7-8d8d-d31e27a81665\") " pod="openshift-image-registry/node-ca-rx59j"
Sep 16 14:04:23.130059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.129924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66575877-fa65-47fe-b600-9c9f1d5eb268-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130158    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/66575877-fa65-47fe-b600-9c9f1d5eb268-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdt2c\" (UniqueName: \"kubernetes.io/projected/62eb4c77-c001-4f17-8000-4217b8f165bc-kube-api-access-sdt2c\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66575877-fa65-47fe-b600-9c9f1d5eb268-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-var-lib-kubelet\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-slash\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-kubelet\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130295    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-cni-bin\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3cc021e-bde8-4cc2-b169-b940b65af6a1-host-slash\") pod \"iptables-alerter-c5qg8\" (UID: \"f3cc021e-bde8-4cc2-b169-b940b65af6a1\") " pod="openshift-network-operator/iptables-alerter-c5qg8"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-socket-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-var-lib-kubelet\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-host\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2eaccbd-4b52-4347-9153-840ca5cd0017-ovnkube-config\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5k6q\" (UniqueName: \"kubernetes.io/projected/f2eaccbd-4b52-4347-9153-840ca5cd0017-kube-api-access-g5k6q\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66575877-fa65-47fe-b600-9c9f1d5eb268-cnibin\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66575877-fa65-47fe-b600-9c9f1d5eb268-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.130744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5zts\" (UniqueName: \"kubernetes.io/projected/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-kube-api-access-b5zts\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130566    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-socket-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-socket-dir-parent\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130612    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-var-lib-cni-bin\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66575877-fa65-47fe-b600-9c9f1d5eb268-cnibin\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130720    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/280b9b34-af5f-4eb3-aca5-27e6bcb9220c-hosts-file\") pod \"node-resolver-btn76\" (UID: \"280b9b34-af5f-4eb3-aca5-27e6bcb9220c\") " pod="openshift-dns/node-resolver-btn76"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88pts\" (UniqueName: \"kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts\") pod \"network-check-target-gq5pp\" (UID: \"b655a103-09b9-4934-8c20-c44fae75cf19\") " pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-cnibin\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130818    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-hostroot\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-run-ovn-kubernetes\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130860    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-sysconfig\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-run\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.130991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-system-cni-dir\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b2310b8-b4db-4fa7-8d8d-d31e27a81665-serviceca\") pod \"node-ca-rx59j\" (UID: \"2b2310b8-b4db-4fa7-8d8d-d31e27a81665\") " pod="openshift-image-registry/node-ca-rx59j"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131031    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-run-k8s-cni-cncf-io\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66575877-fa65-47fe-b600-9c9f1d5eb268-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-systemd-units\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.131488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-etc-openvswitch\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.132159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.132159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.132159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.132159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131271    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.132159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-sys-fs\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.132159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62eb4c77-c001-4f17-8000-4217b8f165bc-tmp\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.132159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-run-netns\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.132159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:23.132159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131384    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5fb4988c-a391-4702-929a-62089b153bd9-sys-fs\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.132159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/280b9b34-af5f-4eb3-aca5-27e6bcb9220c-tmp-dir\") pod \"node-resolver-btn76\" (UID: \"280b9b34-af5f-4eb3-aca5-27e6bcb9220c\") " pod="openshift-dns/node-resolver-btn76"
Sep 16 14:04:23.132159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.131440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b2310b8-b4db-4fa7-8d8d-d31e27a81665-serviceca\") pod \"node-ca-rx59j\" (UID: \"2b2310b8-b4db-4fa7-8d8d-d31e27a81665\") " pod="openshift-image-registry/node-ca-rx59j"
Sep 16 14:04:23.133268 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.133248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cba36ab5-17fb-458a-b1ac-4329c74a478a-agent-certs\") pod \"konnectivity-agent-bshdp\" (UID: \"cba36ab5-17fb-458a-b1ac-4329c74a478a\") " pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:23.142319 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.142292    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4s55\" (UniqueName: \"kubernetes.io/projected/66575877-fa65-47fe-b600-9c9f1d5eb268-kube-api-access-g4s55\") pod \"multus-additional-cni-plugins-gwvrg\" (UID: \"66575877-fa65-47fe-b600-9c9f1d5eb268\") " pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.143059 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.143024    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:04:23.143059 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.143049    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:04:23.143059 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.143060    2579 projected.go:196] Error preparing data for projected volume kube-api-access-88pts for pod openshift-network-diagnostics/network-check-target-gq5pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:23.143291 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.143124    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts podName:b655a103-09b9-4934-8c20-c44fae75cf19 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:23.643105677 +0000 UTC m=+2.942515923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-88pts" (UniqueName: "kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts") pod "network-check-target-gq5pp" (UID: "b655a103-09b9-4934-8c20-c44fae75cf19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:23.145840 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.145816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhzml\" (UniqueName: \"kubernetes.io/projected/5fb4988c-a391-4702-929a-62089b153bd9-kube-api-access-hhzml\") pod \"aws-ebs-csi-driver-node-g7qqp\" (UID: \"5fb4988c-a391-4702-929a-62089b153bd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.146156 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.146139    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xctwp\" (UniqueName: \"kubernetes.io/projected/2b2310b8-b4db-4fa7-8d8d-d31e27a81665-kube-api-access-xctwp\") pod \"node-ca-rx59j\" (UID: \"2b2310b8-b4db-4fa7-8d8d-d31e27a81665\") " pod="openshift-image-registry/node-ca-rx59j"
Sep 16 14:04:23.231864 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.231832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-cnibin\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.231864 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.231868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-hostroot\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.232099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.231891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-run-ovn-kubernetes\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.232099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.231951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-sysconfig\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.232099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.231984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-run\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.232099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.231996    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-cnibin\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.232099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.231999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-run-ovn-kubernetes\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.232099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-system-cni-dir\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.232099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-run\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.232099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-run-k8s-cni-cncf-io\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.232099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232084    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-sysconfig\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232104    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-hostroot\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-systemd-units\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232129    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-system-cni-dir\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232139    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-systemd-units\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-etc-openvswitch\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232172    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-run-k8s-cni-cncf-io\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62eb4c77-c001-4f17-8000-4217b8f165bc-tmp\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232254    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-etc-openvswitch\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-run-netns\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.232406    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-run-netns\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/280b9b34-af5f-4eb3-aca5-27e6bcb9220c-tmp-dir\") pod \"node-resolver-btn76\" (UID: \"280b9b34-af5f-4eb3-aca5-27e6bcb9220c\") " pod="openshift-dns/node-resolver-btn76"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.232482    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret podName:9176e0ae-8c42-4247-9a57-e0260a972717 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:23.732461354 +0000 UTC m=+3.031871605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret") pod "global-pull-secret-syncer-dv2zf" (UID: "9176e0ae-8c42-4247-9a57-e0260a972717") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232512    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-sysctl-d\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.232538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-sys\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-node-log\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2eaccbd-4b52-4347-9153-840ca5cd0017-env-overrides\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-cni-dir\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232660    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4gh5\" (UniqueName: \"kubernetes.io/projected/e473b1f3-e471-4931-bbcb-01aa22cdc91e-kube-api-access-g4gh5\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232729    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-node-log\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-sys\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/280b9b34-af5f-4eb3-aca5-27e6bcb9220c-tmp-dir\") pod \"node-resolver-btn76\" (UID: \"280b9b34-af5f-4eb3-aca5-27e6bcb9220c\") " pod="openshift-dns/node-resolver-btn76"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-kubernetes\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232863    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-kubernetes\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232879    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-sysctl-d\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-cni-dir\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-lib-modules\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.232984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-run-netns\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2eaccbd-4b52-4347-9153-840ca5cd0017-ovnkube-script-lib\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-sysctl-conf\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.233044    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:23.233387 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233075    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-run-netns\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233084    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-var-lib-cni-multus\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.233115    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs podName:b8d48063-48c0-4bcf-9e7a-1d39b0826ef2 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:23.733089095 +0000 UTC m=+3.032499347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs") pod "network-metrics-daemon-vdsdt" (UID: "b8d48063-48c0-4bcf-9e7a-1d39b0826ef2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-var-lib-cni-multus\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-conf-dir\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-run-multus-certs\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2eaccbd-4b52-4347-9153-840ca5cd0017-env-overrides\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-sysctl-conf\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233230    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-lib-modules\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233230    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233272    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3cc021e-bde8-4cc2-b169-b940b65af6a1-iptables-alerter-script\") pod \"iptables-alerter-c5qg8\" (UID: \"f3cc021e-bde8-4cc2-b169-b940b65af6a1\") " pod="openshift-network-operator/iptables-alerter-c5qg8"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-tuned\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-run-multus-certs\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e473b1f3-e471-4931-bbcb-01aa22cdc91e-cni-binary-copy\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233369    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-conf-dir\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-run-systemd\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.234414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-var-lib-openvswitch\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9176e0ae-8c42-4247-9a57-e0260a972717-dbus\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233494    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-run-ovn\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2eaccbd-4b52-4347-9153-840ca5cd0017-ovn-node-metrics-cert\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kj75\" (UniqueName: \"kubernetes.io/projected/f3cc021e-bde8-4cc2-b169-b940b65af6a1-kube-api-access-7kj75\") pod \"iptables-alerter-c5qg8\" (UID: \"f3cc021e-bde8-4cc2-b169-b940b65af6a1\") " pod="openshift-network-operator/iptables-alerter-c5qg8"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-systemd\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9176e0ae-8c42-4247-9a57-e0260a972717-kubelet-config\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-run-openvswitch\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-cni-netd\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-run-ovn\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-daemon-config\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233754    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-etc-kubernetes\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-modprobe-d\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2eaccbd-4b52-4347-9153-840ca5cd0017-ovnkube-script-lib\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k262c\" (UniqueName: \"kubernetes.io/projected/280b9b34-af5f-4eb3-aca5-27e6bcb9220c-kube-api-access-k262c\") pod \"node-resolver-btn76\" (UID: \"280b9b34-af5f-4eb3-aca5-27e6bcb9220c\") " pod="openshift-dns/node-resolver-btn76"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3cc021e-bde8-4cc2-b169-b940b65af6a1-iptables-alerter-script\") pod \"iptables-alerter-c5qg8\" (UID: \"f3cc021e-bde8-4cc2-b169-b940b65af6a1\") " pod="openshift-network-operator/iptables-alerter-c5qg8"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-log-socket\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.235294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233888    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-run-systemd\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdt2c\" (UniqueName: \"kubernetes.io/projected/62eb4c77-c001-4f17-8000-4217b8f165bc-kube-api-access-sdt2c\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233934    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-var-lib-openvswitch\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-var-lib-kubelet\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233970    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-slash\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233977    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-var-lib-kubelet\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.233997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-kubelet\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-log-socket\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-cni-bin\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3cc021e-bde8-4cc2-b169-b940b65af6a1-host-slash\") pod \"iptables-alerter-c5qg8\" (UID: \"f3cc021e-bde8-4cc2-b169-b940b65af6a1\") " pod="openshift-network-operator/iptables-alerter-c5qg8"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234089    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-var-lib-kubelet\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234113    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-host\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2eaccbd-4b52-4347-9153-840ca5cd0017-ovnkube-config\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5k6q\" (UniqueName: \"kubernetes.io/projected/f2eaccbd-4b52-4347-9153-840ca5cd0017-kube-api-access-g5k6q\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234202    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5zts\" (UniqueName: \"kubernetes.io/projected/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-kube-api-access-b5zts\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-daemon-config\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234259    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-systemd\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.236175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-socket-dir-parent\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234300    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9176e0ae-8c42-4247-9a57-e0260a972717-kubelet-config\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-var-lib-cni-bin\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234355    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-multus-socket-dir-parent\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/280b9b34-af5f-4eb3-aca5-27e6bcb9220c-hosts-file\") pod \"node-resolver-btn76\" (UID: \"280b9b34-af5f-4eb3-aca5-27e6bcb9220c\") " pod="openshift-dns/node-resolver-btn76"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234442    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/280b9b34-af5f-4eb3-aca5-27e6bcb9220c-hosts-file\") pod \"node-resolver-btn76\" (UID: \"280b9b34-af5f-4eb3-aca5-27e6bcb9220c\") " pod="openshift-dns/node-resolver-btn76"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234478    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9176e0ae-8c42-4247-9a57-e0260a972717-dbus\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-run-openvswitch\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e473b1f3-e471-4931-bbcb-01aa22cdc91e-cni-binary-copy\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234530    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-cni-netd\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234551    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-etc-kubernetes\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e473b1f3-e471-4931-bbcb-01aa22cdc91e-host-var-lib-cni-bin\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3cc021e-bde8-4cc2-b169-b940b65af6a1-host-slash\") pod \"iptables-alerter-c5qg8\" (UID: \"f3cc021e-bde8-4cc2-b169-b940b65af6a1\") " pod="openshift-network-operator/iptables-alerter-c5qg8"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-modprobe-d\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234693    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-slash\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234732    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-kubelet\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-var-lib-kubelet\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2eaccbd-4b52-4347-9153-840ca5cd0017-host-cni-bin\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.237063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.234792    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62eb4c77-c001-4f17-8000-4217b8f165bc-host\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.237804 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.235208    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2eaccbd-4b52-4347-9153-840ca5cd0017-ovnkube-config\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.237804 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.235941    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62eb4c77-c001-4f17-8000-4217b8f165bc-etc-tuned\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.237804 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.236173    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62eb4c77-c001-4f17-8000-4217b8f165bc-tmp\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.237804 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.236992    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2eaccbd-4b52-4347-9153-840ca5cd0017-ovn-node-metrics-cert\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.258294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.258228    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4gh5\" (UniqueName: \"kubernetes.io/projected/e473b1f3-e471-4931-bbcb-01aa22cdc91e-kube-api-access-g4gh5\") pod \"multus-lkzv6\" (UID: \"e473b1f3-e471-4931-bbcb-01aa22cdc91e\") " pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.269807 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.269779    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5zts\" (UniqueName: \"kubernetes.io/projected/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-kube-api-access-b5zts\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:23.271503 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.271477    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kj75\" (UniqueName: \"kubernetes.io/projected/f3cc021e-bde8-4cc2-b169-b940b65af6a1-kube-api-access-7kj75\") pod \"iptables-alerter-c5qg8\" (UID: \"f3cc021e-bde8-4cc2-b169-b940b65af6a1\") " pod="openshift-network-operator/iptables-alerter-c5qg8"
Sep 16 14:04:23.282815 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.282794    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdt2c\" (UniqueName: \"kubernetes.io/projected/62eb4c77-c001-4f17-8000-4217b8f165bc-kube-api-access-sdt2c\") pod \"tuned-xgskb\" (UID: \"62eb4c77-c001-4f17-8000-4217b8f165bc\") " pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.283058 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.283036    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k262c\" (UniqueName: \"kubernetes.io/projected/280b9b34-af5f-4eb3-aca5-27e6bcb9220c-kube-api-access-k262c\") pod \"node-resolver-btn76\" (UID: \"280b9b34-af5f-4eb3-aca5-27e6bcb9220c\") " pod="openshift-dns/node-resolver-btn76"
Sep 16 14:04:23.283479 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.283460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5k6q\" (UniqueName: \"kubernetes.io/projected/f2eaccbd-4b52-4347-9153-840ca5cd0017-kube-api-access-g5k6q\") pod \"ovnkube-node-kvt4l\" (UID: \"f2eaccbd-4b52-4347-9153-840ca5cd0017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.321937 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.321912    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp"
Sep 16 14:04:23.329159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.329140    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:23.334480 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:23.334456    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb4988c_a391_4702_929a_62089b153bd9.slice/crio-4f5e4894cfe41eb2e4596b8550ebb260697a4b124cfeffcd5eda77ac2448db21 WatchSource:0}: Error finding container 4f5e4894cfe41eb2e4596b8550ebb260697a4b124cfeffcd5eda77ac2448db21: Status 404 returned error can't find the container with id 4f5e4894cfe41eb2e4596b8550ebb260697a4b124cfeffcd5eda77ac2448db21
Sep 16 14:04:23.335710 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.335684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rx59j"
Sep 16 14:04:23.341536 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:23.341507    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba36ab5_17fb_458a_b1ac_4329c74a478a.slice/crio-f9da98d5843b54d25290bdf33658cdd874faa3ef405555c4e639554ed8a3f765 WatchSource:0}: Error finding container f9da98d5843b54d25290bdf33658cdd874faa3ef405555c4e639554ed8a3f765: Status 404 returned error can't find the container with id f9da98d5843b54d25290bdf33658cdd874faa3ef405555c4e639554ed8a3f765
Sep 16 14:04:23.341653 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.341603    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gwvrg"
Sep 16 14:04:23.348033 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.348010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xgskb"
Sep 16 14:04:23.348339 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:23.348315    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b2310b8_b4db_4fa7_8d8d_d31e27a81665.slice/crio-9b02ffc13f4c2acbce0d5bf2b0fd626caf01071a6ef8ff8b0b0d6210f5089290 WatchSource:0}: Error finding container 9b02ffc13f4c2acbce0d5bf2b0fd626caf01071a6ef8ff8b0b0d6210f5089290: Status 404 returned error can't find the container with id 9b02ffc13f4c2acbce0d5bf2b0fd626caf01071a6ef8ff8b0b0d6210f5089290
Sep 16 14:04:23.351800 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:23.351776    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66575877_fa65_47fe_b600_9c9f1d5eb268.slice/crio-91102d3783d8071a465a85eb367c42fdbf759c92f88aec38c0098f43bc507e3a WatchSource:0}: Error finding container 91102d3783d8071a465a85eb367c42fdbf759c92f88aec38c0098f43bc507e3a: Status 404 returned error can't find the container with id 91102d3783d8071a465a85eb367c42fdbf759c92f88aec38c0098f43bc507e3a
Sep 16 14:04:23.353071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.353051    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lkzv6"
Sep 16 14:04:23.358729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.358706    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btn76"
Sep 16 14:04:23.358917 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:23.358893    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62eb4c77_c001_4f17_8000_4217b8f165bc.slice/crio-5918f1cc03e1fd0c23701331b81b779270cdcb3ab314a707ba7cd31a73ac100c WatchSource:0}: Error finding container 5918f1cc03e1fd0c23701331b81b779270cdcb3ab314a707ba7cd31a73ac100c: Status 404 returned error can't find the container with id 5918f1cc03e1fd0c23701331b81b779270cdcb3ab314a707ba7cd31a73ac100c
Sep 16 14:04:23.363768 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:23.363744    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode473b1f3_e471_4931_bbcb_01aa22cdc91e.slice/crio-b65dff542a619161e2613848b5306e874087b1119bb3d926d9760a44262bafe5 WatchSource:0}: Error finding container b65dff542a619161e2613848b5306e874087b1119bb3d926d9760a44262bafe5: Status 404 returned error can't find the container with id b65dff542a619161e2613848b5306e874087b1119bb3d926d9760a44262bafe5
Sep 16 14:04:23.364711 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.364688    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:23.368615 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:23.368592    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280b9b34_af5f_4eb3_aca5_27e6bcb9220c.slice/crio-300adc26d27343cc652e3e037df531d55ca07d05e9cb00b0bc8809abb08a0e0a WatchSource:0}: Error finding container 300adc26d27343cc652e3e037df531d55ca07d05e9cb00b0bc8809abb08a0e0a: Status 404 returned error can't find the container with id 300adc26d27343cc652e3e037df531d55ca07d05e9cb00b0bc8809abb08a0e0a
Sep 16 14:04:23.368706 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.368658    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c5qg8"
Sep 16 14:04:23.376443 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:23.376421    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2eaccbd_4b52_4347_9153_840ca5cd0017.slice/crio-daeb5286258a4a6107329a5828013c07074a60d9497bc7f00c44c0b69e7c7775 WatchSource:0}: Error finding container daeb5286258a4a6107329a5828013c07074a60d9497bc7f00c44c0b69e7c7775: Status 404 returned error can't find the container with id daeb5286258a4a6107329a5828013c07074a60d9497bc7f00c44c0b69e7c7775
Sep 16 14:04:23.380981 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:23.380953    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3cc021e_bde8_4cc2_b169_b940b65af6a1.slice/crio-c0b21290a535505f669b06f3f60d22441965d136894542f28bc8495022284db4 WatchSource:0}: Error finding container c0b21290a535505f669b06f3f60d22441965d136894542f28bc8495022284db4: Status 404 returned error can't find the container with id c0b21290a535505f669b06f3f60d22441965d136894542f28bc8495022284db4
Sep 16 14:04:23.737391 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.737291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88pts\" (UniqueName: \"kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts\") pod \"network-check-target-gq5pp\" (UID: \"b655a103-09b9-4934-8c20-c44fae75cf19\") " pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:23.737391 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.737360    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:23.737632 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:23.737397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:23.737632 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.737486    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:23.737632 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.737487    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:23.737632 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.737489    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:04:23.737632 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.737553    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs podName:b8d48063-48c0-4bcf-9e7a-1d39b0826ef2 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:24.737532048 +0000 UTC m=+4.036942310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs") pod "network-metrics-daemon-vdsdt" (UID: "b8d48063-48c0-4bcf-9e7a-1d39b0826ef2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:23.737632 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.737575    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret podName:9176e0ae-8c42-4247-9a57-e0260a972717 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:24.737563503 +0000 UTC m=+4.036973750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret") pod "global-pull-secret-syncer-dv2zf" (UID: "9176e0ae-8c42-4247-9a57-e0260a972717") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:23.737632 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.737582    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:04:23.737632 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.737598    2579 projected.go:196] Error preparing data for projected volume kube-api-access-88pts for pod openshift-network-diagnostics/network-check-target-gq5pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:23.737967 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:23.737652    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts podName:b655a103-09b9-4934-8c20-c44fae75cf19 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:24.737630598 +0000 UTC m=+4.037040853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-88pts" (UniqueName: "kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts") pod "network-check-target-gq5pp" (UID: "b655a103-09b9-4934-8c20-c44fae75cf19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:24.094413 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.094351    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 13:59:23 +0000 UTC" deadline="2028-06-23 00:03:28.427646964 +0000 UTC"
Sep 16 14:04:24.094413 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.094405    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15489h59m4.333245137s"
Sep 16 14:04:24.122428 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.122386    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c5qg8" event={"ID":"f3cc021e-bde8-4cc2-b169-b940b65af6a1","Type":"ContainerStarted","Data":"c0b21290a535505f669b06f3f60d22441965d136894542f28bc8495022284db4"}
Sep 16 14:04:24.127483 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.127450    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l" event={"ID":"f2eaccbd-4b52-4347-9153-840ca5cd0017","Type":"ContainerStarted","Data":"daeb5286258a4a6107329a5828013c07074a60d9497bc7f00c44c0b69e7c7775"}
Sep 16 14:04:24.129205 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.129181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xgskb" event={"ID":"62eb4c77-c001-4f17-8000-4217b8f165bc","Type":"ContainerStarted","Data":"5918f1cc03e1fd0c23701331b81b779270cdcb3ab314a707ba7cd31a73ac100c"}
Sep 16 14:04:24.130799 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.130773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwvrg" event={"ID":"66575877-fa65-47fe-b600-9c9f1d5eb268","Type":"ContainerStarted","Data":"91102d3783d8071a465a85eb367c42fdbf759c92f88aec38c0098f43bc507e3a"}
Sep 16 14:04:24.133313 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.133290    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btn76" event={"ID":"280b9b34-af5f-4eb3-aca5-27e6bcb9220c","Type":"ContainerStarted","Data":"300adc26d27343cc652e3e037df531d55ca07d05e9cb00b0bc8809abb08a0e0a"}
Sep 16 14:04:24.134955 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.134928    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkzv6" event={"ID":"e473b1f3-e471-4931-bbcb-01aa22cdc91e","Type":"ContainerStarted","Data":"b65dff542a619161e2613848b5306e874087b1119bb3d926d9760a44262bafe5"}
Sep 16 14:04:24.136543 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.136523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rx59j" event={"ID":"2b2310b8-b4db-4fa7-8d8d-d31e27a81665","Type":"ContainerStarted","Data":"9b02ffc13f4c2acbce0d5bf2b0fd626caf01071a6ef8ff8b0b0d6210f5089290"}
Sep 16 14:04:24.141149 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.141120    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bshdp" event={"ID":"cba36ab5-17fb-458a-b1ac-4329c74a478a","Type":"ContainerStarted","Data":"f9da98d5843b54d25290bdf33658cdd874faa3ef405555c4e639554ed8a3f765"}
Sep 16 14:04:24.142772 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.142747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp" event={"ID":"5fb4988c-a391-4702-929a-62089b153bd9","Type":"ContainerStarted","Data":"4f5e4894cfe41eb2e4596b8550ebb260697a4b124cfeffcd5eda77ac2448db21"}
Sep 16 14:04:24.154943 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.154918    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:04:24.745303 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.745218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88pts\" (UniqueName: \"kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts\") pod \"network-check-target-gq5pp\" (UID: \"b655a103-09b9-4934-8c20-c44fae75cf19\") " pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:24.745303 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.745277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:24.745540 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:24.745313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:24.745540 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:24.745452    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:24.745540 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:24.745516    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs podName:b8d48063-48c0-4bcf-9e7a-1d39b0826ef2 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:26.745495012 +0000 UTC m=+6.044905283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs") pod "network-metrics-daemon-vdsdt" (UID: "b8d48063-48c0-4bcf-9e7a-1d39b0826ef2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:24.745976 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:24.745957    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:04:24.746039 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:24.745988    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:04:24.746039 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:24.746003    2579 projected.go:196] Error preparing data for projected volume kube-api-access-88pts for pod openshift-network-diagnostics/network-check-target-gq5pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:24.746149 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:24.746050    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts podName:b655a103-09b9-4934-8c20-c44fae75cf19 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:26.746033993 +0000 UTC m=+6.045444245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-88pts" (UniqueName: "kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts") pod "network-check-target-gq5pp" (UID: "b655a103-09b9-4934-8c20-c44fae75cf19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:24.746149 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:24.746114    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:24.746149 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:24.746147    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret podName:9176e0ae-8c42-4247-9a57-e0260a972717 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:26.746135624 +0000 UTC m=+6.045545871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret") pod "global-pull-secret-syncer-dv2zf" (UID: "9176e0ae-8c42-4247-9a57-e0260a972717") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:25.095031 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:25.094932    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 13:59:23 +0000 UTC" deadline="2028-04-07 23:26:39.63610852 +0000 UTC"
Sep 16 14:04:25.095031 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:25.094979    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13665h22m14.541134622s"
Sep 16 14:04:25.116462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:25.113556    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:25.116462 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:25.116076    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:25.117862 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:25.116473    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:25.117862 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:25.116580    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:25.117862 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:25.116673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:25.117862 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:25.116792    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:25.155942 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:25.155877    2579 generic.go:356] "Generic (PLEG): container finished" podID="0c6d1b33687c0d99c8bd06c017ca0016" containerID="461f96c803b042ea5887ee361529b63bffc64129ea4c8a76bfb1e2a09251a77c" exitCode=0
Sep 16 14:04:25.155942 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:25.155938    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" event={"ID":"0c6d1b33687c0d99c8bd06c017ca0016","Type":"ContainerDied","Data":"461f96c803b042ea5887ee361529b63bffc64129ea4c8a76bfb1e2a09251a77c"}
Sep 16 14:04:26.165161 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:26.165123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" event={"ID":"0c6d1b33687c0d99c8bd06c017ca0016","Type":"ContainerStarted","Data":"cf4a86e2f6c1143fe3096a86ac0dbe74694548bd86815758657df9f7334cf14a"}
Sep 16 14:04:26.768270 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:26.768225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88pts\" (UniqueName: \"kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts\") pod \"network-check-target-gq5pp\" (UID: \"b655a103-09b9-4934-8c20-c44fae75cf19\") " pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:26.768467 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:26.768296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:26.768467 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:26.768382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:26.768589 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:26.768544    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:26.768672 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:26.768627    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs podName:b8d48063-48c0-4bcf-9e7a-1d39b0826ef2 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:30.768589337 +0000 UTC m=+10.067999599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs") pod "network-metrics-daemon-vdsdt" (UID: "b8d48063-48c0-4bcf-9e7a-1d39b0826ef2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:26.768738 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:26.768729    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:04:26.768793 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:26.768748    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:04:26.768793 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:26.768763    2579 projected.go:196] Error preparing data for projected volume kube-api-access-88pts for pod openshift-network-diagnostics/network-check-target-gq5pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:26.768900 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:26.768804    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts podName:b655a103-09b9-4934-8c20-c44fae75cf19 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:30.768791282 +0000 UTC m=+10.068201543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-88pts" (UniqueName: "kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts") pod "network-check-target-gq5pp" (UID: "b655a103-09b9-4934-8c20-c44fae75cf19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:26.768900 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:26.768893    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:26.769007 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:26.768930    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret podName:9176e0ae-8c42-4247-9a57-e0260a972717 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:30.76891776 +0000 UTC m=+10.068328022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret") pod "global-pull-secret-syncer-dv2zf" (UID: "9176e0ae-8c42-4247-9a57-e0260a972717") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:27.110854 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:27.110769    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:27.111025 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:27.110915    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:27.111517 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:27.111495    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:27.111672 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:27.111609    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:27.111746 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:27.111717    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:27.111806 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:27.111792    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:29.111739 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:29.110930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:29.111739 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:29.111077    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:29.111739 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:29.111438    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:29.111739 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:29.111546    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:29.111739 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:29.111592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:29.111739 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:29.111701    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:30.804554 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:30.804523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88pts\" (UniqueName: \"kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts\") pod \"network-check-target-gq5pp\" (UID: \"b655a103-09b9-4934-8c20-c44fae75cf19\") " pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:30.805070 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:30.804584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:30.805070 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:30.804621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:30.805070 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:30.804701    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:04:30.805070 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:30.804729    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:04:30.805070 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:30.804746    2579 projected.go:196] Error preparing data for projected volume kube-api-access-88pts for pod openshift-network-diagnostics/network-check-target-gq5pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:30.805070 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:30.804777    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:30.805070 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:30.804804    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts podName:b655a103-09b9-4934-8c20-c44fae75cf19 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:38.804785097 +0000 UTC m=+18.104195361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-88pts" (UniqueName: "kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts") pod "network-check-target-gq5pp" (UID: "b655a103-09b9-4934-8c20-c44fae75cf19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:30.805070 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:30.804833    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs podName:b8d48063-48c0-4bcf-9e7a-1d39b0826ef2 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:38.80481455 +0000 UTC m=+18.104224799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs") pod "network-metrics-daemon-vdsdt" (UID: "b8d48063-48c0-4bcf-9e7a-1d39b0826ef2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:30.805070 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:30.804777    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:30.805070 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:30.804873    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret podName:9176e0ae-8c42-4247-9a57-e0260a972717 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:38.804862796 +0000 UTC m=+18.104273043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret") pod "global-pull-secret-syncer-dv2zf" (UID: "9176e0ae-8c42-4247-9a57-e0260a972717") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:31.112401 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:31.111450    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:31.112401 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:31.111574    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:31.112401 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:31.111640    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:31.112401 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:31.111716    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:31.112401 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:31.112198    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:31.112401 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:31.112300    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:33.111106 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:33.111067    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:33.111515 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:33.111067    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:33.111515 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:33.111213    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:33.111515 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:33.111067    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:33.111515 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:33.111290    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:33.111515 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:33.111346    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:35.110814 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:35.110742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:35.110814 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:35.110757    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:35.110814 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:35.110757    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:35.111218 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:35.110842    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:35.111218 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:35.110917    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:35.111218 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:35.110994    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:37.110304 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:37.110268    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:37.110764 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:37.110312    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:37.110764 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:37.110414    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:37.110764 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:37.110498    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:37.110764 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:37.110578    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:37.110764 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:37.110662    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:38.868708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:38.868679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:38.869239 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:38.868733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88pts\" (UniqueName: \"kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts\") pod \"network-check-target-gq5pp\" (UID: \"b655a103-09b9-4934-8c20-c44fae75cf19\") " pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:38.869239 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:38.868759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:38.869239 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:38.868850    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:38.869239 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:38.868862    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:04:38.869239 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:38.868885    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:04:38.869239 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:38.868860    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:38.869239 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:38.868897    2579 projected.go:196] Error preparing data for projected volume kube-api-access-88pts for pod openshift-network-diagnostics/network-check-target-gq5pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:38.869239 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:38.868919    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs podName:b8d48063-48c0-4bcf-9e7a-1d39b0826ef2 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:54.868898636 +0000 UTC m=+34.168308896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs") pod "network-metrics-daemon-vdsdt" (UID: "b8d48063-48c0-4bcf-9e7a-1d39b0826ef2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:38.869239 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:38.868938    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret podName:9176e0ae-8c42-4247-9a57-e0260a972717 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:54.868928857 +0000 UTC m=+34.168339109 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret") pod "global-pull-secret-syncer-dv2zf" (UID: "9176e0ae-8c42-4247-9a57-e0260a972717") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:38.869239 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:38.868955    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts podName:b655a103-09b9-4934-8c20-c44fae75cf19 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:54.868945201 +0000 UTC m=+34.168355446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-88pts" (UniqueName: "kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts") pod "network-check-target-gq5pp" (UID: "b655a103-09b9-4934-8c20-c44fae75cf19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:39.111091 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:39.111053    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:39.111257 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:39.111056    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:39.111257 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:39.111161    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:39.111257 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:39.111070    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:39.111257 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:39.111241    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:39.111407 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:39.111348    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:41.111849 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:41.111818    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:41.112258 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:41.111918    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:41.112258 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:41.111928    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:41.112258 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:41.111957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:41.112258 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:41.112018    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:41.112258 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:41.112088    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:43.111213 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:43.111186    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:43.111682 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:43.111199    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:43.111682 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:43.111307    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:43.111682 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:43.111379    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:43.111682 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:43.111420    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:43.111682 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:43.111478    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:44.215590 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.215297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" event={"ID":"615418bae492da132dc002c225bf9501","Type":"ContainerStarted","Data":"9338af29bb0631fd1f91a179ce272b7558621980038183f1148b5ad16c0053b0"}
Sep 16 14:04:44.217229 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.217197    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btn76" event={"ID":"280b9b34-af5f-4eb3-aca5-27e6bcb9220c","Type":"ContainerStarted","Data":"642c3abfc05fd4f801269381d3fa9ac3facbba9e3483e8f507b305b7c02b5fd4"}
Sep 16 14:04:44.219078 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.219055    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkzv6" event={"ID":"e473b1f3-e471-4931-bbcb-01aa22cdc91e","Type":"ContainerStarted","Data":"ebfe7a28b7d8be700d020cc1446fea7640d26b087f22083abbcf7beefd62218f"}
Sep 16 14:04:44.220953 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.220927    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rx59j" event={"ID":"2b2310b8-b4db-4fa7-8d8d-d31e27a81665","Type":"ContainerStarted","Data":"8e082f01232a39e93cdf4391a5492f171c3cb65df689894b165820294b368cd1"}
Sep 16 14:04:44.222582 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.222541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bshdp" event={"ID":"cba36ab5-17fb-458a-b1ac-4329c74a478a","Type":"ContainerStarted","Data":"fb20f7d45e1dd6fcb2db47bf0cc9780a803f6e2734d03a3d12fc5246ada39663"}
Sep 16 14:04:44.224293 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.224272    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp" event={"ID":"5fb4988c-a391-4702-929a-62089b153bd9","Type":"ContainerStarted","Data":"557346762bdfe5ec1870e1eca3c74f34cddc8ee8b9eeb414a45d2641568c69bf"}
Sep 16 14:04:44.227966 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.227941    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l" event={"ID":"f2eaccbd-4b52-4347-9153-840ca5cd0017","Type":"ContainerStarted","Data":"3fbfde82c8759fc5179e7767370f5f6b8ad1705c291e3b2f3c22dc950dacffce"}
Sep 16 14:04:44.228054 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.228025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l" event={"ID":"f2eaccbd-4b52-4347-9153-840ca5cd0017","Type":"ContainerStarted","Data":"22ad8fccd5766d0f7481f8672e8b7837d3f1632777f529819429b09d0bcbfed7"}
Sep 16 14:04:44.228120 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.228073    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l" event={"ID":"f2eaccbd-4b52-4347-9153-840ca5cd0017","Type":"ContainerStarted","Data":"207d9d66e205ff3b9330b69eaacb30a60e1b6fd5dc6e749c715c7b74c5413dd3"}
Sep 16 14:04:44.228178 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.228120    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l" event={"ID":"f2eaccbd-4b52-4347-9153-840ca5cd0017","Type":"ContainerStarted","Data":"fd44da6e529f68ab2391ea16abd777862a72e030823cfda95bcd512e5da029bd"}
Sep 16 14:04:44.228178 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.228169    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l" event={"ID":"f2eaccbd-4b52-4347-9153-840ca5cd0017","Type":"ContainerStarted","Data":"9030711788f18ec49753da76a0e06806c42f0f9041e42525266eacb1ba898e29"}
Sep 16 14:04:44.228265 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.228217    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l" event={"ID":"f2eaccbd-4b52-4347-9153-840ca5cd0017","Type":"ContainerStarted","Data":"58980c5cfc845fd53a46202c8f7a2f7a3c3fe73c56979ba70e180863214694ca"}
Sep 16 14:04:44.229980 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.229777    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xgskb" event={"ID":"62eb4c77-c001-4f17-8000-4217b8f165bc","Type":"ContainerStarted","Data":"d57294ec4c686523973b196406a6ac1f20b8b61eff26b027295c96eb7957d04a"}
Sep 16 14:04:44.230588 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.230522    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" podStartSLOduration=21.230507288 podStartE2EDuration="21.230507288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:04:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:04:26.184053863 +0000 UTC m=+5.483464134" watchObservedRunningTime="2026-09-16 14:04:44.230507288 +0000 UTC m=+23.529917556"
Sep 16 14:04:44.230852 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.230825    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" podStartSLOduration=21.230815806 podStartE2EDuration="21.230815806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:04:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:04:44.230217067 +0000 UTC m=+23.529627346" watchObservedRunningTime="2026-09-16 14:04:44.230815806 +0000 UTC m=+23.530226073"
Sep 16 14:04:44.231578 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.231541    2579 generic.go:356] "Generic (PLEG): container finished" podID="66575877-fa65-47fe-b600-9c9f1d5eb268" containerID="9d4d169855473b240f4b983bbf4dce81922a86ebfe7118ea758ba3f7ad63d7f4" exitCode=0
Sep 16 14:04:44.231670 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.231589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwvrg" event={"ID":"66575877-fa65-47fe-b600-9c9f1d5eb268","Type":"ContainerDied","Data":"9d4d169855473b240f4b983bbf4dce81922a86ebfe7118ea758ba3f7ad63d7f4"}
Sep 16 14:04:44.244853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.244817    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rx59j" podStartSLOduration=2.448556357 podStartE2EDuration="22.244804727s" totalImagesPullingTime="19.79624837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:04:44.244285673 +0000 UTC m=+23.543695938" watchObservedRunningTime="2026-09-16 14:04:44.244804727 +0000 UTC m=+23.544215035"
Sep 16 14:04:44.264587 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.264530    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lkzv6" podStartSLOduration=2.440113067 podStartE2EDuration="22.264518372s" totalImagesPullingTime="19.824405305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:04:44.263989284 +0000 UTC m=+23.563399551" watchObservedRunningTime="2026-09-16 14:04:44.264518372 +0000 UTC m=+23.563928639"
Sep 16 14:04:44.297785 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.297750    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-btn76" podStartSLOduration=2.557634014 podStartE2EDuration="22.297737149s" totalImagesPullingTime="19.740103135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:04:44.281258538 +0000 UTC m=+23.580668830" watchObservedRunningTime="2026-09-16 14:04:44.297737149 +0000 UTC m=+23.597147416"
Sep 16 14:04:44.298161 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.298135    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bshdp" podStartSLOduration=6.677492363 podStartE2EDuration="22.298125601s" totalImagesPullingTime="15.620633238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:04:44.29752737 +0000 UTC m=+23.596937628" watchObservedRunningTime="2026-09-16 14:04:44.298125601 +0000 UTC m=+23.597535868"
Sep 16 14:04:44.315188 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.315154    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xgskb" podStartSLOduration=2.538237434 podStartE2EDuration="22.315142726s" totalImagesPullingTime="19.776905292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:04:44.315121943 +0000 UTC m=+23.614532209" watchObservedRunningTime="2026-09-16 14:04:44.315142726 +0000 UTC m=+23.614552992"
Sep 16 14:04:44.378624 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:44.378604    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 14:04:45.083349 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:45.083207    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T14:04:44.378619547Z","UUID":"2b12f232-01f3-4ada-b018-6dc8996901a8","Handler":null,"Name":"","Endpoint":""}
Sep 16 14:04:45.085052 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:45.085023    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 14:04:45.085179 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:45.085062    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 14:04:45.110347 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:45.110319    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:45.110497 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:45.110318    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:45.110497 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:45.110421    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:45.110588 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:45.110502    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:45.110588 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:45.110559    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:45.110654 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:45.110604    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:45.235905 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:45.235869    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp" event={"ID":"5fb4988c-a391-4702-929a-62089b153bd9","Type":"ContainerStarted","Data":"36a5561a534f771140759151dbe4ce94aad4a3e1615688b667979d5cedf5c6d1"}
Sep 16 14:04:45.237307 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:45.237279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c5qg8" event={"ID":"f3cc021e-bde8-4cc2-b169-b940b65af6a1","Type":"ContainerStarted","Data":"144f50b3f1bb352303db65fd5ce7f6f86747a87fe4f7bd8f45f35ba2ff2f7184"}
Sep 16 14:04:45.247023 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:45.246996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:45.247519 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:45.247501    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:45.295185 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:45.295133    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c5qg8" podStartSLOduration=3.565575085 podStartE2EDuration="23.295116238s" totalImagesPullingTime="19.729541153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:04:45.267173951 +0000 UTC m=+24.566584219" watchObservedRunningTime="2026-09-16 14:04:45.295116238 +0000 UTC m=+24.594526502"
Sep 16 14:04:46.242698 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:46.242658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp" event={"ID":"5fb4988c-a391-4702-929a-62089b153bd9","Type":"ContainerStarted","Data":"fdebf4f18c62c27bc709e9ff65d3bab4d93eecec2dbe6d5ea62d517f78d25534"}
Sep 16 14:04:46.246419 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:46.246388    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l" event={"ID":"f2eaccbd-4b52-4347-9153-840ca5cd0017","Type":"ContainerStarted","Data":"c4effc50eab0782a338b66a36272ebf558f6ddc298a6a2fc508eaf4dd3983fa5"}
Sep 16 14:04:46.246776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:46.246735    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:46.247135 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:46.247117    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bshdp"
Sep 16 14:04:46.265539 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:46.265495    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7qqp" podStartSLOduration=1.8790746889999999 podStartE2EDuration="24.265480755s" totalImagesPullingTime="22.386406066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:04:46.264884657 +0000 UTC m=+25.564294939" watchObservedRunningTime="2026-09-16 14:04:46.265480755 +0000 UTC m=+25.564891019"
Sep 16 14:04:47.110507 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:47.110475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:47.110507 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:47.110483    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:47.110731 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:47.110477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:47.110731 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:47.110591    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:47.110731 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:47.110694    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:47.110824 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:47.110781    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:48.254143 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:48.253882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l" event={"ID":"f2eaccbd-4b52-4347-9153-840ca5cd0017","Type":"ContainerStarted","Data":"4bc520040b586f09f08e9a4629e01fc1055c541a8c6fbae5aa4ee69f6a282e59"}
Sep 16 14:04:48.254665 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:48.254153    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:48.254665 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:48.254205    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:48.270785 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:48.270763    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:48.286697 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:48.286640    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l" podStartSLOduration=6.4551945459999995 podStartE2EDuration="26.286621579s" totalImagesPullingTime="19.831427033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:04:48.286322219 +0000 UTC m=+27.585732500" watchObservedRunningTime="2026-09-16 14:04:48.286621579 +0000 UTC m=+27.586031850"
Sep 16 14:04:49.112426 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:49.112015    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:49.112426 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:49.112158    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:49.112737 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:49.112601    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:49.112737 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:49.112686    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:49.112870 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:49.112843    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:49.113022 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:49.112924    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:49.257681 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:49.257648    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:49.273996 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:49.273973    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:04:49.845437 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:49.845392    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gq5pp"]
Sep 16 14:04:49.845638 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:49.845507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:49.845719 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:49.845637    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:49.850541 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:49.850512    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dv2zf"]
Sep 16 14:04:49.850676 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:49.850626    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:49.850744 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:49.850724    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:49.856655 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:49.856629    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdsdt"]
Sep 16 14:04:49.856776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:49.856729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:49.856865 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:49.856839    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:51.111424 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:51.111346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:51.112010 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:51.111462    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:51.112010 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:51.111502    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:51.112010 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:51.111622    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:51.263851 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:51.263814    2579 generic.go:356] "Generic (PLEG): container finished" podID="66575877-fa65-47fe-b600-9c9f1d5eb268" containerID="d9f26c04c615029e7169064551d3838648ea44f0b9fcf5bc59f496e909734063" exitCode=0
Sep 16 14:04:51.264028 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:51.263898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwvrg" event={"ID":"66575877-fa65-47fe-b600-9c9f1d5eb268","Type":"ContainerDied","Data":"d9f26c04c615029e7169064551d3838648ea44f0b9fcf5bc59f496e909734063"}
Sep 16 14:04:52.110756 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:52.110730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:52.110927 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:52.110844    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:53.110887 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:53.110612    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:53.110887 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:53.110689    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:53.111391 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:53.110904    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:53.111391 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:53.110982    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:54.110524 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:54.110494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:54.110704 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:54.110602    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dv2zf" podUID="9176e0ae-8c42-4247-9a57-e0260a972717"
Sep 16 14:04:54.890180 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:54.890139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:54.890180 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:54.890185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:54.890709 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:54.890237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88pts\" (UniqueName: \"kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts\") pod \"network-check-target-gq5pp\" (UID: \"b655a103-09b9-4934-8c20-c44fae75cf19\") " pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:54.890709 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:54.890294    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:54.890709 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:54.890340    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:54.890709 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:54.890348    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:04:54.890709 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:54.890366    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:04:54.890709 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:54.890378    2579 projected.go:196] Error preparing data for projected volume kube-api-access-88pts for pod openshift-network-diagnostics/network-check-target-gq5pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:54.890709 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:54.890366    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret podName:9176e0ae-8c42-4247-9a57-e0260a972717 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:26.890349517 +0000 UTC m=+66.189759783 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret") pod "global-pull-secret-syncer-dv2zf" (UID: "9176e0ae-8c42-4247-9a57-e0260a972717") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:04:54.890709 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:54.890429    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs podName:b8d48063-48c0-4bcf-9e7a-1d39b0826ef2 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:26.890414019 +0000 UTC m=+66.189824265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs") pod "network-metrics-daemon-vdsdt" (UID: "b8d48063-48c0-4bcf-9e7a-1d39b0826ef2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:04:54.890709 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:54.890441    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts podName:b655a103-09b9-4934-8c20-c44fae75cf19 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:26.890434526 +0000 UTC m=+66.189844772 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-88pts" (UniqueName: "kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts") pod "network-check-target-gq5pp" (UID: "b655a103-09b9-4934-8c20-c44fae75cf19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:04:55.110815 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:55.110787    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:55.110902 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:55.110790    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:55.110977 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:55.110922    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsdt" podUID="b8d48063-48c0-4bcf-9e7a-1d39b0826ef2"
Sep 16 14:04:55.111033 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:55.110984    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gq5pp" podUID="b655a103-09b9-4934-8c20-c44fae75cf19"
Sep 16 14:04:55.273640 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:55.273567    2579 generic.go:356] "Generic (PLEG): container finished" podID="66575877-fa65-47fe-b600-9c9f1d5eb268" containerID="2ee9fa2c05a696220af0f06cb8cd4aa1cae58d461f5ae7097589c25626da695e" exitCode=0
Sep 16 14:04:55.273640 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:55.273610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwvrg" event={"ID":"66575877-fa65-47fe-b600-9c9f1d5eb268","Type":"ContainerDied","Data":"2ee9fa2c05a696220af0f06cb8cd4aa1cae58d461f5ae7097589c25626da695e"}
Sep 16 14:04:56.001718 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.001646    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeReady"
Sep 16 14:04:56.002121 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.001784    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 14:04:56.040511 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.040480    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-vnfbv"]
Sep 16 14:04:56.042507 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.042489    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.044163 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.043850    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b99ccb44d-27kd7"]
Sep 16 14:04:56.045155 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.045133    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 16 14:04:56.045260 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.045139    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rr8hr\""
Sep 16 14:04:56.045260 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.045138    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 16 14:04:56.045513 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.045498    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 16 14:04:56.045585 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.045513    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:04:56.045585 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.045581    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.046823 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.046803    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"]
Sep 16 14:04:56.048433 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.048407    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 14:04:56.048653 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.048631    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:04:56.050019 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.049841    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nfdsg\""
Sep 16 14:04:56.050019 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.049930    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 14:04:56.050167 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.050120    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 14:04:56.053129 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.053093    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 16 14:04:56.053129 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.053118    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rwbkp\""
Sep 16 14:04:56.054848 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.054808    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:04:56.055356 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.055338    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 16 14:04:56.055889 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.055870    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 16 14:04:56.062437 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.062416    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 14:04:56.070930 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.070909    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7cbdcfd966-ktx58"]
Sep 16 14:04:56.072893 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.072875    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"]
Sep 16 14:04:56.073016 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.072996    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.074838 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.074823    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-7ww76"]
Sep 16 14:04:56.074977 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.074960    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"
Sep 16 14:04:56.076490 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.076472    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 16 14:04:56.076830 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.076812    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"]
Sep 16 14:04:56.077033 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.077013    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.078572 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.077624    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 14:04:56.078572 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.077925    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 14:04:56.078726 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.078657    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"]
Sep 16 14:04:56.078939 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.078920    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"
Sep 16 14:04:56.079438 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.079403    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 16 14:04:56.079697 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.079424    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-82vq9\""
Sep 16 14:04:56.079798 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.079703    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 16 14:04:56.079798 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.079472    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:04:56.079798 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.079437    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mp8kx\""
Sep 16 14:04:56.079979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.079478    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 16 14:04:56.079979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.079540    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 16 14:04:56.079979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.079592    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 16 14:04:56.079979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.079599    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 16 14:04:56.080379 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.080360    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 16 14:04:56.080479 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.080399    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qc5x2\""
Sep 16 14:04:56.080701 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.080684    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-9dtvf"]
Sep 16 14:04:56.080867 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.080852    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:04:56.082245 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.082149    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 14:04:56.082333 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.082269    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 16 14:04:56.082333 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.082280    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:04:56.082749 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.082735    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 14:04:56.083053 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.083031    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vv5d9\""
Sep 16 14:04:56.083153 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.083084    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"]
Sep 16 14:04:56.083446 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.083426    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-9dtvf"
Sep 16 14:04:56.083592 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.083506    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 16 14:04:56.084135 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.084095    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 16 14:04:56.084135 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.084131    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 16 14:04:56.084286 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.084147    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 16 14:04:56.087229 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.087158    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-zgzs4"]
Sep 16 14:04:56.087412 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.087359    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:56.090284 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.089487    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cchtf\""
Sep 16 14:04:56.090284 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.089835    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xjnm9\""
Sep 16 14:04:56.090563 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.090376    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 16 14:04:56.093001 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.091393    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:04:56.093001 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.091448    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 16 14:04:56.093001 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.092397    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"]
Sep 16 14:04:56.093156 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.093094    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-zgzs4"
Sep 16 14:04:56.094724 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.094689    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 16 14:04:56.095756 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.095731    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 14:04:56.096141 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.096118    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 14:04:56.096340 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.096322    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xc4xm\""
Sep 16 14:04:56.096712 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.096694    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 16 14:04:56.097263 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.097241    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 16 14:04:56.097419 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.097398    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b99ccb44d-27kd7"]
Sep 16 14:04:56.097692 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.097673    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 14:04:56.097822 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.097805    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 14:04:56.098447 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.098427    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lrrhk\""
Sep 16 14:04:56.100184 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.100166    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vp5jx"]
Sep 16 14:04:56.102587 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.102571    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z95r6"]
Sep 16 14:04:56.102754 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.102738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.105289 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.105271    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"]
Sep 16 14:04:56.105389 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.105328    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z95r6"
Sep 16 14:04:56.108814 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.108754    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jrwbv\""
Sep 16 14:04:56.108947 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.108912    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 14:04:56.109438 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.109417    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 14:04:56.109602 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.109477    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 14:04:56.109602 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.109577    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ss8nr\""
Sep 16 14:04:56.109827 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.109693    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 14:04:56.109827 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.109730    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"]
Sep 16 14:04:56.109971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.109839    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 14:04:56.110196 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.110179    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:04:56.113070 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.113054    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"]
Sep 16 14:04:56.114291 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.114275    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 14:04:56.122675 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.118724    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-7ww76"]
Sep 16 14:04:56.122675 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.121608    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"]
Sep 16 14:04:56.122675 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.121648    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cbdcfd966-ktx58"]
Sep 16 14:04:56.122675 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.121668    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z95r6"]
Sep 16 14:04:56.123573 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.123508    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vp5jx"]
Sep 16 14:04:56.123763 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.123742    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-zgzs4"]
Sep 16 14:04:56.125538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.125191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-vnfbv"]
Sep 16 14:04:56.144641 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.144622    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-9dtvf"]
Sep 16 14:04:56.200388 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/704c0090-1f46-4c6d-b6c7-31494b95a5ad-tmp\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.200485 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e97758bb-120e-4e06-bd96-060759afdb8d-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-z8ns5\" (UID: \"e97758bb-120e-4e06-bd96-060759afdb8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"
Sep 16 14:04:56.200485 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200432    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70310645-9dd0-4568-b1d2-7efa89355c38-config-volume\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.200485 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-installation-pull-secrets\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.200607 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.200607 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:56.200607 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz2sz\" (UniqueName: \"kubernetes.io/projected/7062088c-b344-4940-85d0-f635f757bd31-kube-api-access-kz2sz\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:56.200755 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85d33c58-5154-4811-a6a2-8ac3ea00ebee-ca-trust-extracted\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.200755 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:04:56.200755 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d90c854-fe26-4de2-9d50-458bcc967694-serving-cert\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.200755 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95jpp\" (UniqueName: \"kubernetes.io/projected/7d90c854-fe26-4de2-9d50-458bcc967694-kube-api-access-95jpp\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.200755 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200706    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4p5n\" (UniqueName: \"kubernetes.io/projected/e97758bb-120e-4e06-bd96-060759afdb8d-kube-api-access-s4p5n\") pod \"kube-storage-version-migrator-operator-6c8f84f897-z8ns5\" (UID: \"e97758bb-120e-4e06-bd96-060759afdb8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"
Sep 16 14:04:56.200755 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t56g9\" (UniqueName: \"kubernetes.io/projected/d40d4e7c-f583-40ab-9ce9-54254d2fc523-kube-api-access-t56g9\") pod \"network-check-source-6f8b768455-zgzs4\" (UID: \"d40d4e7c-f583-40ab-9ce9-54254d2fc523\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-zgzs4"
Sep 16 14:04:56.200755 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-trusted-ca\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.200755 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200754    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-certificates\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.201020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktsqn\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-kube-api-access-ktsqn\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.201020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gg8c\" (UniqueName: \"kubernetes.io/projected/c949c60b-538f-40fa-a202-e9b670dc5566-kube-api-access-9gg8c\") pod \"service-ca-operator-cf7c776b7-6lngf\" (UID: \"c949c60b-538f-40fa-a202-e9b670dc5566\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"
Sep 16 14:04:56.201020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:04:56.201020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp8k9\" (UniqueName: \"kubernetes.io/projected/356e2bb2-5bf6-4b36-8b7c-caeff2c0a6b4-kube-api-access-pp8k9\") pod \"volume-data-source-validator-86695b7cc7-9dtvf\" (UID: \"356e2bb2-5bf6-4b36-8b7c-caeff2c0a6b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-9dtvf"
Sep 16 14:04:56.201020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7062088c-b344-4940-85d0-f635f757bd31-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:56.201020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-927mp\" (UniqueName: \"kubernetes.io/projected/5124a2ad-56f1-4d19-b895-80cfdeb431a7-kube-api-access-927mp\") pod \"ingress-canary-z95r6\" (UID: \"5124a2ad-56f1-4d19-b895-80cfdeb431a7\") " pod="openshift-ingress-canary/ingress-canary-z95r6"
Sep 16 14:04:56.201020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200918    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-default-certificate\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.201020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-image-registry-private-configuration\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.201020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.200992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-stats-auth\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.201020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-bound-sa-token\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201030    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4phdf\" (UniqueName: \"kubernetes.io/projected/7639350f-d2a2-43d4-81aa-a63a808f8c90-kube-api-access-4phdf\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d90c854-fe26-4de2-9d50-458bcc967694-trusted-ca\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201100    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e97758bb-120e-4e06-bd96-060759afdb8d-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-z8ns5\" (UID: \"e97758bb-120e-4e06-bd96-060759afdb8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drj9s\" (UniqueName: \"kubernetes.io/projected/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-kube-api-access-drj9s\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70310645-9dd0-4568-b1d2-7efa89355c38-tmp-dir\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c949c60b-538f-40fa-a202-e9b670dc5566-config\") pod \"service-ca-operator-cf7c776b7-6lngf\" (UID: \"c949c60b-538f-40fa-a202-e9b670dc5566\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/704c0090-1f46-4c6d-b6c7-31494b95a5ad-trusted-ca-bundle\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/704c0090-1f46-4c6d-b6c7-31494b95a5ad-service-ca-bundle\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/704c0090-1f46-4c6d-b6c7-31494b95a5ad-snapshots\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201334    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5124a2ad-56f1-4d19-b895-80cfdeb431a7-cert\") pod \"ingress-canary-z95r6\" (UID: \"5124a2ad-56f1-4d19-b895-80cfdeb431a7\") " pod="openshift-ingress-canary/ingress-canary-z95r6"
Sep 16 14:04:56.201476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj9dk\" (UniqueName: \"kubernetes.io/projected/704c0090-1f46-4c6d-b6c7-31494b95a5ad-kube-api-access-hj9dk\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.202168 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19cb7589-a354-4795-b9c0-311be25cf056-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:04:56.202168 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d90c854-fe26-4de2-9d50-458bcc967694-config\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.202168 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/704c0090-1f46-4c6d-b6c7-31494b95a5ad-serving-cert\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.202168 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c949c60b-538f-40fa-a202-e9b670dc5566-serving-cert\") pod \"service-ca-operator-cf7c776b7-6lngf\" (UID: \"c949c60b-538f-40fa-a202-e9b670dc5566\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"
Sep 16 14:04:56.202168 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.201655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76qq9\" (UniqueName: \"kubernetes.io/projected/70310645-9dd0-4568-b1d2-7efa89355c38-kube-api-access-76qq9\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.302087 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302059    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:04:56.302300 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp8k9\" (UniqueName: \"kubernetes.io/projected/356e2bb2-5bf6-4b36-8b7c-caeff2c0a6b4-kube-api-access-pp8k9\") pod \"volume-data-source-validator-86695b7cc7-9dtvf\" (UID: \"356e2bb2-5bf6-4b36-8b7c-caeff2c0a6b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-9dtvf"
Sep 16 14:04:56.302300 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.302188    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:04:56.302300 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.302242    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert podName:19cb7589-a354-4795-b9c0-311be25cf056 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:56.802228111 +0000 UTC m=+36.101638371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-85mkf" (UID: "19cb7589-a354-4795-b9c0-311be25cf056") : secret "networking-console-plugin-cert" not found
Sep 16 14:04:56.302450 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7062088c-b344-4940-85d0-f635f757bd31-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:56.302450 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-927mp\" (UniqueName: \"kubernetes.io/projected/5124a2ad-56f1-4d19-b895-80cfdeb431a7-kube-api-access-927mp\") pod \"ingress-canary-z95r6\" (UID: \"5124a2ad-56f1-4d19-b895-80cfdeb431a7\") " pod="openshift-ingress-canary/ingress-canary-z95r6"
Sep 16 14:04:56.302450 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-default-certificate\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.302624 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-image-registry-private-configuration\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.302624 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-stats-auth\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.302624 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-bound-sa-token\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.302624 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4phdf\" (UniqueName: \"kubernetes.io/projected/7639350f-d2a2-43d4-81aa-a63a808f8c90-kube-api-access-4phdf\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.302624 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.302873 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d90c854-fe26-4de2-9d50-458bcc967694-trusted-ca\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.302873 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e97758bb-120e-4e06-bd96-060759afdb8d-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-z8ns5\" (UID: \"e97758bb-120e-4e06-bd96-060759afdb8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"
Sep 16 14:04:56.302873 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.302873 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drj9s\" (UniqueName: \"kubernetes.io/projected/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-kube-api-access-drj9s\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:04:56.302873 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70310645-9dd0-4568-b1d2-7efa89355c38-tmp-dir\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.302873 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.302873 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c949c60b-538f-40fa-a202-e9b670dc5566-config\") pod \"service-ca-operator-cf7c776b7-6lngf\" (UID: \"c949c60b-538f-40fa-a202-e9b670dc5566\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"
Sep 16 14:04:56.303204 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/704c0090-1f46-4c6d-b6c7-31494b95a5ad-trusted-ca-bundle\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.303204 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/704c0090-1f46-4c6d-b6c7-31494b95a5ad-service-ca-bundle\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.303204 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302934    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/704c0090-1f46-4c6d-b6c7-31494b95a5ad-snapshots\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.303204 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5124a2ad-56f1-4d19-b895-80cfdeb431a7-cert\") pod \"ingress-canary-z95r6\" (UID: \"5124a2ad-56f1-4d19-b895-80cfdeb431a7\") " pod="openshift-ingress-canary/ingress-canary-z95r6"
Sep 16 14:04:56.303204 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.302992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj9dk\" (UniqueName: \"kubernetes.io/projected/704c0090-1f46-4c6d-b6c7-31494b95a5ad-kube-api-access-hj9dk\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.303204 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19cb7589-a354-4795-b9c0-311be25cf056-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:04:56.303451 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d90c854-fe26-4de2-9d50-458bcc967694-config\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.303451 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.303256    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:56.803236085 +0000 UTC m=+36.102646351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : configmap references non-existent config key: service-ca.crt
Sep 16 14:04:56.303451 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/704c0090-1f46-4c6d-b6c7-31494b95a5ad-serving-cert\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.303451 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c949c60b-538f-40fa-a202-e9b670dc5566-serving-cert\") pod \"service-ca-operator-cf7c776b7-6lngf\" (UID: \"c949c60b-538f-40fa-a202-e9b670dc5566\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"
Sep 16 14:04:56.303451 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76qq9\" (UniqueName: \"kubernetes.io/projected/70310645-9dd0-4568-b1d2-7efa89355c38-kube-api-access-76qq9\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.303451 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/704c0090-1f46-4c6d-b6c7-31494b95a5ad-tmp\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.303451 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e97758bb-120e-4e06-bd96-060759afdb8d-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-z8ns5\" (UID: \"e97758bb-120e-4e06-bd96-060759afdb8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"
Sep 16 14:04:56.303451 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70310645-9dd0-4568-b1d2-7efa89355c38-config-volume\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-installation-pull-secrets\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303474    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7062088c-b344-4940-85d0-f635f757bd31-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.303575    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz2sz\" (UniqueName: \"kubernetes.io/projected/7062088c-b344-4940-85d0-f635f757bd31-kube-api-access-kz2sz\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.303624    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls podName:70310645-9dd0-4568-b1d2-7efa89355c38 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:56.803599915 +0000 UTC m=+36.103010163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls") pod "dns-default-vp5jx" (UID: "70310645-9dd0-4568-b1d2-7efa89355c38") : secret "dns-default-metrics-tls" not found
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85d33c58-5154-4811-a6a2-8ac3ea00ebee-ca-trust-extracted\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d90c854-fe26-4de2-9d50-458bcc967694-serving-cert\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303718    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jpp\" (UniqueName: \"kubernetes.io/projected/7d90c854-fe26-4de2-9d50-458bcc967694-kube-api-access-95jpp\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4p5n\" (UniqueName: \"kubernetes.io/projected/e97758bb-120e-4e06-bd96-060759afdb8d-kube-api-access-s4p5n\") pod \"kube-storage-version-migrator-operator-6c8f84f897-z8ns5\" (UID: \"e97758bb-120e-4e06-bd96-060759afdb8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t56g9\" (UniqueName: \"kubernetes.io/projected/d40d4e7c-f583-40ab-9ce9-54254d2fc523-kube-api-access-t56g9\") pod \"network-check-source-6f8b768455-zgzs4\" (UID: \"d40d4e7c-f583-40ab-9ce9-54254d2fc523\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-zgzs4"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303798    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-trusted-ca\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.303853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-certificates\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.304471 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktsqn\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-kube-api-access-ktsqn\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.304471 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gg8c\" (UniqueName: \"kubernetes.io/projected/c949c60b-538f-40fa-a202-e9b670dc5566-kube-api-access-9gg8c\") pod \"service-ca-operator-cf7c776b7-6lngf\" (UID: \"c949c60b-538f-40fa-a202-e9b670dc5566\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"
Sep 16 14:04:56.304471 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.303892    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:04:56.304471 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.303931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d90c854-fe26-4de2-9d50-458bcc967694-config\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.304471 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.303949    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls podName:7062088c-b344-4940-85d0-f635f757bd31 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:56.80393539 +0000 UTC m=+36.103345642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmdtr" (UID: "7062088c-b344-4940-85d0-f635f757bd31") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:04:56.304471 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.304306    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:04:56.304471 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.304346    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:56.804333303 +0000 UTC m=+36.103743580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : secret "router-metrics-certs-default" not found
Sep 16 14:04:56.304813 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.304487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/704c0090-1f46-4c6d-b6c7-31494b95a5ad-snapshots\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.306610 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.305008    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c949c60b-538f-40fa-a202-e9b670dc5566-config\") pod \"service-ca-operator-cf7c776b7-6lngf\" (UID: \"c949c60b-538f-40fa-a202-e9b670dc5566\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"
Sep 16 14:04:56.306610 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.305144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d90c854-fe26-4de2-9d50-458bcc967694-trusted-ca\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.306610 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.305806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/704c0090-1f46-4c6d-b6c7-31494b95a5ad-trusted-ca-bundle\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.306610 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.306246    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/704c0090-1f46-4c6d-b6c7-31494b95a5ad-service-ca-bundle\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.306610 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.306573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70310645-9dd0-4568-b1d2-7efa89355c38-config-volume\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.307509 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.307491    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5124a2ad-56f1-4d19-b895-80cfdeb431a7-cert\") pod \"ingress-canary-z95r6\" (UID: \"5124a2ad-56f1-4d19-b895-80cfdeb431a7\") " pod="openshift-ingress-canary/ingress-canary-z95r6"
Sep 16 14:04:56.307606 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.307517    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-default-certificate\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.307606 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.307524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-stats-auth\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.307781 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.307759    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e97758bb-120e-4e06-bd96-060759afdb8d-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-z8ns5\" (UID: \"e97758bb-120e-4e06-bd96-060759afdb8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"
Sep 16 14:04:56.308153 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.308126    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19cb7589-a354-4795-b9c0-311be25cf056-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:04:56.308234 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.308221    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:04:56.308287 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.308266    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls podName:2ee5ccee-0d6e-4ba9-9131-ba177c7bd366 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:56.808250915 +0000 UTC m=+36.107661173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-w9swh" (UID: "2ee5ccee-0d6e-4ba9-9131-ba177c7bd366") : secret "samples-operator-tls" not found
Sep 16 14:04:56.308287 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.308267    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-certificates\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.308467 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.308434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-image-registry-private-configuration\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.308538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.308525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85d33c58-5154-4811-a6a2-8ac3ea00ebee-ca-trust-extracted\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.308647 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.308624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-trusted-ca\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.309003 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.308973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/704c0090-1f46-4c6d-b6c7-31494b95a5ad-tmp\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.309715 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.309275    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/704c0090-1f46-4c6d-b6c7-31494b95a5ad-serving-cert\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.309715 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.309369    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 14:04:56.309715 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.309377    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c949c60b-538f-40fa-a202-e9b670dc5566-serving-cert\") pod \"service-ca-operator-cf7c776b7-6lngf\" (UID: \"c949c60b-538f-40fa-a202-e9b670dc5566\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"
Sep 16 14:04:56.309715 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.309385    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b99ccb44d-27kd7: secret "image-registry-tls" not found
Sep 16 14:04:56.309715 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.309599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e97758bb-120e-4e06-bd96-060759afdb8d-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-z8ns5\" (UID: \"e97758bb-120e-4e06-bd96-060759afdb8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"
Sep 16 14:04:56.309715 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.309614    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls podName:85d33c58-5154-4811-a6a2-8ac3ea00ebee nodeName:}" failed. No retries permitted until 2026-09-16 14:04:56.809596561 +0000 UTC m=+36.109006823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls") pod "image-registry-7b99ccb44d-27kd7" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee") : secret "image-registry-tls" not found
Sep 16 14:04:56.309715 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.309625    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70310645-9dd0-4568-b1d2-7efa89355c38-tmp-dir\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.311151 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.311129    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-installation-pull-secrets\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.311327 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.311288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-bound-sa-token\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.311391 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.311308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-927mp\" (UniqueName: \"kubernetes.io/projected/5124a2ad-56f1-4d19-b895-80cfdeb431a7-kube-api-access-927mp\") pod \"ingress-canary-z95r6\" (UID: \"5124a2ad-56f1-4d19-b895-80cfdeb431a7\") " pod="openshift-ingress-canary/ingress-canary-z95r6"
Sep 16 14:04:56.311473 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.311458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d90c854-fe26-4de2-9d50-458bcc967694-serving-cert\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.311953 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.311937    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp8k9\" (UniqueName: \"kubernetes.io/projected/356e2bb2-5bf6-4b36-8b7c-caeff2c0a6b4-kube-api-access-pp8k9\") pod \"volume-data-source-validator-86695b7cc7-9dtvf\" (UID: \"356e2bb2-5bf6-4b36-8b7c-caeff2c0a6b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-9dtvf"
Sep 16 14:04:56.314813 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.314795    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gg8c\" (UniqueName: \"kubernetes.io/projected/c949c60b-538f-40fa-a202-e9b670dc5566-kube-api-access-9gg8c\") pod \"service-ca-operator-cf7c776b7-6lngf\" (UID: \"c949c60b-538f-40fa-a202-e9b670dc5566\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"
Sep 16 14:04:56.315999 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.315930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4phdf\" (UniqueName: \"kubernetes.io/projected/7639350f-d2a2-43d4-81aa-a63a808f8c90-kube-api-access-4phdf\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.316171 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.316152    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz2sz\" (UniqueName: \"kubernetes.io/projected/7062088c-b344-4940-85d0-f635f757bd31-kube-api-access-kz2sz\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:56.317660 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.317635    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95jpp\" (UniqueName: \"kubernetes.io/projected/7d90c854-fe26-4de2-9d50-458bcc967694-kube-api-access-95jpp\") pod \"console-operator-696884fb9c-vnfbv\" (UID: \"7d90c854-fe26-4de2-9d50-458bcc967694\") " pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.317876 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.317859    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj9dk\" (UniqueName: \"kubernetes.io/projected/704c0090-1f46-4c6d-b6c7-31494b95a5ad-kube-api-access-hj9dk\") pod \"insights-operator-5844b856db-7ww76\" (UID: \"704c0090-1f46-4c6d-b6c7-31494b95a5ad\") " pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.318665 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.318630    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktsqn\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-kube-api-access-ktsqn\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.318753 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.318665    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t56g9\" (UniqueName: \"kubernetes.io/projected/d40d4e7c-f583-40ab-9ce9-54254d2fc523-kube-api-access-t56g9\") pod \"network-check-source-6f8b768455-zgzs4\" (UID: \"d40d4e7c-f583-40ab-9ce9-54254d2fc523\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-zgzs4"
Sep 16 14:04:56.320082 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.320061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4p5n\" (UniqueName: \"kubernetes.io/projected/e97758bb-120e-4e06-bd96-060759afdb8d-kube-api-access-s4p5n\") pod \"kube-storage-version-migrator-operator-6c8f84f897-z8ns5\" (UID: \"e97758bb-120e-4e06-bd96-060759afdb8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"
Sep 16 14:04:56.320306 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.320286    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76qq9\" (UniqueName: \"kubernetes.io/projected/70310645-9dd0-4568-b1d2-7efa89355c38-kube-api-access-76qq9\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.320473 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.320460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drj9s\" (UniqueName: \"kubernetes.io/projected/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-kube-api-access-drj9s\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:04:56.357941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.357921    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:04:56.399941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.399914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"
Sep 16 14:04:56.407706 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.407682    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-7ww76"
Sep 16 14:04:56.417839 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.417818    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"
Sep 16 14:04:56.436655 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.436625    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-9dtvf"
Sep 16 14:04:56.454408 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.454203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-zgzs4"
Sep 16 14:04:56.471514 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.471213    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z95r6"
Sep 16 14:04:56.639337 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.639220    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-vnfbv"]
Sep 16 14:04:56.641849 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:56.641821    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d90c854_fe26_4de2_9d50_458bcc967694.slice/crio-28016519510e40d60bd9a6ba0001b3a3decfd1159ad2ce4246c9233ae84b5e99 WatchSource:0}: Error finding container 28016519510e40d60bd9a6ba0001b3a3decfd1159ad2ce4246c9233ae84b5e99: Status 404 returned error can't find the container with id 28016519510e40d60bd9a6ba0001b3a3decfd1159ad2ce4246c9233ae84b5e99
Sep 16 14:04:56.685894 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.685871    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5"]
Sep 16 14:04:56.687988 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:56.687966    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97758bb_120e_4e06_bd96_060759afdb8d.slice/crio-bdddf60d5ff2d0825901ef58b5ab064823342ba2f805da87fbe23f5eaf09f104 WatchSource:0}: Error finding container bdddf60d5ff2d0825901ef58b5ab064823342ba2f805da87fbe23f5eaf09f104: Status 404 returned error can't find the container with id bdddf60d5ff2d0825901ef58b5ab064823342ba2f805da87fbe23f5eaf09f104
Sep 16 14:04:56.704335 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.704310    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-7ww76"]
Sep 16 14:04:56.706772 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:56.706748    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704c0090_1f46_4c6d_b6c7_31494b95a5ad.slice/crio-00ecc1f93b2160b2e04778d967eb8c9e4d7349464cda668ecea2abc6d89d74b6 WatchSource:0}: Error finding container 00ecc1f93b2160b2e04778d967eb8c9e4d7349464cda668ecea2abc6d89d74b6: Status 404 returned error can't find the container with id 00ecc1f93b2160b2e04778d967eb8c9e4d7349464cda668ecea2abc6d89d74b6
Sep 16 14:04:56.710767 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.710747    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf"]
Sep 16 14:04:56.713793 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:56.713771    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc949c60b_538f_40fa_a202_e9b670dc5566.slice/crio-934c1acc442d5345081f9f6cefa273f33c97d598e9845f0e2786dc4f2c28cb1a WatchSource:0}: Error finding container 934c1acc442d5345081f9f6cefa273f33c97d598e9845f0e2786dc4f2c28cb1a: Status 404 returned error can't find the container with id 934c1acc442d5345081f9f6cefa273f33c97d598e9845f0e2786dc4f2c28cb1a
Sep 16 14:04:56.726634 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.726611    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-9dtvf"]
Sep 16 14:04:56.728933 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:56.728916    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356e2bb2_5bf6_4b36_8b7c_caeff2c0a6b4.slice/crio-eae7e2519960cc8d3fd1e73081f00e2497d639d2cb619a845552a5fe76e220f5 WatchSource:0}: Error finding container eae7e2519960cc8d3fd1e73081f00e2497d639d2cb619a845552a5fe76e220f5: Status 404 returned error can't find the container with id eae7e2519960cc8d3fd1e73081f00e2497d639d2cb619a845552a5fe76e220f5
Sep 16 14:04:56.751209 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.751189    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-zgzs4"]
Sep 16 14:04:56.753822 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:56.753790    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd40d4e7c_f583_40ab_9ce9_54254d2fc523.slice/crio-14973105caca93032f54748af1d46ea951aeb88ec9f35f38a42242b5273f7b64 WatchSource:0}: Error finding container 14973105caca93032f54748af1d46ea951aeb88ec9f35f38a42242b5273f7b64: Status 404 returned error can't find the container with id 14973105caca93032f54748af1d46ea951aeb88ec9f35f38a42242b5273f7b64
Sep 16 14:04:56.769335 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.769311    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z95r6"]
Sep 16 14:04:56.772039 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:04:56.772024    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5124a2ad_56f1_4d19_b895_80cfdeb431a7.slice/crio-e704a0c55cef17c9b017a5a6db53a3347c302a5ad35db3c622074032c29d9eec WatchSource:0}: Error finding container e704a0c55cef17c9b017a5a6db53a3347c302a5ad35db3c622074032c29d9eec: Status 404 returned error can't find the container with id e704a0c55cef17c9b017a5a6db53a3347c302a5ad35db3c622074032c29d9eec
Sep 16 14:04:56.809201 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.809178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:56.809270 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.809205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:04:56.809270 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.809240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:04:56.809337 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.809276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.809337 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.809314    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:04:56.809337 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.809316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:56.809443 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.809358    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:04:56.809443 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.809372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:56.809443 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.809384    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:04:56.809443 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.809400    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:57.80938717 +0000 UTC m=+37.108797415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : secret "router-metrics-certs-default" not found
Sep 16 14:04:56.809443 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.809317    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:04:56.809443 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.809421    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls podName:7062088c-b344-4940-85d0-f635f757bd31 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:57.809405646 +0000 UTC m=+37.108815893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmdtr" (UID: "7062088c-b344-4940-85d0-f635f757bd31") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:04:56.809443 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.809439    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert podName:19cb7589-a354-4795-b9c0-311be25cf056 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:57.809429304 +0000 UTC m=+37.108839550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-85mkf" (UID: "19cb7589-a354-4795-b9c0-311be25cf056") : secret "networking-console-plugin-cert" not found
Sep 16 14:04:56.809707 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.809459    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls podName:2ee5ccee-0d6e-4ba9-9131-ba177c7bd366 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:57.809449898 +0000 UTC m=+37.108860148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-w9swh" (UID: "2ee5ccee-0d6e-4ba9-9131-ba177c7bd366") : secret "samples-operator-tls" not found
Sep 16 14:04:56.809707 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.809464    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:04:56.809707 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.809486    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:57.80947487 +0000 UTC m=+37.108885122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : configmap references non-existent config key: service-ca.crt
Sep 16 14:04:56.809707 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.809504    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls podName:70310645-9dd0-4568-b1d2-7efa89355c38 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:57.809495559 +0000 UTC m=+37.108905804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls") pod "dns-default-vp5jx" (UID: "70310645-9dd0-4568-b1d2-7efa89355c38") : secret "dns-default-metrics-tls" not found
Sep 16 14:04:56.910454 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:56.910428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:56.910572 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.910540    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 14:04:56.910615 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.910575    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b99ccb44d-27kd7: secret "image-registry-tls" not found
Sep 16 14:04:56.910668 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:56.910619    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls podName:85d33c58-5154-4811-a6a2-8ac3ea00ebee nodeName:}" failed. No retries permitted until 2026-09-16 14:04:57.910606964 +0000 UTC m=+37.210017225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls") pod "image-registry-7b99ccb44d-27kd7" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee") : secret "image-registry-tls" not found
Sep 16 14:04:57.110904 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.110824    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:04:57.110904 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.110840    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:04:57.113820 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.113799    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j74pt\""
Sep 16 14:04:57.113977 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.113962    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-df78v\""
Sep 16 14:04:57.114160 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.114149    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 14:04:57.290742 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.290705    2579 generic.go:356] "Generic (PLEG): container finished" podID="66575877-fa65-47fe-b600-9c9f1d5eb268" containerID="f162b2b0638242d42ebd61f6b5e66f5e7ab7d622498c717da2d1a51c12d3f9fa" exitCode=0
Sep 16 14:04:57.290951 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.290802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwvrg" event={"ID":"66575877-fa65-47fe-b600-9c9f1d5eb268","Type":"ContainerDied","Data":"f162b2b0638242d42ebd61f6b5e66f5e7ab7d622498c717da2d1a51c12d3f9fa"}
Sep 16 14:04:57.292844 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.292810    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf" event={"ID":"c949c60b-538f-40fa-a202-e9b670dc5566","Type":"ContainerStarted","Data":"934c1acc442d5345081f9f6cefa273f33c97d598e9845f0e2786dc4f2c28cb1a"}
Sep 16 14:04:57.294745 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.294669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5" event={"ID":"e97758bb-120e-4e06-bd96-060759afdb8d","Type":"ContainerStarted","Data":"bdddf60d5ff2d0825901ef58b5ab064823342ba2f805da87fbe23f5eaf09f104"}
Sep 16 14:04:57.296499 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.296473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv" event={"ID":"7d90c854-fe26-4de2-9d50-458bcc967694","Type":"ContainerStarted","Data":"28016519510e40d60bd9a6ba0001b3a3decfd1159ad2ce4246c9233ae84b5e99"}
Sep 16 14:04:57.297870 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.297843    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z95r6" event={"ID":"5124a2ad-56f1-4d19-b895-80cfdeb431a7","Type":"ContainerStarted","Data":"e704a0c55cef17c9b017a5a6db53a3347c302a5ad35db3c622074032c29d9eec"}
Sep 16 14:04:57.299432 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.299367    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-9dtvf" event={"ID":"356e2bb2-5bf6-4b36-8b7c-caeff2c0a6b4","Type":"ContainerStarted","Data":"eae7e2519960cc8d3fd1e73081f00e2497d639d2cb619a845552a5fe76e220f5"}
Sep 16 14:04:57.300830 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.300804    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-7ww76" event={"ID":"704c0090-1f46-4c6d-b6c7-31494b95a5ad","Type":"ContainerStarted","Data":"00ecc1f93b2160b2e04778d967eb8c9e4d7349464cda668ecea2abc6d89d74b6"}
Sep 16 14:04:57.302202 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.302180    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-zgzs4" event={"ID":"d40d4e7c-f583-40ab-9ce9-54254d2fc523","Type":"ContainerStarted","Data":"14973105caca93032f54748af1d46ea951aeb88ec9f35f38a42242b5273f7b64"}
Sep 16 14:04:57.818895 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.818857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:57.819062 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.818912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:57.819062 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.818942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:04:57.819062 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.818977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:04:57.819062 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.819032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:57.819263 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.819096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:57.819309 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.819270    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:59.819251433 +0000 UTC m=+39.118661697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : configmap references non-existent config key: service-ca.crt
Sep 16 14:04:57.820134 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.819713    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:04:57.820134 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.819769    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls podName:70310645-9dd0-4568-b1d2-7efa89355c38 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:59.819753296 +0000 UTC m=+39.119163555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls") pod "dns-default-vp5jx" (UID: "70310645-9dd0-4568-b1d2-7efa89355c38") : secret "dns-default-metrics-tls" not found
Sep 16 14:04:57.820134 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.819827    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:04:57.820134 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.819861    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls podName:7062088c-b344-4940-85d0-f635f757bd31 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:59.819850589 +0000 UTC m=+39.119260849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmdtr" (UID: "7062088c-b344-4940-85d0-f635f757bd31") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:04:57.820134 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.819914    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:04:57.820134 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.819945    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls podName:2ee5ccee-0d6e-4ba9-9131-ba177c7bd366 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:59.819934115 +0000 UTC m=+39.119344360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-w9swh" (UID: "2ee5ccee-0d6e-4ba9-9131-ba177c7bd366") : secret "samples-operator-tls" not found
Sep 16 14:04:57.820134 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.819994    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:04:57.820134 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.820026    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert podName:19cb7589-a354-4795-b9c0-311be25cf056 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:59.820015857 +0000 UTC m=+39.119426106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-85mkf" (UID: "19cb7589-a354-4795-b9c0-311be25cf056") : secret "networking-console-plugin-cert" not found
Sep 16 14:04:57.820134 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.820072    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:04:57.820134 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.820102    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:04:59.820091097 +0000 UTC m=+39.119501357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : secret "router-metrics-certs-default" not found
Sep 16 14:04:57.920667 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:57.920557    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:57.920750 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.920720    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 14:04:57.920750 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.920738    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b99ccb44d-27kd7: secret "image-registry-tls" not found
Sep 16 14:04:57.920836 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:57.920796    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls podName:85d33c58-5154-4811-a6a2-8ac3ea00ebee nodeName:}" failed. No retries permitted until 2026-09-16 14:04:59.920776603 +0000 UTC m=+39.220186850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls") pod "image-registry-7b99ccb44d-27kd7" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee") : secret "image-registry-tls" not found
Sep 16 14:04:58.309842 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:58.309469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-9dtvf" event={"ID":"356e2bb2-5bf6-4b36-8b7c-caeff2c0a6b4","Type":"ContainerStarted","Data":"339d791f1a7563039093247431084f4456ca9f1eb4d1f4655d5f4c460dfcec3b"}
Sep 16 14:04:59.841156 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:59.841074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:59.841171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:59.841248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.841253    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.841323    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.841330    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert podName:19cb7589-a354-4795-b9c0-311be25cf056 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:03.841307161 +0000 UTC m=+43.140717429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-85mkf" (UID: "19cb7589-a354-4795-b9c0-311be25cf056") : secret "networking-console-plugin-cert" not found
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:59.841393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:59.841426    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.841440    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.841473    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:03.841451874 +0000 UTC m=+43.140862132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : secret "router-metrics-certs-default" not found
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:59.841457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.841499    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:03.841486349 +0000 UTC m=+43.140896595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : configmap references non-existent config key: service-ca.crt
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.841519    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls podName:70310645-9dd0-4568-b1d2-7efa89355c38 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:03.841510797 +0000 UTC m=+43.140921047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls") pod "dns-default-vp5jx" (UID: "70310645-9dd0-4568-b1d2-7efa89355c38") : secret "dns-default-metrics-tls" not found
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.841524    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:04:59.841570 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.841580    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:04:59.842180 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.841594    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls podName:7062088c-b344-4940-85d0-f635f757bd31 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:03.841580132 +0000 UTC m=+43.140990385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmdtr" (UID: "7062088c-b344-4940-85d0-f635f757bd31") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:04:59.842180 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.841616    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls podName:2ee5ccee-0d6e-4ba9-9131-ba177c7bd366 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:03.841608389 +0000 UTC m=+43.141018647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-w9swh" (UID: "2ee5ccee-0d6e-4ba9-9131-ba177c7bd366") : secret "samples-operator-tls" not found
Sep 16 14:04:59.942011 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:04:59.941970    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:04:59.942181 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.942135    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 14:04:59.942181 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.942153    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b99ccb44d-27kd7: secret "image-registry-tls" not found
Sep 16 14:04:59.942296 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:04:59.942215    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls podName:85d33c58-5154-4811-a6a2-8ac3ea00ebee nodeName:}" failed. No retries permitted until 2026-09-16 14:05:03.942196005 +0000 UTC m=+43.241606273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls") pod "image-registry-7b99ccb44d-27kd7" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee") : secret "image-registry-tls" not found
Sep 16 14:05:03.877794 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:03.877753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:03.877836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:03.877893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:03.877924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:03.877954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.877927    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:03.877993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.877982    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.878030    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:11.878005961 +0000 UTC m=+51.177416225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : configmap references non-existent config key: service-ca.crt
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.878061    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:11.878049958 +0000 UTC m=+51.177460207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : secret "router-metrics-certs-default" not found
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.878067    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.878079    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls podName:70310645-9dd0-4568-b1d2-7efa89355c38 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:11.878070458 +0000 UTC m=+51.177480705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls") pod "dns-default-vp5jx" (UID: "70310645-9dd0-4568-b1d2-7efa89355c38") : secret "dns-default-metrics-tls" not found
Sep 16 14:05:03.878247 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.878078    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:05:03.878839 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.878509    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:05:03.878839 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.878543    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls podName:7062088c-b344-4940-85d0-f635f757bd31 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:11.87811441 +0000 UTC m=+51.177524657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmdtr" (UID: "7062088c-b344-4940-85d0-f635f757bd31") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:05:03.878839 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.878591    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert podName:19cb7589-a354-4795-b9c0-311be25cf056 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:11.878570704 +0000 UTC m=+51.177980958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-85mkf" (UID: "19cb7589-a354-4795-b9c0-311be25cf056") : secret "networking-console-plugin-cert" not found
Sep 16 14:05:03.878839 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.878627    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls podName:2ee5ccee-0d6e-4ba9-9131-ba177c7bd366 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:11.878602828 +0000 UTC m=+51.178013091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-w9swh" (UID: "2ee5ccee-0d6e-4ba9-9131-ba177c7bd366") : secret "samples-operator-tls" not found
Sep 16 14:05:03.978889 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:03.978852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:05:03.979068 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.979001    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 14:05:03.979068 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.979019    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b99ccb44d-27kd7: secret "image-registry-tls" not found
Sep 16 14:05:03.979178 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:03.979084    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls podName:85d33c58-5154-4811-a6a2-8ac3ea00ebee nodeName:}" failed. No retries permitted until 2026-09-16 14:05:11.979071259 +0000 UTC m=+51.278481504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls") pod "image-registry-7b99ccb44d-27kd7" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee") : secret "image-registry-tls" not found
Sep 16 14:05:06.337355 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.337016    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-zgzs4" event={"ID":"d40d4e7c-f583-40ab-9ce9-54254d2fc523","Type":"ContainerStarted","Data":"5482e1412ffdd74f4ba25dde268d4d5ef627b3b6d27e3142634189eb44c820e3"}
Sep 16 14:05:06.342581 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.341977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwvrg" event={"ID":"66575877-fa65-47fe-b600-9c9f1d5eb268","Type":"ContainerStarted","Data":"cc7829ed152a9276b500c211edd3b0d7c77f9b471ec9fe2126aeeb9079f589dc"}
Sep 16 14:05:06.345124 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.345070    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf" event={"ID":"c949c60b-538f-40fa-a202-e9b670dc5566","Type":"ContainerStarted","Data":"b68de28df95a8d864cd0113c64f62e90adbb6538213d897008b868ec91f5e31e"}
Sep 16 14:05:06.347231 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.346846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5" event={"ID":"e97758bb-120e-4e06-bd96-060759afdb8d","Type":"ContainerStarted","Data":"117a0d3a73a16bed27c65d09217caae5a4f3b269cf8503a41f9a8f5f754ba148"}
Sep 16 14:05:06.349590 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.349142    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/0.log"
Sep 16 14:05:06.349590 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.349171    2579 generic.go:356] "Generic (PLEG): container finished" podID="7d90c854-fe26-4de2-9d50-458bcc967694" containerID="37e14208515fa9630d495e0b9d815d17f4d0b3d8abbfde93d81ff795d672cacd" exitCode=255
Sep 16 14:05:06.349590 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.349241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv" event={"ID":"7d90c854-fe26-4de2-9d50-458bcc967694","Type":"ContainerDied","Data":"37e14208515fa9630d495e0b9d815d17f4d0b3d8abbfde93d81ff795d672cacd"}
Sep 16 14:05:06.349590 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.349480    2579 scope.go:117] "RemoveContainer" containerID="37e14208515fa9630d495e0b9d815d17f4d0b3d8abbfde93d81ff795d672cacd"
Sep 16 14:05:06.353067 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.352690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z95r6" event={"ID":"5124a2ad-56f1-4d19-b895-80cfdeb431a7","Type":"ContainerStarted","Data":"28083c903401788cf0d13dd7ddaae02989e5d51f8c472a074f769d1cdc52868d"}
Sep 16 14:05:06.355216 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.354813    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-7ww76" event={"ID":"704c0090-1f46-4c6d-b6c7-31494b95a5ad","Type":"ContainerStarted","Data":"dd437692102a7a63284c5a68fc8e374379c08987c9a78e563507aeff1c408b10"}
Sep 16 14:05:06.358906 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.358612    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:05:06.358906 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.358872    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:05:06.388989 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.388937    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-zgzs4" podStartSLOduration=30.309162956 podStartE2EDuration="39.388919413s" totalImagesPullingTime="9.079756457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:06.387649265 +0000 UTC m=+45.687059531" watchObservedRunningTime="2026-09-16 14:05:06.388919413 +0000 UTC m=+45.688329678"
Sep 16 14:05:06.389801 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.389710    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-9dtvf" podStartSLOduration=38.19735709 podStartE2EDuration="39.389701476s" totalImagesPullingTime="1.192344386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:04:58.326049912 +0000 UTC m=+37.625460178" watchObservedRunningTime="2026-09-16 14:05:06.389701476 +0000 UTC m=+45.689111745"
Sep 16 14:05:06.410388 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.410285    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5" podStartSLOduration=30.232098558 podStartE2EDuration="39.410266595s" totalImagesPullingTime="9.178168037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:06.407999476 +0000 UTC m=+45.707409742" watchObservedRunningTime="2026-09-16 14:05:06.410266595 +0000 UTC m=+45.709676865"
Sep 16 14:05:06.433581 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.433517    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-7ww76" podStartSLOduration=31.595515471 podStartE2EDuration="39.433498675s" totalImagesPullingTime="7.837983204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:06.432421191 +0000 UTC m=+45.731831459" watchObservedRunningTime="2026-09-16 14:05:06.433498675 +0000 UTC m=+45.732908935"
Sep 16 14:05:06.473023 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.472514    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf" podStartSLOduration=31.641431437 podStartE2EDuration="39.472493573s" totalImagesPullingTime="7.831062136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:06.45349572 +0000 UTC m=+45.752905989" watchObservedRunningTime="2026-09-16 14:05:06.472493573 +0000 UTC m=+45.771903839"
Sep 16 14:05:06.491801 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:06.491743    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z95r6" podStartSLOduration=1.391274333 podStartE2EDuration="10.491722854s" totalImagesPullingTime="9.100448521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:06.472828007 +0000 UTC m=+45.772238276" watchObservedRunningTime="2026-09-16 14:05:06.491722854 +0000 UTC m=+45.791133125"
Sep 16 14:05:07.365738 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.365653    2579 generic.go:356] "Generic (PLEG): container finished" podID="66575877-fa65-47fe-b600-9c9f1d5eb268" containerID="cc7829ed152a9276b500c211edd3b0d7c77f9b471ec9fe2126aeeb9079f589dc" exitCode=0
Sep 16 14:05:07.366123 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.365734    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwvrg" event={"ID":"66575877-fa65-47fe-b600-9c9f1d5eb268","Type":"ContainerDied","Data":"cc7829ed152a9276b500c211edd3b0d7c77f9b471ec9fe2126aeeb9079f589dc"}
Sep 16 14:05:07.367921 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.367902    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:05:07.368364 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.368345    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/0.log"
Sep 16 14:05:07.368458 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.368386    2579 generic.go:356] "Generic (PLEG): container finished" podID="7d90c854-fe26-4de2-9d50-458bcc967694" containerID="796679c97ce43539dc5ecbb9b0c9ef88605f7164e63424340e1152f2446ffc3e" exitCode=255
Sep 16 14:05:07.368516 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.368466    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv" event={"ID":"7d90c854-fe26-4de2-9d50-458bcc967694","Type":"ContainerDied","Data":"796679c97ce43539dc5ecbb9b0c9ef88605f7164e63424340e1152f2446ffc3e"}
Sep 16 14:05:07.368583 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.368522    2579 scope.go:117] "RemoveContainer" containerID="37e14208515fa9630d495e0b9d815d17f4d0b3d8abbfde93d81ff795d672cacd"
Sep 16 14:05:07.368712 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.368695    2579 scope.go:117] "RemoveContainer" containerID="796679c97ce43539dc5ecbb9b0c9ef88605f7164e63424340e1152f2446ffc3e"
Sep 16 14:05:07.369042 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:07.368876    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-vnfbv_openshift-console-operator(7d90c854-fe26-4de2-9d50-458bcc967694)\"" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv" podUID="7d90c854-fe26-4de2-9d50-458bcc967694"
Sep 16 14:05:07.949986 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.949955    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6v7c5"]
Sep 16 14:05:07.967801 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.967749    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:07.970493 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.970377    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zzz2w\""
Sep 16 14:05:07.970824 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.970802    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 14:05:07.971018 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.971000    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 14:05:07.973933 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:07.973853    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6v7c5"]
Sep 16 14:05:08.017874 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.017842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqbsd\" (UniqueName: \"kubernetes.io/projected/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-api-access-bqbsd\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.018036 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.017887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.018036 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.017958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.018036 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.018019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09302756-6ac0-4c12-a4ae-7e5546cde847-crio-socket\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.018206 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.018122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09302756-6ac0-4c12-a4ae-7e5546cde847-data-volume\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.119457 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.119420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqbsd\" (UniqueName: \"kubernetes.io/projected/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-api-access-bqbsd\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.119457 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.119459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.119720 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.119480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.119720 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:08.119599    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:08.119720 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.119623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09302756-6ac0-4c12-a4ae-7e5546cde847-crio-socket\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.119720 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:08.119647    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls podName:09302756-6ac0-4c12-a4ae-7e5546cde847 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:08.61963454 +0000 UTC m=+47.919044784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v7c5" (UID: "09302756-6ac0-4c12-a4ae-7e5546cde847") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:08.119720 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.119709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09302756-6ac0-4c12-a4ae-7e5546cde847-data-volume\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.119949 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:08.119726    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:05:08.119949 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:08.119798    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm podName:09302756-6ac0-4c12-a4ae-7e5546cde847 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:08.619781979 +0000 UTC m=+47.919192244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v7c5" (UID: "09302756-6ac0-4c12-a4ae-7e5546cde847") : configmap "kube-rbac-proxy" not found
Sep 16 14:05:08.119949 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.119885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09302756-6ac0-4c12-a4ae-7e5546cde847-crio-socket\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.120048 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.120021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09302756-6ac0-4c12-a4ae-7e5546cde847-data-volume\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.128466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.128436    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqbsd\" (UniqueName: \"kubernetes.io/projected/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-api-access-bqbsd\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.373943 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.373865    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:05:08.374388 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.374258    2579 scope.go:117] "RemoveContainer" containerID="796679c97ce43539dc5ecbb9b0c9ef88605f7164e63424340e1152f2446ffc3e"
Sep 16 14:05:08.374504 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:08.374480    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-vnfbv_openshift-console-operator(7d90c854-fe26-4de2-9d50-458bcc967694)\"" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv" podUID="7d90c854-fe26-4de2-9d50-458bcc967694"
Sep 16 14:05:08.377141 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.377106    2579 generic.go:356] "Generic (PLEG): container finished" podID="66575877-fa65-47fe-b600-9c9f1d5eb268" containerID="80af6c6da60f4dd753aa0f8d495780a34529da64e4422d52effef686e8770e6e" exitCode=0
Sep 16 14:05:08.377266 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.377150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwvrg" event={"ID":"66575877-fa65-47fe-b600-9c9f1d5eb268","Type":"ContainerDied","Data":"80af6c6da60f4dd753aa0f8d495780a34529da64e4422d52effef686e8770e6e"}
Sep 16 14:05:08.624049 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.623955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.624049 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:08.624005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:08.624255 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:08.624109    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:08.624255 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:08.624123    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:05:08.624255 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:08.624178    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls podName:09302756-6ac0-4c12-a4ae-7e5546cde847 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:09.624160818 +0000 UTC m=+48.923571062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v7c5" (UID: "09302756-6ac0-4c12-a4ae-7e5546cde847") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:08.624255 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:08.624193    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm podName:09302756-6ac0-4c12-a4ae-7e5546cde847 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:09.624186388 +0000 UTC m=+48.923596632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v7c5" (UID: "09302756-6ac0-4c12-a4ae-7e5546cde847") : configmap "kube-rbac-proxy" not found
Sep 16 14:05:09.384576 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:09.384529    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwvrg" event={"ID":"66575877-fa65-47fe-b600-9c9f1d5eb268","Type":"ContainerStarted","Data":"fb9dd7b1c06e20701171e6e032dcb79db3adb242900a0c9e40c92e17111584c3"}
Sep 16 14:05:09.410968 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:09.410923    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gwvrg" podStartSLOduration=7.94418753 podStartE2EDuration="47.410908258s" totalImagesPullingTime="39.466720728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:09.408942968 +0000 UTC m=+48.708353269" watchObservedRunningTime="2026-09-16 14:05:09.410908258 +0000 UTC m=+48.710318545"
Sep 16 14:05:09.634659 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:09.634575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:09.634659 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:09.634632    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:09.634836 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:09.634713    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:05:09.634836 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:09.634728    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:09.634836 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:09.634769    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm podName:09302756-6ac0-4c12-a4ae-7e5546cde847 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:11.634756324 +0000 UTC m=+50.934166570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v7c5" (UID: "09302756-6ac0-4c12-a4ae-7e5546cde847") : configmap "kube-rbac-proxy" not found
Sep 16 14:05:09.634836 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:09.634781    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls podName:09302756-6ac0-4c12-a4ae-7e5546cde847 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:11.634775097 +0000 UTC m=+50.934185341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v7c5" (UID: "09302756-6ac0-4c12-a4ae-7e5546cde847") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:10.503877 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:10.503849    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btn76_280b9b34-af5f-4eb3-aca5-27e6bcb9220c/dns-node-resolver/0.log"
Sep 16 14:05:11.657099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:11.657060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:11.657450 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:11.657108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:11.657450 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.657196    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:05:11.657450 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.657201    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:11.657450 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.657255    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls podName:09302756-6ac0-4c12-a4ae-7e5546cde847 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:15.65724089 +0000 UTC m=+54.956651151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v7c5" (UID: "09302756-6ac0-4c12-a4ae-7e5546cde847") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:11.657450 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.657270    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm podName:09302756-6ac0-4c12-a4ae-7e5546cde847 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:15.657263208 +0000 UTC m=+54.956673453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v7c5" (UID: "09302756-6ac0-4c12-a4ae-7e5546cde847") : configmap "kube-rbac-proxy" not found
Sep 16 14:05:11.904364 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:11.904335    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rx59j_2b2310b8-b4db-4fa7-8d8d-d31e27a81665/node-ca/0.log"
Sep 16 14:05:11.960375 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:11.960305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:11.960375 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:11.960361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:11.960562 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:11.960405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:05:11.960562 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:11.960425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:05:11.960562 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.960435    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:05:11.960562 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:11.960481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:05:11.960562 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.960487    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:27.960474305 +0000 UTC m=+67.259884550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : secret "router-metrics-certs-default" not found
Sep 16 14:05:11.960562 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.960524    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:05:11.960881 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.960500    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:05:11.960881 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:11.960565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:05:11.960881 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.960576    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle podName:7639350f-d2a2-43d4-81aa-a63a808f8c90 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:27.960562112 +0000 UTC m=+67.259972378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle") pod "router-default-7cbdcfd966-ktx58" (UID: "7639350f-d2a2-43d4-81aa-a63a808f8c90") : configmap references non-existent config key: service-ca.crt
Sep 16 14:05:11.960881 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.960623    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:05:11.960881 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.960645    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls podName:70310645-9dd0-4568-b1d2-7efa89355c38 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:27.960627242 +0000 UTC m=+67.260037502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls") pod "dns-default-vp5jx" (UID: "70310645-9dd0-4568-b1d2-7efa89355c38") : secret "dns-default-metrics-tls" not found
Sep 16 14:05:11.960881 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.960657    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:05:11.960881 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.960664    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls podName:7062088c-b344-4940-85d0-f635f757bd31 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:27.960654681 +0000 UTC m=+67.260064931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmdtr" (UID: "7062088c-b344-4940-85d0-f635f757bd31") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:05:11.960881 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.960734    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert podName:19cb7589-a354-4795-b9c0-311be25cf056 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:27.960716882 +0000 UTC m=+67.260127130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-85mkf" (UID: "19cb7589-a354-4795-b9c0-311be25cf056") : secret "networking-console-plugin-cert" not found
Sep 16 14:05:11.960881 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:11.960770    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls podName:2ee5ccee-0d6e-4ba9-9131-ba177c7bd366 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:27.960759989 +0000 UTC m=+67.260170236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-w9swh" (UID: "2ee5ccee-0d6e-4ba9-9131-ba177c7bd366") : secret "samples-operator-tls" not found
Sep 16 14:05:12.062102 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:12.062073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:05:12.062265 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:12.062228    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 14:05:12.062265 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:12.062247    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b99ccb44d-27kd7: secret "image-registry-tls" not found
Sep 16 14:05:12.062377 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:12.062304    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls podName:85d33c58-5154-4811-a6a2-8ac3ea00ebee nodeName:}" failed. No retries permitted until 2026-09-16 14:05:28.062287017 +0000 UTC m=+67.361697277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls") pod "image-registry-7b99ccb44d-27kd7" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee") : secret "image-registry-tls" not found
Sep 16 14:05:12.706599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:12.706562    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z95r6_5124a2ad-56f1-4d19-b895-80cfdeb431a7/serve-healthcheck-canary/0.log"
Sep 16 14:05:13.304592 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:13.304565    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-z8ns5_e97758bb-120e-4e06-bd96-060759afdb8d/kube-storage-version-migrator-operator/0.log"
Sep 16 14:05:15.695069 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:15.695033    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:15.695494 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:15.695076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:15.695494 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:15.695185    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:15.695494 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:15.695231    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:05:15.695494 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:15.695247    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls podName:09302756-6ac0-4c12-a4ae-7e5546cde847 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:23.695230898 +0000 UTC m=+62.994641164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v7c5" (UID: "09302756-6ac0-4c12-a4ae-7e5546cde847") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:15.695494 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:15.695272    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm podName:09302756-6ac0-4c12-a4ae-7e5546cde847 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:23.695261036 +0000 UTC m=+62.994671280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v7c5" (UID: "09302756-6ac0-4c12-a4ae-7e5546cde847") : configmap "kube-rbac-proxy" not found
Sep 16 14:05:16.358230 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:16.358177    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:05:16.358230 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:16.358247    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:05:16.358617 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:16.358604    2579 scope.go:117] "RemoveContainer" containerID="796679c97ce43539dc5ecbb9b0c9ef88605f7164e63424340e1152f2446ffc3e"
Sep 16 14:05:16.358772 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:16.358753    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-vnfbv_openshift-console-operator(7d90c854-fe26-4de2-9d50-458bcc967694)\"" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv" podUID="7d90c854-fe26-4de2-9d50-458bcc967694"
Sep 16 14:05:21.280901 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:21.280872    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvt4l"
Sep 16 14:05:23.768060 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:23.768016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:23.768539 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:23.768073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:23.768539 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:23.768173    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:23.768539 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:23.768260    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls podName:09302756-6ac0-4c12-a4ae-7e5546cde847 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:39.768241308 +0000 UTC m=+79.067651573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v7c5" (UID: "09302756-6ac0-4c12-a4ae-7e5546cde847") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:05:23.768762 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:23.768698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09302756-6ac0-4c12-a4ae-7e5546cde847-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:26.895748 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:26.895715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:05:26.896115 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:26.895776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88pts\" (UniqueName: \"kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts\") pod \"network-check-target-gq5pp\" (UID: \"b655a103-09b9-4934-8c20-c44fae75cf19\") " pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:05:26.896115 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:26.895815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:05:26.898321 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:26.898302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88pts\" (UniqueName: \"kubernetes.io/projected/b655a103-09b9-4934-8c20-c44fae75cf19-kube-api-access-88pts\") pod \"network-check-target-gq5pp\" (UID: \"b655a103-09b9-4934-8c20-c44fae75cf19\") " pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:05:26.898804 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:26.898784    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 14:05:26.900536 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:26.900510    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 14:05:26.908764 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:26.908734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8d48063-48c0-4bcf-9e7a-1d39b0826ef2-metrics-certs\") pod \"network-metrics-daemon-vdsdt\" (UID: \"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2\") " pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:05:26.908850 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:26.908749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9176e0ae-8c42-4247-9a57-e0260a972717-original-pull-secret\") pod \"global-pull-secret-syncer-dv2zf\" (UID: \"9176e0ae-8c42-4247-9a57-e0260a972717\") " pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:05:27.075650 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:27.075620    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dv2zf"
Sep 16 14:05:27.128880 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:27.128858    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j74pt\""
Sep 16 14:05:27.131442 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:27.131423    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-df78v\""
Sep 16 14:05:27.135642 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:27.135620    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:05:27.139821 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:27.139730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsdt"
Sep 16 14:05:27.346255 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:27.346228    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dv2zf"]
Sep 16 14:05:27.408101 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:27.407965    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gq5pp"]
Sep 16 14:05:27.409985 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:27.409961    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb655a103_09b9_4934_8c20_c44fae75cf19.slice/crio-35a9dd4138d1041d6c8d5e24f4173f142b67106d12b10922866475a04dd681d2 WatchSource:0}: Error finding container 35a9dd4138d1041d6c8d5e24f4173f142b67106d12b10922866475a04dd681d2: Status 404 returned error can't find the container with id 35a9dd4138d1041d6c8d5e24f4173f142b67106d12b10922866475a04dd681d2
Sep 16 14:05:27.413340 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:27.413318    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdsdt"]
Sep 16 14:05:27.415919 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:27.415898    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d48063_48c0_4bcf_9e7a_1d39b0826ef2.slice/crio-86af900a0da4b15d25005ffe3503b81334c31a8413859d3d26b2c28c092c1b96 WatchSource:0}: Error finding container 86af900a0da4b15d25005ffe3503b81334c31a8413859d3d26b2c28c092c1b96: Status 404 returned error can't find the container with id 86af900a0da4b15d25005ffe3503b81334c31a8413859d3d26b2c28c092c1b96
Sep 16 14:05:27.437541 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:27.437508    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gq5pp" event={"ID":"b655a103-09b9-4934-8c20-c44fae75cf19","Type":"ContainerStarted","Data":"35a9dd4138d1041d6c8d5e24f4173f142b67106d12b10922866475a04dd681d2"}
Sep 16 14:05:27.438979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:27.438949    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdsdt" event={"ID":"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2","Type":"ContainerStarted","Data":"86af900a0da4b15d25005ffe3503b81334c31a8413859d3d26b2c28c092c1b96"}
Sep 16 14:05:27.440022 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:27.440002    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dv2zf" event={"ID":"9176e0ae-8c42-4247-9a57-e0260a972717","Type":"ContainerStarted","Data":"c7530ceb6da6a7cc1400f3d9299534ffc0b7c6fb94bfb2cc2501ada0299ee5f9"}
Sep 16 14:05:28.003083 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.003034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:05:28.003083 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.003087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:05:28.003571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.003109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:05:28.003571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.003146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:05:28.003571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.003250    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:28.003571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.003296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:28.004068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.004030    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7639350f-d2a2-43d4-81aa-a63a808f8c90-service-ca-bundle\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:28.005878 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.005846    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7639350f-d2a2-43d4-81aa-a63a808f8c90-metrics-certs\") pod \"router-default-7cbdcfd966-ktx58\" (UID: \"7639350f-d2a2-43d4-81aa-a63a808f8c90\") " pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:28.005971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.005879    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7062088c-b344-4940-85d0-f635f757bd31-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmdtr\" (UID: \"7062088c-b344-4940-85d0-f635f757bd31\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:05:28.006014 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.005967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70310645-9dd0-4568-b1d2-7efa89355c38-metrics-tls\") pod \"dns-default-vp5jx\" (UID: \"70310645-9dd0-4568-b1d2-7efa89355c38\") " pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:05:28.006048 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.006023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee5ccee-0d6e-4ba9-9131-ba177c7bd366-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-w9swh\" (UID: \"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:05:28.006092 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.006075    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19cb7589-a354-4795-b9c0-311be25cf056-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-85mkf\" (UID: \"19cb7589-a354-4795-b9c0-311be25cf056\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:05:28.104490 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.104453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:05:28.106968 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.106936    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls\") pod \"image-registry-7b99ccb44d-27kd7\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") " pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:05:28.111170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.111148    2579 scope.go:117] "RemoveContainer" containerID="796679c97ce43539dc5ecbb9b0c9ef88605f7164e63424340e1152f2446ffc3e"
Sep 16 14:05:28.167046 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.167019    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nfdsg\""
Sep 16 14:05:28.173476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.173448    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rwbkp\""
Sep 16 14:05:28.175625 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.175560    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:05:28.181350 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.181328    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"
Sep 16 14:05:28.189614 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.189595    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-82vq9\""
Sep 16 14:05:28.197964 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.197937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:28.233019 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.232981    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xjnm9\""
Sep 16 14:05:28.242725 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.242466    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"
Sep 16 14:05:28.259029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.249614    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xc4xm\""
Sep 16 14:05:28.259029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.258278    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"
Sep 16 14:05:28.266189 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.266128    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ss8nr\""
Sep 16 14:05:28.276463 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.275771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:05:28.445699 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.445671    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:05:28.445889 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.445771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv" event={"ID":"7d90c854-fe26-4de2-9d50-458bcc967694","Type":"ContainerStarted","Data":"4c845ba5fc4cfeac67f53d7a848acdbd71fc3d2f4e5af086ea414b84957c661d"}
Sep 16 14:05:28.446097 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.446076    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:05:28.448952 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.448923    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gq5pp" event={"ID":"b655a103-09b9-4934-8c20-c44fae75cf19","Type":"ContainerStarted","Data":"9d28a2fd906f1a49d4cf4c90efa7f04a0928bc9f1a1bd6bd17d012f03685361e"}
Sep 16 14:05:28.449355 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.449338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:05:28.465324 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.465282    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv" podStartSLOduration=52.273543659 podStartE2EDuration="1m1.465263214s" totalImagesPullingTime="9.191719555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:28.464693605 +0000 UTC m=+67.764103873" watchObservedRunningTime="2026-09-16 14:05:28.465263214 +0000 UTC m=+67.764673482"
Sep 16 14:05:28.473368 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.473330    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b99ccb44d-27kd7"]
Sep 16 14:05:28.475799 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.475739    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh"]
Sep 16 14:05:28.478236 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:28.478204    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d33c58_5154_4811_a6a2_8ac3ea00ebee.slice/crio-168303a7aaf42dbbc3683ff37675a3b831e822f8b8c72361adc47b81bac2d14b WatchSource:0}: Error finding container 168303a7aaf42dbbc3683ff37675a3b831e822f8b8c72361adc47b81bac2d14b: Status 404 returned error can't find the container with id 168303a7aaf42dbbc3683ff37675a3b831e822f8b8c72361adc47b81bac2d14b
Sep 16 14:05:28.484831 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.484760    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gq5pp" podStartSLOduration=66.484742527 podStartE2EDuration="1m6.484742527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:28.483533253 +0000 UTC m=+67.782943520" watchObservedRunningTime="2026-09-16 14:05:28.484742527 +0000 UTC m=+67.784152794"
Sep 16 14:05:28.504942 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.504878    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cbdcfd966-ktx58"]
Sep 16 14:05:28.509772 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:28.509743    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7639350f_d2a2_43d4_81aa_a63a808f8c90.slice/crio-d2c1ba85b2455e9697ba4c6b6056bde1e928724e3693b8ff91d3c54d65d473a2 WatchSource:0}: Error finding container d2c1ba85b2455e9697ba4c6b6056bde1e928724e3693b8ff91d3c54d65d473a2: Status 404 returned error can't find the container with id d2c1ba85b2455e9697ba4c6b6056bde1e928724e3693b8ff91d3c54d65d473a2
Sep 16 14:05:28.566196 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.566171    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf"]
Sep 16 14:05:28.569650 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.569618    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr"]
Sep 16 14:05:28.570708 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:28.570678    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19cb7589_a354_4795_b9c0_311be25cf056.slice/crio-69d079857677a76a676eef1bec5c95025558f364aee581a81d5a7921eb850c53 WatchSource:0}: Error finding container 69d079857677a76a676eef1bec5c95025558f364aee581a81d5a7921eb850c53: Status 404 returned error can't find the container with id 69d079857677a76a676eef1bec5c95025558f364aee581a81d5a7921eb850c53
Sep 16 14:05:28.574461 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:28.574169    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7062088c_b344_4940_85d0_f635f757bd31.slice/crio-8db00d8f327d8b92fcc5f53e10d8f9230f5de179709fa71f3bf935f64c9c8c8c WatchSource:0}: Error finding container 8db00d8f327d8b92fcc5f53e10d8f9230f5de179709fa71f3bf935f64c9c8c8c: Status 404 returned error can't find the container with id 8db00d8f327d8b92fcc5f53e10d8f9230f5de179709fa71f3bf935f64c9c8c8c
Sep 16 14:05:28.576510 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:28.576475    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vp5jx"]
Sep 16 14:05:28.581868 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:28.581717    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70310645_9dd0_4568_b1d2_7efa89355c38.slice/crio-a29498d0827bdb5466aa1ee335aaa5069cc2c2af8a99a57f43e88765339c57f0 WatchSource:0}: Error finding container a29498d0827bdb5466aa1ee335aaa5069cc2c2af8a99a57f43e88765339c57f0: Status 404 returned error can't find the container with id a29498d0827bdb5466aa1ee335aaa5069cc2c2af8a99a57f43e88765339c57f0
Sep 16 14:05:29.374265 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.374232    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-vnfbv"
Sep 16 14:05:29.459935 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.456590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh" event={"ID":"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366","Type":"ContainerStarted","Data":"74c7bc0cbb08789f9dc04542eb7e7cc2f0066f37db7a08f581304354804b5f23"}
Sep 16 14:05:29.461185 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.461150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7" event={"ID":"85d33c58-5154-4811-a6a2-8ac3ea00ebee","Type":"ContainerStarted","Data":"c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd"}
Sep 16 14:05:29.461422 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.461399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7" event={"ID":"85d33c58-5154-4811-a6a2-8ac3ea00ebee","Type":"ContainerStarted","Data":"168303a7aaf42dbbc3683ff37675a3b831e822f8b8c72361adc47b81bac2d14b"}
Sep 16 14:05:29.461616 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.461603    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:05:29.464785 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.464753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vp5jx" event={"ID":"70310645-9dd0-4568-b1d2-7efa89355c38","Type":"ContainerStarted","Data":"a29498d0827bdb5466aa1ee335aaa5069cc2c2af8a99a57f43e88765339c57f0"}
Sep 16 14:05:29.472081 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.472054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr" event={"ID":"7062088c-b344-4940-85d0-f635f757bd31","Type":"ContainerStarted","Data":"8db00d8f327d8b92fcc5f53e10d8f9230f5de179709fa71f3bf935f64c9c8c8c"}
Sep 16 14:05:29.475853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.475827    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf" event={"ID":"19cb7589-a354-4795-b9c0-311be25cf056","Type":"ContainerStarted","Data":"69d079857677a76a676eef1bec5c95025558f364aee581a81d5a7921eb850c53"}
Sep 16 14:05:29.482061 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.482013    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7" podStartSLOduration=67.481995771 podStartE2EDuration="1m7.481995771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:29.480626595 +0000 UTC m=+68.780036863" watchObservedRunningTime="2026-09-16 14:05:29.481995771 +0000 UTC m=+68.781406039"
Sep 16 14:05:29.483852 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.483617    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cbdcfd966-ktx58" event={"ID":"7639350f-d2a2-43d4-81aa-a63a808f8c90","Type":"ContainerStarted","Data":"0307ab7dd7bfd462344aa208b3dcabc814738798ce93370fd7fa64957d70f643"}
Sep 16 14:05:29.483852 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.483659    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cbdcfd966-ktx58" event={"ID":"7639350f-d2a2-43d4-81aa-a63a808f8c90","Type":"ContainerStarted","Data":"d2c1ba85b2455e9697ba4c6b6056bde1e928724e3693b8ff91d3c54d65d473a2"}
Sep 16 14:05:29.504648 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:29.504372    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7cbdcfd966-ktx58" podStartSLOduration=62.504352905 podStartE2EDuration="1m2.504352905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:29.502711929 +0000 UTC m=+68.802122197" watchObservedRunningTime="2026-09-16 14:05:29.504352905 +0000 UTC m=+68.803763174"
Sep 16 14:05:30.199148 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:30.199114    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:30.202401 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:30.202377    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:30.489791 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:30.489691    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:30.491089 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:30.491037    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7cbdcfd966-ktx58"
Sep 16 14:05:34.278884 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.278852    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d5d68db7d-8z6gz"]
Sep 16 14:05:34.310109 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.310081    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5d68db7d-8z6gz"]
Sep 16 14:05:34.310261 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.310209    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.314260 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.314237    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 14:05:34.314366 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.314240    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 14:05:34.314741 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.314699    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 14:05:34.314741 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.314732    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 14:05:34.314898 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.314747    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 14:05:34.314898 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.314750    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 14:05:34.316677 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.316632    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w6sw4\""
Sep 16 14:05:34.316778 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.316689    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 14:05:34.463119 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.463085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-service-ca\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.463282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.463140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-serving-cert\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.463282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.463190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-oauth-config\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.463282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.463241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-oauth-serving-cert\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.463418 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.463289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-config\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.463418 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.463307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvw4d\" (UniqueName: \"kubernetes.io/projected/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-kube-api-access-wvw4d\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.505299 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.505257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdsdt" event={"ID":"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2","Type":"ContainerStarted","Data":"7a0f8c86f017e6c0e94672cd429707f72ba643aea1c33d20a0460c10ab18f63e"}
Sep 16 14:05:34.505426 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.505310    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdsdt" event={"ID":"b8d48063-48c0-4bcf-9e7a-1d39b0826ef2","Type":"ContainerStarted","Data":"b2aff7ad079eb195d1839b21f1d645afca73eea5ff35c683f3c0898510b2f6b1"}
Sep 16 14:05:34.507137 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.507113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh" event={"ID":"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366","Type":"ContainerStarted","Data":"10a04bdb7719b44e2dfcdcdef3747c1b1607ca98fdb40f6610dc865bcd728348"}
Sep 16 14:05:34.507275 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.507161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh" event={"ID":"2ee5ccee-0d6e-4ba9-9131-ba177c7bd366","Type":"ContainerStarted","Data":"2a2bba1936f2201e4714bcb6a9694cc5b00753d737b81de9c7de66dbfac29a90"}
Sep 16 14:05:34.508555 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.508522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dv2zf" event={"ID":"9176e0ae-8c42-4247-9a57-e0260a972717","Type":"ContainerStarted","Data":"7d1b7f659a2a5aa993dbcd97ff4bd242f680ca73dc388a3c7d6400da2e1dd1dd"}
Sep 16 14:05:34.510337 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.510312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vp5jx" event={"ID":"70310645-9dd0-4568-b1d2-7efa89355c38","Type":"ContainerStarted","Data":"b21af8aff8e832bd9de79d7c491903677b115522ace50d64544de1039d367f5b"}
Sep 16 14:05:34.510433 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.510366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vp5jx" event={"ID":"70310645-9dd0-4568-b1d2-7efa89355c38","Type":"ContainerStarted","Data":"3c08628d1e93ae5502c47cc2856b4b39608443cf9fe68a9696c8ba16ff0568b0"}
Sep 16 14:05:34.510433 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.510397    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:05:34.511783 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.511764    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr" event={"ID":"7062088c-b344-4940-85d0-f635f757bd31","Type":"ContainerStarted","Data":"9178499b62f0e6708a21e47083f3a45b9fe8eaf732eb328e7153822e703dd740"}
Sep 16 14:05:34.513170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.513140    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf" event={"ID":"19cb7589-a354-4795-b9c0-311be25cf056","Type":"ContainerStarted","Data":"93dfa4e140b0d2f687f01d29b3f158ada2340f8c1bcc2986b049f760e1ec6dfb"}
Sep 16 14:05:34.524984 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.524935    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vdsdt" podStartSLOduration=66.344382016 podStartE2EDuration="1m12.524921558s" totalImagesPullingTime="6.180539542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:34.523656708 +0000 UTC m=+73.823066975" watchObservedRunningTime="2026-09-16 14:05:34.524921558 +0000 UTC m=+73.824331826"
Sep 16 14:05:34.553402 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.549917    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vp5jx" podStartSLOduration=33.59851573 podStartE2EDuration="38.549905082s" totalImagesPullingTime="4.951389352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:34.549220882 +0000 UTC m=+73.848631149" watchObservedRunningTime="2026-09-16 14:05:34.549905082 +0000 UTC m=+73.849315349"
Sep 16 14:05:34.563922 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.563899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-serving-cert\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.564022 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.563932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-oauth-config\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.564022 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.563960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-oauth-serving-cert\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.564022 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.564008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-config\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.564195 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.564167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw4d\" (UniqueName: \"kubernetes.io/projected/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-kube-api-access-wvw4d\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.564305 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.564288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-service-ca\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.564764 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.564742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-oauth-serving-cert\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.564878 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.564793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-config\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.564967 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.564948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-service-ca\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.566428 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.566410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-serving-cert\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.566503 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.566429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-oauth-config\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.576328 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.576287    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-w9swh" podStartSLOduration=62.568950756 podStartE2EDuration="1m7.576275693s" totalImagesPullingTime="5.007324937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:34.575679299 +0000 UTC m=+73.875089567" watchObservedRunningTime="2026-09-16 14:05:34.576275693 +0000 UTC m=+73.875685959"
Sep 16 14:05:34.582637 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.582619    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvw4d\" (UniqueName: \"kubernetes.io/projected/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-kube-api-access-wvw4d\") pod \"console-d5d68db7d-8z6gz\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") " pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.598174 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.598137    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-85mkf" podStartSLOduration=48.635426704 podStartE2EDuration="53.598124746s" totalImagesPullingTime="4.962698042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:34.597038707 +0000 UTC m=+73.896448978" watchObservedRunningTime="2026-09-16 14:05:34.598124746 +0000 UTC m=+73.897535013"
Sep 16 14:05:34.614283 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.614245    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dv2zf" podStartSLOduration=66.430524681 podStartE2EDuration="1m12.61423297s" totalImagesPullingTime="6.183708289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:34.613571189 +0000 UTC m=+73.912981457" watchObservedRunningTime="2026-09-16 14:05:34.61423297 +0000 UTC m=+73.913643261"
Sep 16 14:05:34.619916 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.619889    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:34.631877 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.631839    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmdtr" podStartSLOduration=62.673111827 podStartE2EDuration="1m7.631827099s" totalImagesPullingTime="4.958715272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:34.630953808 +0000 UTC m=+73.930364075" watchObservedRunningTime="2026-09-16 14:05:34.631827099 +0000 UTC m=+73.931237362"
Sep 16 14:05:34.922300 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:34.922269    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5d68db7d-8z6gz"]
Sep 16 14:05:34.925175 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:34.925150    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75f89a7_ed51_4ef1_aa4e_8a8e38c2503c.slice/crio-0516c8d3459af8fb1fa8e7b56e039b7c7c94cee96cc90a2c048eaabd474e8a52 WatchSource:0}: Error finding container 0516c8d3459af8fb1fa8e7b56e039b7c7c94cee96cc90a2c048eaabd474e8a52: Status 404 returned error can't find the container with id 0516c8d3459af8fb1fa8e7b56e039b7c7c94cee96cc90a2c048eaabd474e8a52
Sep 16 14:05:35.521176 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:35.521138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d68db7d-8z6gz" event={"ID":"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c","Type":"ContainerStarted","Data":"0516c8d3459af8fb1fa8e7b56e039b7c7c94cee96cc90a2c048eaabd474e8a52"}
Sep 16 14:05:38.535673 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:38.535635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d68db7d-8z6gz" event={"ID":"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c","Type":"ContainerStarted","Data":"9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a"}
Sep 16 14:05:38.556394 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:38.556348    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d5d68db7d-8z6gz" podStartSLOduration=1.162432638 podStartE2EDuration="4.55633188s" totalImagesPullingTime="3.393899242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:38.55452633 +0000 UTC m=+77.853936638" watchObservedRunningTime="2026-09-16 14:05:38.55633188 +0000 UTC m=+77.855742146"
Sep 16 14:05:39.810700 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:39.810661    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:39.813102 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:39.813074    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09302756-6ac0-4c12-a4ae-7e5546cde847-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v7c5\" (UID: \"09302756-6ac0-4c12-a4ae-7e5546cde847\") " pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:40.085772 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:40.085680    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zzz2w\""
Sep 16 14:05:40.093765 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:40.093747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6v7c5"
Sep 16 14:05:40.391959 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:40.391936    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6v7c5"]
Sep 16 14:05:40.394708 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:40.394680    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09302756_6ac0_4c12_a4ae_7e5546cde847.slice/crio-54998a909c9d7654d196d1c57c3fc3960e38ff2c2831ec41db30efbe620dd735 WatchSource:0}: Error finding container 54998a909c9d7654d196d1c57c3fc3960e38ff2c2831ec41db30efbe620dd735: Status 404 returned error can't find the container with id 54998a909c9d7654d196d1c57c3fc3960e38ff2c2831ec41db30efbe620dd735
Sep 16 14:05:40.545184 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:40.545157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v7c5" event={"ID":"09302756-6ac0-4c12-a4ae-7e5546cde847","Type":"ContainerStarted","Data":"17392bd17de7f449aafc1fdac4740759f8585870d75d4bc6a794a8346165e816"}
Sep 16 14:05:40.545292 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:40.545220    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v7c5" event={"ID":"09302756-6ac0-4c12-a4ae-7e5546cde847","Type":"ContainerStarted","Data":"54998a909c9d7654d196d1c57c3fc3960e38ff2c2831ec41db30efbe620dd735"}
Sep 16 14:05:42.554078 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:42.554045    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v7c5" event={"ID":"09302756-6ac0-4c12-a4ae-7e5546cde847","Type":"ContainerStarted","Data":"34cff6c0dfed17e3a804e7d86af5758e993d3cd3d229b67fcf9303c611db2de1"}
Sep 16 14:05:44.524027 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.523997    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vp5jx"
Sep 16 14:05:44.565409 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.565364    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v7c5" event={"ID":"09302756-6ac0-4c12-a4ae-7e5546cde847","Type":"ContainerStarted","Data":"7ba9c0bca84e0822c745ee932f5e151d5416202c9ba3ddfb9b06c7c9629df5e1"}
Sep 16 14:05:44.580824 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.580794    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"]
Sep 16 14:05:44.583267 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.583248    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.586352 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.586327    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 16 14:05:44.586480 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.586451    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wjdgs\""
Sep 16 14:05:44.587000 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.586983    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 16 14:05:44.587529 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.587508    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 16 14:05:44.587654 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.587589    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 14:05:44.596952 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.596913    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6v7c5" podStartSLOduration=33.883099924 podStartE2EDuration="37.596898089s" totalImagesPullingTime="3.713798165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:05:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:44.595937479 +0000 UTC m=+83.895347745" watchObservedRunningTime="2026-09-16 14:05:44.596898089 +0000 UTC m=+83.896308369"
Sep 16 14:05:44.599819 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.599797    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"]
Sep 16 14:05:44.612852 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.612798    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n6dlr"]
Sep 16 14:05:44.615553 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.615530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.619403 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.619381    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 14:05:44.619915 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.619896    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dpfk2\""
Sep 16 14:05:44.620005 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.619984    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 14:05:44.620005 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.619995    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 14:05:44.620115 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.620073    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:44.620115 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.620109    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:44.626146 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.626128    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:44.642184 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch6x9\" (UniqueName: \"kubernetes.io/projected/95468dde-e111-49af-ae5a-0a36d109007f-kube-api-access-ch6x9\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.642298 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95468dde-e111-49af-ae5a-0a36d109007f-sys\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.642362 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.642423 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642400    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.642469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-textfile\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.642469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642451    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.642585 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95468dde-e111-49af-ae5a-0a36d109007f-root\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.642643 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642584    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-tls\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.642679 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.642715 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642689    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95468dde-e111-49af-ae5a-0a36d109007f-metrics-client-ca\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.642756 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.642806 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642786    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-wtmp\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.642889 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.643007 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.642992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-accelerators-collector-config\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.643069 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.643024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tbcw\" (UniqueName: \"kubernetes.io/projected/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-api-access-8tbcw\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.744018 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.743991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-tls\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95468dde-e111-49af-ae5a-0a36d109007f-metrics-client-ca\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.744170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-wtmp\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.744170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-accelerators-collector-config\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744174    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tbcw\" (UniqueName: \"kubernetes.io/projected/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-api-access-8tbcw\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.744508 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6x9\" (UniqueName: \"kubernetes.io/projected/95468dde-e111-49af-ae5a-0a36d109007f-kube-api-access-ch6x9\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744508 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:44.744234    2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 16 14:05:44.744508 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95468dde-e111-49af-ae5a-0a36d109007f-sys\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744508 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:05:44.744302    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-tls podName:12a1d253-2a3c-47dd-b5e6-c275fdf72d26 nodeName:}" failed. No retries permitted until 2026-09-16 14:05:45.244282917 +0000 UTC m=+84.543693167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-qjxdn" (UID: "12a1d253-2a3c-47dd-b5e6-c275fdf72d26") : secret "kube-state-metrics-tls" not found
Sep 16 14:05:44.744508 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744421    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-wtmp\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744508 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95468dde-e111-49af-ae5a-0a36d109007f-sys\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744508 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.744886 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744563    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.744886 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-textfile\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744886 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.744886 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95468dde-e111-49af-ae5a-0a36d109007f-root\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744886 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744745    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95468dde-e111-49af-ae5a-0a36d109007f-root\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.744886 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744846    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-accelerators-collector-config\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.745182 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95468dde-e111-49af-ae5a-0a36d109007f-metrics-client-ca\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.745182 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.744993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.745182 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.745034    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-textfile\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.745349 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.745216    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.745484 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.745462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.746641 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.746622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-tls\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.747073 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.747047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95468dde-e111-49af-ae5a-0a36d109007f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.747155 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.747107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.755658 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.755633    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch6x9\" (UniqueName: \"kubernetes.io/projected/95468dde-e111-49af-ae5a-0a36d109007f-kube-api-access-ch6x9\") pod \"node-exporter-n6dlr\" (UID: \"95468dde-e111-49af-ae5a-0a36d109007f\") " pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.755798 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.755781    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tbcw\" (UniqueName: \"kubernetes.io/projected/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-api-access-8tbcw\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:44.924571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:44.924530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n6dlr"
Sep 16 14:05:44.934837 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:44.934811    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95468dde_e111_49af_ae5a_0a36d109007f.slice/crio-001693a4a4765569deec3b3494ca5b8c489fea807b8a62e93a298534c6fffedc WatchSource:0}: Error finding container 001693a4a4765569deec3b3494ca5b8c489fea807b8a62e93a298534c6fffedc: Status 404 returned error can't find the container with id 001693a4a4765569deec3b3494ca5b8c489fea807b8a62e93a298534c6fffedc
Sep 16 14:05:45.247987 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:45.247912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:45.250337 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:45.250313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12a1d253-2a3c-47dd-b5e6-c275fdf72d26-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-qjxdn\" (UID: \"12a1d253-2a3c-47dd-b5e6-c275fdf72d26\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:45.493051 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:45.493019    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"
Sep 16 14:05:45.572050 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:45.572017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n6dlr" event={"ID":"95468dde-e111-49af-ae5a-0a36d109007f","Type":"ContainerStarted","Data":"001693a4a4765569deec3b3494ca5b8c489fea807b8a62e93a298534c6fffedc"}
Sep 16 14:05:45.577717 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:45.577649    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:05:45.770147 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:45.770111    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn"]
Sep 16 14:05:45.772973 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:45.772949    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a1d253_2a3c_47dd_b5e6_c275fdf72d26.slice/crio-12c6e6612c3c1d891bdb3c531ddfa83905deeff0dfd2440a1e9685dbf33bd0c6 WatchSource:0}: Error finding container 12c6e6612c3c1d891bdb3c531ddfa83905deeff0dfd2440a1e9685dbf33bd0c6: Status 404 returned error can't find the container with id 12c6e6612c3c1d891bdb3c531ddfa83905deeff0dfd2440a1e9685dbf33bd0c6
Sep 16 14:05:46.577975 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:46.577944    2579 generic.go:356] "Generic (PLEG): container finished" podID="95468dde-e111-49af-ae5a-0a36d109007f" containerID="6b38e0927c4034ef87597980abc3dbe8bc8c21d4476b3493075769aa751ca8d7" exitCode=0
Sep 16 14:05:46.578456 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:46.578036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n6dlr" event={"ID":"95468dde-e111-49af-ae5a-0a36d109007f","Type":"ContainerDied","Data":"6b38e0927c4034ef87597980abc3dbe8bc8c21d4476b3493075769aa751ca8d7"}
Sep 16 14:05:46.579613 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:46.579586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn" event={"ID":"12a1d253-2a3c-47dd-b5e6-c275fdf72d26","Type":"ContainerStarted","Data":"12c6e6612c3c1d891bdb3c531ddfa83905deeff0dfd2440a1e9685dbf33bd0c6"}
Sep 16 14:05:47.585721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:47.585688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n6dlr" event={"ID":"95468dde-e111-49af-ae5a-0a36d109007f","Type":"ContainerStarted","Data":"387cfe6ef6ea45eb9a9bf2442bf2638fc716dc38ddab4d47446e5bdee65ace09"}
Sep 16 14:05:47.586161 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:47.585747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n6dlr" event={"ID":"95468dde-e111-49af-ae5a-0a36d109007f","Type":"ContainerStarted","Data":"b2c21e396f2d5a704f1fe87a86346ad68ba152a6be830290673c95662b342acd"}
Sep 16 14:05:47.607643 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:47.607597    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n6dlr" podStartSLOduration=2.4059765029999998 podStartE2EDuration="3.607582528s" totalImagesPullingTime="1.139239506s" totalInitContainerRuntime="62.366519ms" isStatefulPod=true podCreationTimestamp="2026-09-16 14:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:47.606023187 +0000 UTC m=+86.905433454" watchObservedRunningTime="2026-09-16 14:05:47.607582528 +0000 UTC m=+86.906992792"
Sep 16 14:05:49.337676 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.337601    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"]
Sep 16 14:05:49.339800 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.339783    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"
Sep 16 14:05:49.342880 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.342858    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fk2b2\""
Sep 16 14:05:49.343629 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.343609    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 16 14:05:49.354415 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.354390    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"]
Sep 16 14:05:49.385275 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.385248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/89a14d69-4ea4-4d9d-951c-c64908f628b0-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-wb8cm\" (UID: \"89a14d69-4ea4-4d9d-951c-c64908f628b0\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"
Sep 16 14:05:49.385378 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.385297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8mpz\" (UniqueName: \"kubernetes.io/projected/89a14d69-4ea4-4d9d-951c-c64908f628b0-kube-api-access-c8mpz\") pod \"monitoring-plugin-5d85778b9d-wb8cm\" (UID: \"89a14d69-4ea4-4d9d-951c-c64908f628b0\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"
Sep 16 14:05:49.486615 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.486581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8mpz\" (UniqueName: \"kubernetes.io/projected/89a14d69-4ea4-4d9d-951c-c64908f628b0-kube-api-access-c8mpz\") pod \"monitoring-plugin-5d85778b9d-wb8cm\" (UID: \"89a14d69-4ea4-4d9d-951c-c64908f628b0\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"
Sep 16 14:05:49.486782 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.486745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/89a14d69-4ea4-4d9d-951c-c64908f628b0-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-wb8cm\" (UID: \"89a14d69-4ea4-4d9d-951c-c64908f628b0\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"
Sep 16 14:05:49.489205 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.489181    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/89a14d69-4ea4-4d9d-951c-c64908f628b0-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-wb8cm\" (UID: \"89a14d69-4ea4-4d9d-951c-c64908f628b0\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"
Sep 16 14:05:49.494684 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.494663    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8mpz\" (UniqueName: \"kubernetes.io/projected/89a14d69-4ea4-4d9d-951c-c64908f628b0-kube-api-access-c8mpz\") pod \"monitoring-plugin-5d85778b9d-wb8cm\" (UID: \"89a14d69-4ea4-4d9d-951c-c64908f628b0\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"
Sep 16 14:05:49.596342 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.596248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn" event={"ID":"12a1d253-2a3c-47dd-b5e6-c275fdf72d26","Type":"ContainerStarted","Data":"f8caaefbf400aaa88470958b958e8ba58fed6785a4c2accd1768e85600872ab7"}
Sep 16 14:05:49.596342 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.596314    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn" event={"ID":"12a1d253-2a3c-47dd-b5e6-c275fdf72d26","Type":"ContainerStarted","Data":"4700effe4e181dcfa470476944922f910759134b8d599e4dcb5d96469937e27d"}
Sep 16 14:05:49.596342 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.596335    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn" event={"ID":"12a1d253-2a3c-47dd-b5e6-c275fdf72d26","Type":"ContainerStarted","Data":"19c40139c8cc6616d9b8f0f50699c6f1162b925f34583290b5f0adc1ecef65b1"}
Sep 16 14:05:49.617496 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.617440    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-qjxdn" podStartSLOduration=2.467082205 podStartE2EDuration="5.617424459s" totalImagesPullingTime="3.150342254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:49.615756862 +0000 UTC m=+88.915167130" watchObservedRunningTime="2026-09-16 14:05:49.617424459 +0000 UTC m=+88.916834755"
Sep 16 14:05:49.653642 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.653618    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"
Sep 16 14:05:49.909770 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.909718    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8675c9cb4d-ctnkg"]
Sep 16 14:05:49.912429 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.912409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:49.920508 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.920488    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 14:05:49.926342 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.926313    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8675c9cb4d-ctnkg"]
Sep 16 14:05:49.927719 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.927677    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"]
Sep 16 14:05:49.930484 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:49.930458    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a14d69_4ea4_4d9d_951c_c64908f628b0.slice/crio-0c13bb33232eacbbf3a4d5a7364df604d0dcdee24004f7b3cd2b4956bee8ba91 WatchSource:0}: Error finding container 0c13bb33232eacbbf3a4d5a7364df604d0dcdee24004f7b3cd2b4956bee8ba91: Status 404 returned error can't find the container with id 0c13bb33232eacbbf3a4d5a7364df604d0dcdee24004f7b3cd2b4956bee8ba91
Sep 16 14:05:49.992052 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.992025    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-oauth-serving-cert\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:49.992192 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.992062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-oauth-config\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:49.992192 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.992091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cjtl\" (UniqueName: \"kubernetes.io/projected/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-kube-api-access-2cjtl\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:49.992192 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.992123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-trusted-ca-bundle\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:49.992192 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.992174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-service-ca\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:49.992369 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.992207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-config\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:49.992369 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:49.992252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-serving-cert\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.092962 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.092928    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-oauth-serving-cert\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.092962 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.092965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-oauth-config\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.093197 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.092989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cjtl\" (UniqueName: \"kubernetes.io/projected/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-kube-api-access-2cjtl\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.093197 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.093111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-trusted-ca-bundle\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.093197 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.093181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-service-ca\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.093354 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.093212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-config\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.093354 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.093258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-serving-cert\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.093786 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.093767    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-oauth-serving-cert\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.093985 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.093963    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-service-ca\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.094060 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.093988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-trusted-ca-bundle\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.094060 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.093999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-config\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.095505 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.095476    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-oauth-config\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.095634 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.095616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-serving-cert\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.100996 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.100971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cjtl\" (UniqueName: \"kubernetes.io/projected/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-kube-api-access-2cjtl\") pod \"console-8675c9cb4d-ctnkg\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") " pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.221898 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.221831    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:05:50.493782 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.493714    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:05:50.501158 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.501105    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8675c9cb4d-ctnkg"]
Sep 16 14:05:50.504680 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:05:50.504657    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f68fbe_ede5_40b7_b0c3_d9e2aea2f753.slice/crio-6772b3201838860fe50a896dba74429275120ecff88d9a36b5b2c54919149896 WatchSource:0}: Error finding container 6772b3201838860fe50a896dba74429275120ecff88d9a36b5b2c54919149896: Status 404 returned error can't find the container with id 6772b3201838860fe50a896dba74429275120ecff88d9a36b5b2c54919149896
Sep 16 14:05:50.602471 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.602426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm" event={"ID":"89a14d69-4ea4-4d9d-951c-c64908f628b0","Type":"ContainerStarted","Data":"0c13bb33232eacbbf3a4d5a7364df604d0dcdee24004f7b3cd2b4956bee8ba91"}
Sep 16 14:05:50.604182 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.604156    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675c9cb4d-ctnkg" event={"ID":"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753","Type":"ContainerStarted","Data":"c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643"}
Sep 16 14:05:50.604291 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.604196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675c9cb4d-ctnkg" event={"ID":"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753","Type":"ContainerStarted","Data":"6772b3201838860fe50a896dba74429275120ecff88d9a36b5b2c54919149896"}
Sep 16 14:05:50.623854 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:50.623792    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8675c9cb4d-ctnkg" podStartSLOduration=1.623773673 podStartE2EDuration="1.623773673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:50.623384329 +0000 UTC m=+89.922794597" watchObservedRunningTime="2026-09-16 14:05:50.623773673 +0000 UTC m=+89.923183941"
Sep 16 14:05:52.394121 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:52.394092    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b99ccb44d-27kd7"]
Sep 16 14:05:54.622801 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:54.622741    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm" event={"ID":"89a14d69-4ea4-4d9d-951c-c64908f628b0","Type":"ContainerStarted","Data":"33fb41690ce0465997b3058eb9cbdbd090191504271a66b12d1e2e9f67c7462f"}
Sep 16 14:05:54.623230 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:54.622905    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"
Sep 16 14:05:54.627725 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:54.627705    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm"
Sep 16 14:05:54.646029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:05:54.645987    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wb8cm" podStartSLOduration=1.746993673 podStartE2EDuration="5.645972643s" totalImagesPullingTime="3.89897897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:05:54.64489803 +0000 UTC m=+93.944308296" watchObservedRunningTime="2026-09-16 14:05:54.645972643 +0000 UTC m=+93.945382909"
Sep 16 14:06:00.221978 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:00.221938    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:06:00.222368 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:00.221996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:06:00.226790 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:00.226758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:06:00.491341 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:00.491264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gq5pp"
Sep 16 14:06:00.647041 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:00.647016    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:06:00.700568 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:00.700522    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d5d68db7d-8z6gz"]
Sep 16 14:06:17.413375 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.413329    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7" podUID="85d33c58-5154-4811-a6a2-8ac3ea00ebee" containerName="registry" containerID="cri-o://c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd" gracePeriod=30
Sep 16 14:06:17.648255 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.648226    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:06:17.709295 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.709213    2579 generic.go:356] "Generic (PLEG): container finished" podID="85d33c58-5154-4811-a6a2-8ac3ea00ebee" containerID="c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd" exitCode=0
Sep 16 14:06:17.709295 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.709258    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7" event={"ID":"85d33c58-5154-4811-a6a2-8ac3ea00ebee","Type":"ContainerDied","Data":"c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd"}
Sep 16 14:06:17.709295 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.709264    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7"
Sep 16 14:06:17.709295 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.709296    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b99ccb44d-27kd7" event={"ID":"85d33c58-5154-4811-a6a2-8ac3ea00ebee","Type":"ContainerDied","Data":"168303a7aaf42dbbc3683ff37675a3b831e822f8b8c72361adc47b81bac2d14b"}
Sep 16 14:06:17.709627 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.709316    2579 scope.go:117] "RemoveContainer" containerID="c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd"
Sep 16 14:06:17.717298 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.717282    2579 scope.go:117] "RemoveContainer" containerID="c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd"
Sep 16 14:06:17.717568 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:06:17.717525    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd\": container with ID starting with c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd not found: ID does not exist" containerID="c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd"
Sep 16 14:06:17.717623 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.717572    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd"} err="failed to get container status \"c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd\": rpc error: code = NotFound desc = could not find container \"c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd\": container with ID starting with c882f3784bf3da71db7ae2876792f25f0849f6ab7cd5be52fa576a5bcca2fabd not found: ID does not exist"
Sep 16 14:06:17.728915 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.728895    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-bound-sa-token\") pod \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") "
Sep 16 14:06:17.729017 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.728935    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-installation-pull-secrets\") pod \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") "
Sep 16 14:06:17.729017 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.728961    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls\") pod \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") "
Sep 16 14:06:17.729119 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.729023    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-trusted-ca\") pod \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") "
Sep 16 14:06:17.729119 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.729061    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-certificates\") pod \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") "
Sep 16 14:06:17.729220 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.729120    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktsqn\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-kube-api-access-ktsqn\") pod \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") "
Sep 16 14:06:17.729339 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.729311    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-image-registry-private-configuration\") pod \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") "
Sep 16 14:06:17.729458 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.729435    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "85d33c58-5154-4811-a6a2-8ac3ea00ebee" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:06:17.729522 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.729484    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "85d33c58-5154-4811-a6a2-8ac3ea00ebee" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:06:17.729728 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.729708    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85d33c58-5154-4811-a6a2-8ac3ea00ebee-ca-trust-extracted\") pod \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\" (UID: \"85d33c58-5154-4811-a6a2-8ac3ea00ebee\") "
Sep 16 14:06:17.730066 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.730046    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-trusted-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:17.730156 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.730073    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-certificates\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:17.731522 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.731496    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "85d33c58-5154-4811-a6a2-8ac3ea00ebee" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:06:17.731661 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.731587    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "85d33c58-5154-4811-a6a2-8ac3ea00ebee" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:06:17.731661 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.731602    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-kube-api-access-ktsqn" (OuterVolumeSpecName: "kube-api-access-ktsqn") pod "85d33c58-5154-4811-a6a2-8ac3ea00ebee" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee"). InnerVolumeSpecName "kube-api-access-ktsqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:06:17.731754 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.731695    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "85d33c58-5154-4811-a6a2-8ac3ea00ebee" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:06:17.731946 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.731931    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "85d33c58-5154-4811-a6a2-8ac3ea00ebee" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:06:17.737910 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.737888    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d33c58-5154-4811-a6a2-8ac3ea00ebee-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "85d33c58-5154-4811-a6a2-8ac3ea00ebee" (UID: "85d33c58-5154-4811-a6a2-8ac3ea00ebee"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:06:17.830758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.830709    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-bound-sa-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:17.830758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.830752    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-installation-pull-secrets\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:17.830758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.830763    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-registry-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:17.830758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.830772    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktsqn\" (UniqueName: \"kubernetes.io/projected/85d33c58-5154-4811-a6a2-8ac3ea00ebee-kube-api-access-ktsqn\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:17.831018 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.830782    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85d33c58-5154-4811-a6a2-8ac3ea00ebee-image-registry-private-configuration\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:17.831018 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:17.830793    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85d33c58-5154-4811-a6a2-8ac3ea00ebee-ca-trust-extracted\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:18.031299 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:18.031263    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b99ccb44d-27kd7"]
Sep 16 14:06:18.035208 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:18.035179    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b99ccb44d-27kd7"]
Sep 16 14:06:19.115716 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:19.115687    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85d33c58-5154-4811-a6a2-8ac3ea00ebee" path="/var/lib/kubelet/pods/85d33c58-5154-4811-a6a2-8ac3ea00ebee/volumes"
Sep 16 14:06:25.728734 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:25.728690    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d5d68db7d-8z6gz" podUID="e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" containerName="console" containerID="cri-o://9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a" gracePeriod=15
Sep 16 14:06:25.966781 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:25.966759    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:06:26.100071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.100007    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-oauth-serving-cert\") pod \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") "
Sep 16 14:06:26.100071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.100042    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-service-ca\") pod \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") "
Sep 16 14:06:26.100228 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.100074    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvw4d\" (UniqueName: \"kubernetes.io/projected/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-kube-api-access-wvw4d\") pod \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") "
Sep 16 14:06:26.100228 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.100184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-oauth-config\") pod \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") "
Sep 16 14:06:26.100228 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.100212    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-config\") pod \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") "
Sep 16 14:06:26.100365 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.100261    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-serving-cert\") pod \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\" (UID: \"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c\") "
Sep 16 14:06:26.100456 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.100432    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" (UID: "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:06:26.100593 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.100576    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-service-ca" (OuterVolumeSpecName: "service-ca") pod "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" (UID: "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:06:26.100684 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.100661    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-config" (OuterVolumeSpecName: "console-config") pod "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" (UID: "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:06:26.102308 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.102270    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-kube-api-access-wvw4d" (OuterVolumeSpecName: "kube-api-access-wvw4d") pod "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" (UID: "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c"). InnerVolumeSpecName "kube-api-access-wvw4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:06:26.102308 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.102297    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" (UID: "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:06:26.102415 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.102357    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" (UID: "e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:06:26.200938 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.200910    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:26.200938 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.200932    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-oauth-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:26.200938 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.200943    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:26.201103 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.200952    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvw4d\" (UniqueName: \"kubernetes.io/projected/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-kube-api-access-wvw4d\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:26.201103 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.200961    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-oauth-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:26.201103 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.200969    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c-console-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:06:26.748758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.748720    2579 generic.go:356] "Generic (PLEG): container finished" podID="e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" containerID="9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a" exitCode=0
Sep 16 14:06:26.748758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.748761    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d68db7d-8z6gz"
Sep 16 14:06:26.749183 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.748807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d68db7d-8z6gz" event={"ID":"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c","Type":"ContainerDied","Data":"9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a"}
Sep 16 14:06:26.749183 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.748855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d68db7d-8z6gz" event={"ID":"e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c","Type":"ContainerDied","Data":"0516c8d3459af8fb1fa8e7b56e039b7c7c94cee96cc90a2c048eaabd474e8a52"}
Sep 16 14:06:26.749183 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.748877    2579 scope.go:117] "RemoveContainer" containerID="9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a"
Sep 16 14:06:26.757626 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.757606    2579 scope.go:117] "RemoveContainer" containerID="9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a"
Sep 16 14:06:26.757878 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:06:26.757860    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a\": container with ID starting with 9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a not found: ID does not exist" containerID="9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a"
Sep 16 14:06:26.757931 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.757888    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a"} err="failed to get container status \"9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a\": rpc error: code = NotFound desc = could not find container \"9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a\": container with ID starting with 9b0266e4d98d28c04c8f2e9503f0e83d1518cf844a8e40d74c5c3d2dae671a4a not found: ID does not exist"
Sep 16 14:06:26.770713 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.770690    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d5d68db7d-8z6gz"]
Sep 16 14:06:26.774392 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:26.774374    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d5d68db7d-8z6gz"]
Sep 16 14:06:27.115664 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:27.115591    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" path="/var/lib/kubelet/pods/e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c/volumes"
Sep 16 14:06:27.755253 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:27.755221    2579 generic.go:356] "Generic (PLEG): container finished" podID="704c0090-1f46-4c6d-b6c7-31494b95a5ad" containerID="dd437692102a7a63284c5a68fc8e374379c08987c9a78e563507aeff1c408b10" exitCode=0
Sep 16 14:06:27.755737 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:27.755265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-7ww76" event={"ID":"704c0090-1f46-4c6d-b6c7-31494b95a5ad","Type":"ContainerDied","Data":"dd437692102a7a63284c5a68fc8e374379c08987c9a78e563507aeff1c408b10"}
Sep 16 14:06:27.755737 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:27.755692    2579 scope.go:117] "RemoveContainer" containerID="dd437692102a7a63284c5a68fc8e374379c08987c9a78e563507aeff1c408b10"
Sep 16 14:06:28.431005 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:28.430973    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cbdcfd966-ktx58_7639350f-d2a2-43d4-81aa-a63a808f8c90/router/0.log"
Sep 16 14:06:28.450808 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:28.450787    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z95r6_5124a2ad-56f1-4d19-b895-80cfdeb431a7/serve-healthcheck-canary/0.log"
Sep 16 14:06:28.761451 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:28.761368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-7ww76" event={"ID":"704c0090-1f46-4c6d-b6c7-31494b95a5ad","Type":"ContainerStarted","Data":"203326c188a64b45f4ff26e0b996fe8b238f738b53fe732a46d2507adeb4f2fd"}
Sep 16 14:06:32.776770 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:32.776734    2579 generic.go:356] "Generic (PLEG): container finished" podID="c949c60b-538f-40fa-a202-e9b670dc5566" containerID="b68de28df95a8d864cd0113c64f62e90adbb6538213d897008b868ec91f5e31e" exitCode=0
Sep 16 14:06:32.776770 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:32.776775    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf" event={"ID":"c949c60b-538f-40fa-a202-e9b670dc5566","Type":"ContainerDied","Data":"b68de28df95a8d864cd0113c64f62e90adbb6538213d897008b868ec91f5e31e"}
Sep 16 14:06:32.777170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:32.777062    2579 scope.go:117] "RemoveContainer" containerID="b68de28df95a8d864cd0113c64f62e90adbb6538213d897008b868ec91f5e31e"
Sep 16 14:06:33.781735 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:33.781698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6lngf" event={"ID":"c949c60b-538f-40fa-a202-e9b670dc5566","Type":"ContainerStarted","Data":"5cbf9fad8a18f149c2852014cdf4b03e865f4c3d8548994c02d25cf8f32ccd68"}
Sep 16 14:06:42.819159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:42.819125    2579 generic.go:356] "Generic (PLEG): container finished" podID="e97758bb-120e-4e06-bd96-060759afdb8d" containerID="117a0d3a73a16bed27c65d09217caae5a4f3b269cf8503a41f9a8f5f754ba148" exitCode=0
Sep 16 14:06:42.819512 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:42.819204    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5" event={"ID":"e97758bb-120e-4e06-bd96-060759afdb8d","Type":"ContainerDied","Data":"117a0d3a73a16bed27c65d09217caae5a4f3b269cf8503a41f9a8f5f754ba148"}
Sep 16 14:06:42.819576 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:42.819515    2579 scope.go:117] "RemoveContainer" containerID="117a0d3a73a16bed27c65d09217caae5a4f3b269cf8503a41f9a8f5f754ba148"
Sep 16 14:06:43.824407 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:06:43.824376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-z8ns5" event={"ID":"e97758bb-120e-4e06-bd96-060759afdb8d","Type":"ContainerStarted","Data":"7dd33865417e1e71fd99966e3ad9a94ea8bf47b1d63b9de1de54748aff9ec7c0"}
Sep 16 14:07:16.242931 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.242853    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77ffbf7686-pf4r5"]
Sep 16 14:07:16.243419 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.243286    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" containerName="console"
Sep 16 14:07:16.243419 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.243301    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" containerName="console"
Sep 16 14:07:16.243419 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.243311    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d33c58-5154-4811-a6a2-8ac3ea00ebee" containerName="registry"
Sep 16 14:07:16.243419 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.243316    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d33c58-5154-4811-a6a2-8ac3ea00ebee" containerName="registry"
Sep 16 14:07:16.243419 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.243393    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="85d33c58-5154-4811-a6a2-8ac3ea00ebee" containerName="registry"
Sep 16 14:07:16.243419 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.243402    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e75f89a7-ed51-4ef1-aa4e-8a8e38c2503c" containerName="console"
Sep 16 14:07:16.246578 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.246536    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.272521 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.272487    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77ffbf7686-pf4r5"]
Sep 16 14:07:16.371712 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.371679    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-service-ca\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.371712 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.371712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-oauth-config\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.371905 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.371733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-trusted-ca-bundle\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.371905 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.371821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-serving-cert\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.371905 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.371857    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm9fl\" (UniqueName: \"kubernetes.io/projected/b6138ff9-03b0-47fa-9424-66c0394f99fc-kube-api-access-pm9fl\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.371905 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.371883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-oauth-serving-cert\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.372025 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.371927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-config\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.473159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.473127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-config\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.473301 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.473167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-service-ca\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.473301 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.473189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-oauth-config\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.473301 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.473214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-trusted-ca-bundle\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.473301 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.473266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-serving-cert\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.473487 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.473306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm9fl\" (UniqueName: \"kubernetes.io/projected/b6138ff9-03b0-47fa-9424-66c0394f99fc-kube-api-access-pm9fl\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.473487 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.473346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-oauth-serving-cert\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.474017 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.473986    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-service-ca\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.474017 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.474007    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-oauth-serving-cert\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.474208 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.473989    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-config\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.474284 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.474256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-trusted-ca-bundle\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.475719 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.475688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-oauth-config\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.475855 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.475833    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-serving-cert\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.481991 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.481972    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm9fl\" (UniqueName: \"kubernetes.io/projected/b6138ff9-03b0-47fa-9424-66c0394f99fc-kube-api-access-pm9fl\") pod \"console-77ffbf7686-pf4r5\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") " pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.558975 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.558917    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:16.830632 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.830601    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77ffbf7686-pf4r5"]
Sep 16 14:07:16.832946 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:07:16.832918    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6138ff9_03b0_47fa_9424_66c0394f99fc.slice/crio-8770442f5db6b16254a5de1d8d09971fa448dc06522e399330e55e74df784b5f WatchSource:0}: Error finding container 8770442f5db6b16254a5de1d8d09971fa448dc06522e399330e55e74df784b5f: Status 404 returned error can't find the container with id 8770442f5db6b16254a5de1d8d09971fa448dc06522e399330e55e74df784b5f
Sep 16 14:07:16.944571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.944521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77ffbf7686-pf4r5" event={"ID":"b6138ff9-03b0-47fa-9424-66c0394f99fc","Type":"ContainerStarted","Data":"c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337"}
Sep 16 14:07:16.944732 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.944590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77ffbf7686-pf4r5" event={"ID":"b6138ff9-03b0-47fa-9424-66c0394f99fc","Type":"ContainerStarted","Data":"8770442f5db6b16254a5de1d8d09971fa448dc06522e399330e55e74df784b5f"}
Sep 16 14:07:16.964334 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:16.964253    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77ffbf7686-pf4r5" podStartSLOduration=0.964233103 podStartE2EDuration="964.233103ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:07:16.963732839 +0000 UTC m=+176.263143107" watchObservedRunningTime="2026-09-16 14:07:16.964233103 +0000 UTC m=+176.263643372"
Sep 16 14:07:26.559435 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:26.559405    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:26.559839 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:26.559479    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:26.564039 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:26.564018    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:26.985109 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:26.985081    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:07:27.037298 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:27.037259    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8675c9cb4d-ctnkg"]
Sep 16 14:07:52.059175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.059133    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8675c9cb4d-ctnkg" podUID="a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" containerName="console" containerID="cri-o://c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643" gracePeriod=15
Sep 16 14:07:52.302197 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.302174    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:07:52.340961 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.340902    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-serving-cert\") pod \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") "
Sep 16 14:07:52.341072 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.340962    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-trusted-ca-bundle\") pod \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") "
Sep 16 14:07:52.341072 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.340987    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cjtl\" (UniqueName: \"kubernetes.io/projected/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-kube-api-access-2cjtl\") pod \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") "
Sep 16 14:07:52.341072 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.341005    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-oauth-serving-cert\") pod \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") "
Sep 16 14:07:52.341072 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.341027    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-service-ca\") pod \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") "
Sep 16 14:07:52.341072 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.341045    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-oauth-config\") pod \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") "
Sep 16 14:07:52.341327 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.341098    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-config\") pod \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\" (UID: \"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753\") "
Sep 16 14:07:52.341564 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.341524    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" (UID: "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:07:52.341676 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.341566    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-config" (OuterVolumeSpecName: "console-config") pod "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" (UID: "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:07:52.341676 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.341520    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-service-ca" (OuterVolumeSpecName: "service-ca") pod "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" (UID: "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:07:52.341676 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.341533    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" (UID: "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:07:52.343098 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.343072    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" (UID: "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:07:52.343197 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.343089    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" (UID: "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:07:52.343197 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.343173    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-kube-api-access-2cjtl" (OuterVolumeSpecName: "kube-api-access-2cjtl") pod "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" (UID: "a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753"). InnerVolumeSpecName "kube-api-access-2cjtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:07:52.441721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.441695    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-oauth-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:07:52.441851 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.441720    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:07:52.441851 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.441760    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-console-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:07:52.441851 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.441773    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-trusted-ca-bundle\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:07:52.441851 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.441788    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cjtl\" (UniqueName: \"kubernetes.io/projected/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-kube-api-access-2cjtl\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:07:52.441851 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.441800    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-oauth-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:07:52.441851 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:52.441812    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:07:53.080523 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:53.080486    2579 generic.go:356] "Generic (PLEG): container finished" podID="a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" containerID="c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643" exitCode=0
Sep 16 14:07:53.080523 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:53.080526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675c9cb4d-ctnkg" event={"ID":"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753","Type":"ContainerDied","Data":"c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643"}
Sep 16 14:07:53.081064 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:53.080541    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675c9cb4d-ctnkg"
Sep 16 14:07:53.081064 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:53.080603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675c9cb4d-ctnkg" event={"ID":"a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753","Type":"ContainerDied","Data":"6772b3201838860fe50a896dba74429275120ecff88d9a36b5b2c54919149896"}
Sep 16 14:07:53.081064 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:53.080626    2579 scope.go:117] "RemoveContainer" containerID="c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643"
Sep 16 14:07:53.088983 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:53.088965    2579 scope.go:117] "RemoveContainer" containerID="c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643"
Sep 16 14:07:53.089234 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:07:53.089214    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643\": container with ID starting with c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643 not found: ID does not exist" containerID="c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643"
Sep 16 14:07:53.089289 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:53.089241    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643"} err="failed to get container status \"c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643\": rpc error: code = NotFound desc = could not find container \"c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643\": container with ID starting with c7c339c624b061bb40003804b8fd9bb8099bb44e899e32c7173a3102235f2643 not found: ID does not exist"
Sep 16 14:07:53.101561 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:53.101527    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8675c9cb4d-ctnkg"]
Sep 16 14:07:53.105294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:53.105273    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8675c9cb4d-ctnkg"]
Sep 16 14:07:53.115330 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:07:53.115308    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" path="/var/lib/kubelet/pods/a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753/volumes"
Sep 16 14:08:29.594818 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.594784    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76fcc7675f-vw7zh"]
Sep 16 14:08:29.595267 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.595062    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" containerName="console"
Sep 16 14:08:29.595267 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.595074    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" containerName="console"
Sep 16 14:08:29.595267 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.595143    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8f68fbe-ede5-40b7-b0c3-d9e2aea2f753" containerName="console"
Sep 16 14:08:29.599225 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.599192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.615273 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.615250    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76fcc7675f-vw7zh"]
Sep 16 14:08:29.724197 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.724164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-console-config\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.724371 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.724199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqlr9\" (UniqueName: \"kubernetes.io/projected/f669f276-e34b-4527-864a-b648b7cb08cc-kube-api-access-xqlr9\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.724371 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.724273    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-trusted-ca-bundle\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.724371 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.724338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-oauth-config\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.724371 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.724362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-serving-cert\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.724592 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.724424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-service-ca\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.724592 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.724470    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-oauth-serving-cert\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.825462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.825432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-service-ca\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.825462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.825463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-oauth-serving-cert\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.825697 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.825485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-console-config\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.825697 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.825501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqlr9\" (UniqueName: \"kubernetes.io/projected/f669f276-e34b-4527-864a-b648b7cb08cc-kube-api-access-xqlr9\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.825697 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.825532    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-trusted-ca-bundle\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.825697 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.825614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-oauth-config\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.825697 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.825640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-serving-cert\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.826250 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.826224    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-oauth-serving-cert\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.826366 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.826313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-service-ca\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.826366 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.826336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-console-config\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.826481 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.826462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-trusted-ca-bundle\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.827966 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.827944    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-oauth-config\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.828054 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.828044    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-serving-cert\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.834517 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.834499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqlr9\" (UniqueName: \"kubernetes.io/projected/f669f276-e34b-4527-864a-b648b7cb08cc-kube-api-access-xqlr9\") pod \"console-76fcc7675f-vw7zh\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") " pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:29.909144 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:29.909119    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:30.182322 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:30.182159    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76fcc7675f-vw7zh"]
Sep 16 14:08:30.185283 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:08:30.185254    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf669f276_e34b_4527_864a_b648b7cb08cc.slice/crio-a5bf82f777e00303a3de65961de113ddb37e2006856838feb7a53090828f22f3 WatchSource:0}: Error finding container a5bf82f777e00303a3de65961de113ddb37e2006856838feb7a53090828f22f3: Status 404 returned error can't find the container with id a5bf82f777e00303a3de65961de113ddb37e2006856838feb7a53090828f22f3
Sep 16 14:08:30.213021 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:30.212997    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76fcc7675f-vw7zh" event={"ID":"f669f276-e34b-4527-864a-b648b7cb08cc","Type":"ContainerStarted","Data":"a5bf82f777e00303a3de65961de113ddb37e2006856838feb7a53090828f22f3"}
Sep 16 14:08:31.218399 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:31.218366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76fcc7675f-vw7zh" event={"ID":"f669f276-e34b-4527-864a-b648b7cb08cc","Type":"ContainerStarted","Data":"99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f"}
Sep 16 14:08:31.241743 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:31.241696    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76fcc7675f-vw7zh" podStartSLOduration=2.241679045 podStartE2EDuration="2.241679045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:08:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:08:31.240902305 +0000 UTC m=+250.540312572" watchObservedRunningTime="2026-09-16 14:08:31.241679045 +0000 UTC m=+250.541089312"
Sep 16 14:08:39.909351 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:39.909313    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:39.909745 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:39.909371    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:39.914389 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:39.914368    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:40.259329 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:40.259233    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:08:40.321590 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:08:40.321523    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77ffbf7686-pf4r5"]
Sep 16 14:09:05.341123 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.341062    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77ffbf7686-pf4r5" podUID="b6138ff9-03b0-47fa-9424-66c0394f99fc" containerName="console" containerID="cri-o://c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337" gracePeriod=15
Sep 16 14:09:05.584381 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.584358    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:09:05.616286 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.616224    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-trusted-ca-bundle\") pod \"b6138ff9-03b0-47fa-9424-66c0394f99fc\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") "
Sep 16 14:09:05.616286 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.616268    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-serving-cert\") pod \"b6138ff9-03b0-47fa-9424-66c0394f99fc\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") "
Sep 16 14:09:05.616462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.616333    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-oauth-config\") pod \"b6138ff9-03b0-47fa-9424-66c0394f99fc\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") "
Sep 16 14:09:05.616462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.616358    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-oauth-serving-cert\") pod \"b6138ff9-03b0-47fa-9424-66c0394f99fc\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") "
Sep 16 14:09:05.616462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.616389    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-config\") pod \"b6138ff9-03b0-47fa-9424-66c0394f99fc\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") "
Sep 16 14:09:05.616462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.616417    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-service-ca\") pod \"b6138ff9-03b0-47fa-9424-66c0394f99fc\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") "
Sep 16 14:09:05.616462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.616441    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm9fl\" (UniqueName: \"kubernetes.io/projected/b6138ff9-03b0-47fa-9424-66c0394f99fc-kube-api-access-pm9fl\") pod \"b6138ff9-03b0-47fa-9424-66c0394f99fc\" (UID: \"b6138ff9-03b0-47fa-9424-66c0394f99fc\") "
Sep 16 14:09:05.616786 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.616745    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b6138ff9-03b0-47fa-9424-66c0394f99fc" (UID: "b6138ff9-03b0-47fa-9424-66c0394f99fc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:09:05.616905 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.616836    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-service-ca" (OuterVolumeSpecName: "service-ca") pod "b6138ff9-03b0-47fa-9424-66c0394f99fc" (UID: "b6138ff9-03b0-47fa-9424-66c0394f99fc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:09:05.616905 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.616851    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-config" (OuterVolumeSpecName: "console-config") pod "b6138ff9-03b0-47fa-9424-66c0394f99fc" (UID: "b6138ff9-03b0-47fa-9424-66c0394f99fc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:09:05.617118 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.617091    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b6138ff9-03b0-47fa-9424-66c0394f99fc" (UID: "b6138ff9-03b0-47fa-9424-66c0394f99fc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:09:05.618675 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.618655    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6138ff9-03b0-47fa-9424-66c0394f99fc-kube-api-access-pm9fl" (OuterVolumeSpecName: "kube-api-access-pm9fl") pod "b6138ff9-03b0-47fa-9424-66c0394f99fc" (UID: "b6138ff9-03b0-47fa-9424-66c0394f99fc"). InnerVolumeSpecName "kube-api-access-pm9fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:09:05.618932 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.618916    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b6138ff9-03b0-47fa-9424-66c0394f99fc" (UID: "b6138ff9-03b0-47fa-9424-66c0394f99fc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:09:05.618981 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.618944    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b6138ff9-03b0-47fa-9424-66c0394f99fc" (UID: "b6138ff9-03b0-47fa-9424-66c0394f99fc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:09:05.718024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.717995    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-trusted-ca-bundle\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:09:05.718024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.718024    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:09:05.718193 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.718038    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-oauth-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:09:05.718193 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.718051    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-oauth-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:09:05.718193 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.718062    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-console-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:09:05.718193 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.718075    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6138ff9-03b0-47fa-9424-66c0394f99fc-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:09:05.718193 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:05.718087    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm9fl\" (UniqueName: \"kubernetes.io/projected/b6138ff9-03b0-47fa-9424-66c0394f99fc-kube-api-access-pm9fl\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:09:06.352008 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:06.351973    2579 generic.go:356] "Generic (PLEG): container finished" podID="b6138ff9-03b0-47fa-9424-66c0394f99fc" containerID="c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337" exitCode=0
Sep 16 14:09:06.352365 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:06.352018    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77ffbf7686-pf4r5"
Sep 16 14:09:06.352365 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:06.352054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77ffbf7686-pf4r5" event={"ID":"b6138ff9-03b0-47fa-9424-66c0394f99fc","Type":"ContainerDied","Data":"c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337"}
Sep 16 14:09:06.352365 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:06.352102    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77ffbf7686-pf4r5" event={"ID":"b6138ff9-03b0-47fa-9424-66c0394f99fc","Type":"ContainerDied","Data":"8770442f5db6b16254a5de1d8d09971fa448dc06522e399330e55e74df784b5f"}
Sep 16 14:09:06.352365 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:06.352122    2579 scope.go:117] "RemoveContainer" containerID="c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337"
Sep 16 14:09:06.361130 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:06.361111    2579 scope.go:117] "RemoveContainer" containerID="c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337"
Sep 16 14:09:06.361404 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:09:06.361387    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337\": container with ID starting with c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337 not found: ID does not exist" containerID="c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337"
Sep 16 14:09:06.361489 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:06.361412    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337"} err="failed to get container status \"c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337\": rpc error: code = NotFound desc = could not find container \"c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337\": container with ID starting with c562b59f84d4c048eabb35f5898c31dea11cc0ed8758e2123fb4794e052d2337 not found: ID does not exist"
Sep 16 14:09:06.376936 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:06.376910    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77ffbf7686-pf4r5"]
Sep 16 14:09:06.380899 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:06.380878    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77ffbf7686-pf4r5"]
Sep 16 14:09:07.115801 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:07.115767    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6138ff9-03b0-47fa-9424-66c0394f99fc" path="/var/lib/kubelet/pods/b6138ff9-03b0-47fa-9424-66c0394f99fc/volumes"
Sep 16 14:09:17.218993 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.218957    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"]
Sep 16 14:09:17.219425 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.219236    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6138ff9-03b0-47fa-9424-66c0394f99fc" containerName="console"
Sep 16 14:09:17.219425 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.219246    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6138ff9-03b0-47fa-9424-66c0394f99fc" containerName="console"
Sep 16 14:09:17.219425 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.219302    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6138ff9-03b0-47fa-9424-66c0394f99fc" containerName="console"
Sep 16 14:09:17.222178 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.222159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:17.226013 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.225986    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:09:17.226601 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.226575    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:09:17.226879 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.226859    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gdgch\""
Sep 16 14:09:17.242640 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.242612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"]
Sep 16 14:09:17.298189 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.298160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:17.298337 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.298223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:17.298337 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.298267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xwnx\" (UniqueName: \"kubernetes.io/projected/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-kube-api-access-9xwnx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:17.398767 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.398729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:17.398917 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.398797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:17.398917 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.398839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xwnx\" (UniqueName: \"kubernetes.io/projected/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-kube-api-access-9xwnx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:17.399092 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.399075    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:17.399138 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.399106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:17.407860 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.407839    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xwnx\" (UniqueName: \"kubernetes.io/projected/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-kube-api-access-9xwnx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:17.533501 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.533446    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:17.807091 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:17.807020    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"]
Sep 16 14:09:17.810964 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:09:17.810937    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402918e6_c9d7_43d1_a3e8_1d9c76d3cc92.slice/crio-59c26e3c25f771c39e7463de4141ffd3117641702749a31b7b9c8b780477213b WatchSource:0}: Error finding container 59c26e3c25f771c39e7463de4141ffd3117641702749a31b7b9c8b780477213b: Status 404 returned error can't find the container with id 59c26e3c25f771c39e7463de4141ffd3117641702749a31b7b9c8b780477213b
Sep 16 14:09:18.400125 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:18.400089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4" event={"ID":"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92","Type":"ContainerStarted","Data":"59c26e3c25f771c39e7463de4141ffd3117641702749a31b7b9c8b780477213b"}
Sep 16 14:09:21.027134 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:21.027107    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:09:21.030052 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:21.030031    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:09:21.036044 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:21.036026    2579 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 14:09:27.438437 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:27.438401    2579 generic.go:356] "Generic (PLEG): container finished" podID="402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" containerID="d274d45d97ae342709713e7a611e27c9b7fb41bd56e3aabd235580952282e8bb" exitCode=0
Sep 16 14:09:27.438896 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:27.438448    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4" event={"ID":"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92","Type":"ContainerDied","Data":"d274d45d97ae342709713e7a611e27c9b7fb41bd56e3aabd235580952282e8bb"}
Sep 16 14:09:27.439482 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:27.439466    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:09:30.452203 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:30.452167    2579 generic.go:356] "Generic (PLEG): container finished" podID="402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" containerID="c7900a427d04163fd5b229f14931dc3f0632bdeaca3ec10de92b050abe744a52" exitCode=0
Sep 16 14:09:30.452599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:30.452212    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4" event={"ID":"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92","Type":"ContainerDied","Data":"c7900a427d04163fd5b229f14931dc3f0632bdeaca3ec10de92b050abe744a52"}
Sep 16 14:09:36.479761 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:36.479672    2579 generic.go:356] "Generic (PLEG): container finished" podID="402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" containerID="096e4b1982dd09fc196ea40346af6a7bcd113765e8fa3d5b123d102c64b20a4d" exitCode=0
Sep 16 14:09:36.479761 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:36.479725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4" event={"ID":"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92","Type":"ContainerDied","Data":"096e4b1982dd09fc196ea40346af6a7bcd113765e8fa3d5b123d102c64b20a4d"}
Sep 16 14:09:37.605623 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:37.605601    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:37.766446 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:37.766367    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-util\") pod \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") "
Sep 16 14:09:37.766446 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:37.766400    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xwnx\" (UniqueName: \"kubernetes.io/projected/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-kube-api-access-9xwnx\") pod \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") "
Sep 16 14:09:37.766446 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:37.766427    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-bundle\") pod \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\" (UID: \"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92\") "
Sep 16 14:09:37.767088 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:37.767061    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-bundle" (OuterVolumeSpecName: "bundle") pod "402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" (UID: "402918e6-c9d7-43d1-a3e8-1d9c76d3cc92"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:09:37.768584 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:37.768559    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-kube-api-access-9xwnx" (OuterVolumeSpecName: "kube-api-access-9xwnx") pod "402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" (UID: "402918e6-c9d7-43d1-a3e8-1d9c76d3cc92"). InnerVolumeSpecName "kube-api-access-9xwnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:09:37.770578 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:37.770543    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-util" (OuterVolumeSpecName: "util") pod "402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" (UID: "402918e6-c9d7-43d1-a3e8-1d9c76d3cc92"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:09:37.867054 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:37.867028    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-util\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:09:37.867054 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:37.867051    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xwnx\" (UniqueName: \"kubernetes.io/projected/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-kube-api-access-9xwnx\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:09:37.867177 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:37.867060    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402918e6-c9d7-43d1-a3e8-1d9c76d3cc92-bundle\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:09:38.488783 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:38.488743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4" event={"ID":"402918e6-c9d7-43d1-a3e8-1d9c76d3cc92","Type":"ContainerDied","Data":"59c26e3c25f771c39e7463de4141ffd3117641702749a31b7b9c8b780477213b"}
Sep 16 14:09:38.488783 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:38.488768    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5ll4"
Sep 16 14:09:38.488783 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:38.488787    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59c26e3c25f771c39e7463de4141ffd3117641702749a31b7b9c8b780477213b"
Sep 16 14:09:45.506676 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.506641    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx"]
Sep 16 14:09:45.507047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.506926    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" containerName="util"
Sep 16 14:09:45.507047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.506937    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" containerName="util"
Sep 16 14:09:45.507047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.506951    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" containerName="extract"
Sep 16 14:09:45.507047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.506957    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" containerName="extract"
Sep 16 14:09:45.507047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.506963    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" containerName="pull"
Sep 16 14:09:45.507047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.506969    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" containerName="pull"
Sep 16 14:09:45.507047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.507019    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="402918e6-c9d7-43d1-a3e8-1d9c76d3cc92" containerName="extract"
Sep 16 14:09:45.519694 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.519670    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx"
Sep 16 14:09:45.525294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.525261    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 16 14:09:45.525432 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.525296    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pgsvl\""
Sep 16 14:09:45.525432 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.525348    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:09:45.538646 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.538625    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx"]
Sep 16 14:09:45.626024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.625996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c84f052-377e-40f1-9181-95d98999e809-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2r2fx\" (UID: \"9c84f052-377e-40f1-9181-95d98999e809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx"
Sep 16 14:09:45.626157 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.626040    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgzsx\" (UniqueName: \"kubernetes.io/projected/9c84f052-377e-40f1-9181-95d98999e809-kube-api-access-kgzsx\") pod \"cert-manager-operator-controller-manager-55c444bf86-2r2fx\" (UID: \"9c84f052-377e-40f1-9181-95d98999e809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx"
Sep 16 14:09:45.726846 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.726819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c84f052-377e-40f1-9181-95d98999e809-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2r2fx\" (UID: \"9c84f052-377e-40f1-9181-95d98999e809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx"
Sep 16 14:09:45.726955 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.726862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgzsx\" (UniqueName: \"kubernetes.io/projected/9c84f052-377e-40f1-9181-95d98999e809-kube-api-access-kgzsx\") pod \"cert-manager-operator-controller-manager-55c444bf86-2r2fx\" (UID: \"9c84f052-377e-40f1-9181-95d98999e809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx"
Sep 16 14:09:45.727183 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.727165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c84f052-377e-40f1-9181-95d98999e809-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2r2fx\" (UID: \"9c84f052-377e-40f1-9181-95d98999e809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx"
Sep 16 14:09:45.738099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.738078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgzsx\" (UniqueName: \"kubernetes.io/projected/9c84f052-377e-40f1-9181-95d98999e809-kube-api-access-kgzsx\") pod \"cert-manager-operator-controller-manager-55c444bf86-2r2fx\" (UID: \"9c84f052-377e-40f1-9181-95d98999e809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx"
Sep 16 14:09:45.833036 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:45.832964    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx"
Sep 16 14:09:46.142075 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:46.141984    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx"]
Sep 16 14:09:46.148519 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:09:46.148493    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c84f052_377e_40f1_9181_95d98999e809.slice/crio-a9ce66491daff940b68ddd3db7bb8d20b6abcca13aac06075708dd7586426c62 WatchSource:0}: Error finding container a9ce66491daff940b68ddd3db7bb8d20b6abcca13aac06075708dd7586426c62: Status 404 returned error can't find the container with id a9ce66491daff940b68ddd3db7bb8d20b6abcca13aac06075708dd7586426c62
Sep 16 14:09:46.518851 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:46.518815    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx" event={"ID":"9c84f052-377e-40f1-9181-95d98999e809","Type":"ContainerStarted","Data":"a9ce66491daff940b68ddd3db7bb8d20b6abcca13aac06075708dd7586426c62"}
Sep 16 14:09:49.534481 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:49.534395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx" event={"ID":"9c84f052-377e-40f1-9181-95d98999e809","Type":"ContainerStarted","Data":"f44381b02bdd29fa1322de9fe8c9921daf3c006ad927ba50fcdcd1d1776c9eea"}
Sep 16 14:09:49.559785 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:49.559738    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2r2fx" podStartSLOduration=1.5401452359999999 podStartE2EDuration="4.559723159s" totalImagesPullingTime="3.019577923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:09:49.558418422 +0000 UTC m=+328.857828701" watchObservedRunningTime="2026-09-16 14:09:49.559723159 +0000 UTC m=+328.859133426"
Sep 16 14:09:53.858691 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:53.858655    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z"]
Sep 16 14:09:53.860989 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:53.860972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z"
Sep 16 14:09:53.864042 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:53.864018    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 14:09:53.865239 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:53.865220    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 14:09:53.865321 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:53.865220    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-d7974\""
Sep 16 14:09:53.881928 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:53.881906    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z"]
Sep 16 14:09:53.991128 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:53.991099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd66aaa8-bd74-47a6-8edc-3857adcdea2a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wwg8z\" (UID: \"bd66aaa8-bd74-47a6-8edc-3857adcdea2a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z"
Sep 16 14:09:53.991262 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:53.991155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l22nc\" (UniqueName: \"kubernetes.io/projected/bd66aaa8-bd74-47a6-8edc-3857adcdea2a-kube-api-access-l22nc\") pod \"cert-manager-cainjector-559cdd8c87-wwg8z\" (UID: \"bd66aaa8-bd74-47a6-8edc-3857adcdea2a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z"
Sep 16 14:09:54.092554 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:54.092520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd66aaa8-bd74-47a6-8edc-3857adcdea2a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wwg8z\" (UID: \"bd66aaa8-bd74-47a6-8edc-3857adcdea2a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z"
Sep 16 14:09:54.092649 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:54.092601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22nc\" (UniqueName: \"kubernetes.io/projected/bd66aaa8-bd74-47a6-8edc-3857adcdea2a-kube-api-access-l22nc\") pod \"cert-manager-cainjector-559cdd8c87-wwg8z\" (UID: \"bd66aaa8-bd74-47a6-8edc-3857adcdea2a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z"
Sep 16 14:09:54.106779 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:54.106756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l22nc\" (UniqueName: \"kubernetes.io/projected/bd66aaa8-bd74-47a6-8edc-3857adcdea2a-kube-api-access-l22nc\") pod \"cert-manager-cainjector-559cdd8c87-wwg8z\" (UID: \"bd66aaa8-bd74-47a6-8edc-3857adcdea2a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z"
Sep 16 14:09:54.108275 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:54.108249    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd66aaa8-bd74-47a6-8edc-3857adcdea2a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wwg8z\" (UID: \"bd66aaa8-bd74-47a6-8edc-3857adcdea2a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z"
Sep 16 14:09:54.179086 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:54.179063    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z"
Sep 16 14:09:54.454218 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:54.454188    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z"]
Sep 16 14:09:54.454681 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:09:54.454660    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd66aaa8_bd74_47a6_8edc_3857adcdea2a.slice/crio-7b6e854ee37493fa77a56dab7677f382129129d346dca4940076e78d1e9e8b71 WatchSource:0}: Error finding container 7b6e854ee37493fa77a56dab7677f382129129d346dca4940076e78d1e9e8b71: Status 404 returned error can't find the container with id 7b6e854ee37493fa77a56dab7677f382129129d346dca4940076e78d1e9e8b71
Sep 16 14:09:54.558006 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:54.557974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z" event={"ID":"bd66aaa8-bd74-47a6-8edc-3857adcdea2a","Type":"ContainerStarted","Data":"7b6e854ee37493fa77a56dab7677f382129129d346dca4940076e78d1e9e8b71"}
Sep 16 14:09:57.573783 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:57.573744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z" event={"ID":"bd66aaa8-bd74-47a6-8edc-3857adcdea2a","Type":"ContainerStarted","Data":"3528085fac5fcde12d225746cebb3b59f9537bf7762eb316b8ec98bbbf1c6f34"}
Sep 16 14:09:57.595071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:57.595018    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwg8z" podStartSLOduration=1.9578600590000002 podStartE2EDuration="4.595000769s" totalImagesPullingTime="2.63714071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:09:57.594390989 +0000 UTC m=+336.893801257" watchObservedRunningTime="2026-09-16 14:09:57.595000769 +0000 UTC m=+336.894411036"
Sep 16 14:09:58.319514 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.319480    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tjchc"]
Sep 16 14:09:58.321632 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.321613    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc"
Sep 16 14:09:58.324162 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.324142    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rwbhv\""
Sep 16 14:09:58.331148 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.331125    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tjchc"]
Sep 16 14:09:58.429021 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.428987    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfvvg\" (UniqueName: \"kubernetes.io/projected/16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d-kube-api-access-pfvvg\") pod \"cert-manager-webhook-6486ffd997-tjchc\" (UID: \"16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc"
Sep 16 14:09:58.429182 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.429035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tjchc\" (UID: \"16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc"
Sep 16 14:09:58.529481 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.529448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfvvg\" (UniqueName: \"kubernetes.io/projected/16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d-kube-api-access-pfvvg\") pod \"cert-manager-webhook-6486ffd997-tjchc\" (UID: \"16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc"
Sep 16 14:09:58.529690 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.529493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tjchc\" (UID: \"16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc"
Sep 16 14:09:58.538517 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.538493    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tjchc\" (UID: \"16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc"
Sep 16 14:09:58.538838 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.538808    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfvvg\" (UniqueName: \"kubernetes.io/projected/16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d-kube-api-access-pfvvg\") pod \"cert-manager-webhook-6486ffd997-tjchc\" (UID: \"16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc"
Sep 16 14:09:58.630428 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.630356    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc"
Sep 16 14:09:58.900828 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:58.900762    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tjchc"]
Sep 16 14:09:58.907040 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:09:58.907015    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16f86dda_d3c1_4ddc_ae3e_6ffc6630f89d.slice/crio-4f01d16a11b9d7eb8605cf16deceb9bb57e424ec2c83c23c96761089f190a4c9 WatchSource:0}: Error finding container 4f01d16a11b9d7eb8605cf16deceb9bb57e424ec2c83c23c96761089f190a4c9: Status 404 returned error can't find the container with id 4f01d16a11b9d7eb8605cf16deceb9bb57e424ec2c83c23c96761089f190a4c9
Sep 16 14:09:59.583758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:59.583720    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc" event={"ID":"16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d","Type":"ContainerStarted","Data":"a0a236ae56647452f357e478220ce6efc3395cd21778cea12bc9da5ea2adc8a9"}
Sep 16 14:09:59.583979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:59.583768    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc" event={"ID":"16f86dda-d3c1-4ddc-ae3e-6ffc6630f89d","Type":"ContainerStarted","Data":"4f01d16a11b9d7eb8605cf16deceb9bb57e424ec2c83c23c96761089f190a4c9"}
Sep 16 14:09:59.583979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:59.583790    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc"
Sep 16 14:09:59.600030 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:09:59.599984    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc" podStartSLOduration=1.5999689030000002 podStartE2EDuration="1.599968903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:09:59.599004213 +0000 UTC m=+338.898414480" watchObservedRunningTime="2026-09-16 14:09:59.599968903 +0000 UTC m=+338.899379169"
Sep 16 14:10:05.590537 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:05.590504    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tjchc"
Sep 16 14:10:17.652452 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.652370    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7"]
Sep 16 14:10:17.654501 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.654477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7"
Sep 16 14:10:17.657159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.657130    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:10:17.658373 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.658355    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2kh9g\""
Sep 16 14:10:17.658481 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.658390    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 14:10:17.670910 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.670889    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7"]
Sep 16 14:10:17.682406 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.682383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bcd5acf-63ba-4136-bd96-ade397573c1a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q6jt7\" (UID: \"4bcd5acf-63ba-4136-bd96-ade397573c1a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7"
Sep 16 14:10:17.682526 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.682506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7c27\" (UniqueName: \"kubernetes.io/projected/4bcd5acf-63ba-4136-bd96-ade397573c1a-kube-api-access-k7c27\") pod \"openshift-lws-operator-fd8ccff4c-q6jt7\" (UID: \"4bcd5acf-63ba-4136-bd96-ade397573c1a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7"
Sep 16 14:10:17.783125 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.783096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7c27\" (UniqueName: \"kubernetes.io/projected/4bcd5acf-63ba-4136-bd96-ade397573c1a-kube-api-access-k7c27\") pod \"openshift-lws-operator-fd8ccff4c-q6jt7\" (UID: \"4bcd5acf-63ba-4136-bd96-ade397573c1a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7"
Sep 16 14:10:17.783288 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.783134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bcd5acf-63ba-4136-bd96-ade397573c1a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q6jt7\" (UID: \"4bcd5acf-63ba-4136-bd96-ade397573c1a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7"
Sep 16 14:10:17.783450 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.783433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bcd5acf-63ba-4136-bd96-ade397573c1a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q6jt7\" (UID: \"4bcd5acf-63ba-4136-bd96-ade397573c1a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7"
Sep 16 14:10:17.798881 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.798854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7c27\" (UniqueName: \"kubernetes.io/projected/4bcd5acf-63ba-4136-bd96-ade397573c1a-kube-api-access-k7c27\") pod \"openshift-lws-operator-fd8ccff4c-q6jt7\" (UID: \"4bcd5acf-63ba-4136-bd96-ade397573c1a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7"
Sep 16 14:10:17.964765 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:17.964691    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7"
Sep 16 14:10:18.236937 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:18.236862    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7"]
Sep 16 14:10:18.240145 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:10:18.240121    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bcd5acf_63ba_4136_bd96_ade397573c1a.slice/crio-76841174ad22fccd971e50089f8e4b449844ee3c47087b09a3e6fb80ceae8018 WatchSource:0}: Error finding container 76841174ad22fccd971e50089f8e4b449844ee3c47087b09a3e6fb80ceae8018: Status 404 returned error can't find the container with id 76841174ad22fccd971e50089f8e4b449844ee3c47087b09a3e6fb80ceae8018
Sep 16 14:10:18.666501 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:18.666460    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7" event={"ID":"4bcd5acf-63ba-4136-bd96-ade397573c1a","Type":"ContainerStarted","Data":"76841174ad22fccd971e50089f8e4b449844ee3c47087b09a3e6fb80ceae8018"}
Sep 16 14:10:21.681786 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:21.681753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7" event={"ID":"4bcd5acf-63ba-4136-bd96-ade397573c1a","Type":"ContainerStarted","Data":"dce9b901eb1a614450fdf5dcae08cec148779f8c5999397b7c62d64a90457cab"}
Sep 16 14:10:21.700725 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:21.700669    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6jt7" podStartSLOduration=2.251132476 podStartE2EDuration="4.700650891s" totalImagesPullingTime="2.449518415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:10:21.699351808 +0000 UTC m=+360.998762076" watchObservedRunningTime="2026-09-16 14:10:21.700650891 +0000 UTC m=+361.000061158"
Sep 16 14:10:23.996488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:23.996454    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"]
Sep 16 14:10:24.000247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.000227    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:24.003012 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.002981    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gdgch\""
Sep 16 14:10:24.003012 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.002986    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:10:24.003175 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.003019    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:10:24.009240 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.009217    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"]
Sep 16 14:10:24.136476 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.136447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:24.136653 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.136486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:24.136653 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.136577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-978nl\" (UniqueName: \"kubernetes.io/projected/0084d6b1-cab9-445b-a324-9eafef968345-kube-api-access-978nl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:24.237538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.237507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:24.237709 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.237581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978nl\" (UniqueName: \"kubernetes.io/projected/0084d6b1-cab9-445b-a324-9eafef968345-kube-api-access-978nl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:24.237709 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.237627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:24.237958 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.237943    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:24.237998 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.237943    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:24.245745 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.245722    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-978nl\" (UniqueName: \"kubernetes.io/projected/0084d6b1-cab9-445b-a324-9eafef968345-kube-api-access-978nl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:24.309875 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.309821    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:24.580950 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.580918    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"]
Sep 16 14:10:24.583370 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:10:24.583346    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0084d6b1_cab9_445b_a324_9eafef968345.slice/crio-c4f3d544e649389b75048bda520fe84e333f5a54b0bcfe19d7094e75808ca6da WatchSource:0}: Error finding container c4f3d544e649389b75048bda520fe84e333f5a54b0bcfe19d7094e75808ca6da: Status 404 returned error can't find the container with id c4f3d544e649389b75048bda520fe84e333f5a54b0bcfe19d7094e75808ca6da
Sep 16 14:10:24.696883 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.696852    2579 generic.go:356] "Generic (PLEG): container finished" podID="0084d6b1-cab9-445b-a324-9eafef968345" containerID="c59bb156a456960b682dd4b95d8812529cf17d5f401aa2630d0139ccba24ce89" exitCode=0
Sep 16 14:10:24.697005 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.696926    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7" event={"ID":"0084d6b1-cab9-445b-a324-9eafef968345","Type":"ContainerDied","Data":"c59bb156a456960b682dd4b95d8812529cf17d5f401aa2630d0139ccba24ce89"}
Sep 16 14:10:24.697005 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:24.696977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7" event={"ID":"0084d6b1-cab9-445b-a324-9eafef968345","Type":"ContainerStarted","Data":"c4f3d544e649389b75048bda520fe84e333f5a54b0bcfe19d7094e75808ca6da"}
Sep 16 14:10:26.709463 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:26.709431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7" event={"ID":"0084d6b1-cab9-445b-a324-9eafef968345","Type":"ContainerStarted","Data":"fe143e98a061ee6643529e79e107365255268ddd622de224984eb0200d516ba8"}
Sep 16 14:10:27.716277 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:27.716243    2579 generic.go:356] "Generic (PLEG): container finished" podID="0084d6b1-cab9-445b-a324-9eafef968345" containerID="fe143e98a061ee6643529e79e107365255268ddd622de224984eb0200d516ba8" exitCode=0
Sep 16 14:10:27.716678 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:27.716322    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7" event={"ID":"0084d6b1-cab9-445b-a324-9eafef968345","Type":"ContainerDied","Data":"fe143e98a061ee6643529e79e107365255268ddd622de224984eb0200d516ba8"}
Sep 16 14:10:28.723488 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:28.723453    2579 generic.go:356] "Generic (PLEG): container finished" podID="0084d6b1-cab9-445b-a324-9eafef968345" containerID="1ab1a069d27e50b4f533b924f610bed4bc65572815052a842ab9309163c4b1bd" exitCode=0
Sep 16 14:10:28.723897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:28.723541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7" event={"ID":"0084d6b1-cab9-445b-a324-9eafef968345","Type":"ContainerDied","Data":"1ab1a069d27e50b4f533b924f610bed4bc65572815052a842ab9309163c4b1bd"}
Sep 16 14:10:29.853028 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:29.853003    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:29.983734 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:29.983657    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-978nl\" (UniqueName: \"kubernetes.io/projected/0084d6b1-cab9-445b-a324-9eafef968345-kube-api-access-978nl\") pod \"0084d6b1-cab9-445b-a324-9eafef968345\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") "
Sep 16 14:10:29.983734 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:29.983707    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-util\") pod \"0084d6b1-cab9-445b-a324-9eafef968345\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") "
Sep 16 14:10:29.983734 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:29.983729    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-bundle\") pod \"0084d6b1-cab9-445b-a324-9eafef968345\" (UID: \"0084d6b1-cab9-445b-a324-9eafef968345\") "
Sep 16 14:10:29.984419 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:29.984391    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-bundle" (OuterVolumeSpecName: "bundle") pod "0084d6b1-cab9-445b-a324-9eafef968345" (UID: "0084d6b1-cab9-445b-a324-9eafef968345"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:10:29.985840 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:29.985817    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0084d6b1-cab9-445b-a324-9eafef968345-kube-api-access-978nl" (OuterVolumeSpecName: "kube-api-access-978nl") pod "0084d6b1-cab9-445b-a324-9eafef968345" (UID: "0084d6b1-cab9-445b-a324-9eafef968345"). InnerVolumeSpecName "kube-api-access-978nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:10:29.991737 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:29.991695    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-util" (OuterVolumeSpecName: "util") pod "0084d6b1-cab9-445b-a324-9eafef968345" (UID: "0084d6b1-cab9-445b-a324-9eafef968345"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:10:30.084502 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:30.084462    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-978nl\" (UniqueName: \"kubernetes.io/projected/0084d6b1-cab9-445b-a324-9eafef968345-kube-api-access-978nl\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:10:30.084502 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:30.084494    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-util\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:10:30.084502 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:30.084504    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0084d6b1-cab9-445b-a324-9eafef968345-bundle\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:10:30.734427 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:30.734396    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7"
Sep 16 14:10:30.734732 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:30.734428    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz5b7" event={"ID":"0084d6b1-cab9-445b-a324-9eafef968345","Type":"ContainerDied","Data":"c4f3d544e649389b75048bda520fe84e333f5a54b0bcfe19d7094e75808ca6da"}
Sep 16 14:10:30.734732 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:30.734474    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4f3d544e649389b75048bda520fe84e333f5a54b0bcfe19d7094e75808ca6da"
Sep 16 14:10:34.627942 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.627907    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"]
Sep 16 14:10:34.628395 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.628355    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0084d6b1-cab9-445b-a324-9eafef968345" containerName="extract"
Sep 16 14:10:34.628395 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.628374    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0084d6b1-cab9-445b-a324-9eafef968345" containerName="extract"
Sep 16 14:10:34.628395 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.628392    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0084d6b1-cab9-445b-a324-9eafef968345" containerName="util"
Sep 16 14:10:34.628576 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.628400    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0084d6b1-cab9-445b-a324-9eafef968345" containerName="util"
Sep 16 14:10:34.628576 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.628434    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0084d6b1-cab9-445b-a324-9eafef968345" containerName="pull"
Sep 16 14:10:34.628576 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.628444    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0084d6b1-cab9-445b-a324-9eafef968345" containerName="pull"
Sep 16 14:10:34.628576 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.628518    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0084d6b1-cab9-445b-a324-9eafef968345" containerName="extract"
Sep 16 14:10:34.631696 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.631675    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.647330 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.647309    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 16 14:10:34.647412 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.647367    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 16 14:10:34.658080 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.658060    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vbs78\""
Sep 16 14:10:34.659277 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.659257    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 16 14:10:34.660882 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.660863    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"]
Sep 16 14:10:34.724571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.724538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69be3329-2a70-4d8d-b5a8-77c1cae3535d-cert\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.724703 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.724640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txszs\" (UniqueName: \"kubernetes.io/projected/69be3329-2a70-4d8d-b5a8-77c1cae3535d-kube-api-access-txszs\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.724703 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.724670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69be3329-2a70-4d8d-b5a8-77c1cae3535d-manager-config\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.724703 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.724696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69be3329-2a70-4d8d-b5a8-77c1cae3535d-metrics-cert\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.825686 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.825654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txszs\" (UniqueName: \"kubernetes.io/projected/69be3329-2a70-4d8d-b5a8-77c1cae3535d-kube-api-access-txszs\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.825852 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.825700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69be3329-2a70-4d8d-b5a8-77c1cae3535d-manager-config\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.825852 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.825734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69be3329-2a70-4d8d-b5a8-77c1cae3535d-metrics-cert\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.825852 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.825786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69be3329-2a70-4d8d-b5a8-77c1cae3535d-cert\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.826469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.826447    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69be3329-2a70-4d8d-b5a8-77c1cae3535d-manager-config\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.828457 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.828430    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69be3329-2a70-4d8d-b5a8-77c1cae3535d-cert\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.828543 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.828453    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69be3329-2a70-4d8d-b5a8-77c1cae3535d-metrics-cert\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.842695 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.842670    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txszs\" (UniqueName: \"kubernetes.io/projected/69be3329-2a70-4d8d-b5a8-77c1cae3535d-kube-api-access-txszs\") pod \"lws-controller-manager-654b6f4fd4-9kl4v\" (UID: \"69be3329-2a70-4d8d-b5a8-77c1cae3535d\") " pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:34.940412 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:34.940387    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:35.260489 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:35.260460    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"]
Sep 16 14:10:35.262346 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:10:35.262322    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69be3329_2a70_4d8d_b5a8_77c1cae3535d.slice/crio-13210419efb494992d77d3c34b0e7e6ed93c543c8f6d2b2434f3cdfe7210b3a7 WatchSource:0}: Error finding container 13210419efb494992d77d3c34b0e7e6ed93c543c8f6d2b2434f3cdfe7210b3a7: Status 404 returned error can't find the container with id 13210419efb494992d77d3c34b0e7e6ed93c543c8f6d2b2434f3cdfe7210b3a7
Sep 16 14:10:35.758167 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:35.758134    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v" event={"ID":"69be3329-2a70-4d8d-b5a8-77c1cae3535d","Type":"ContainerStarted","Data":"13210419efb494992d77d3c34b0e7e6ed93c543c8f6d2b2434f3cdfe7210b3a7"}
Sep 16 14:10:37.026389 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.026360    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"]
Sep 16 14:10:37.031012 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.030989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.036056 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.036031    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 14:10:37.036154 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.036058    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 14:10:37.036154 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.036091    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 14:10:37.036397 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.036296    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kkfv7\""
Sep 16 14:10:37.036469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.036455    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 14:10:37.051565 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.051247    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"]
Sep 16 14:10:37.144686 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.144647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5x8d\" (UniqueName: \"kubernetes.io/projected/a352d83e-6203-4d16-91a1-eedc7c36d5b6-kube-api-access-n5x8d\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.144850 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.144695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a352d83e-6203-4d16-91a1-eedc7c36d5b6-tmp\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.144850 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.144729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a352d83e-6203-4d16-91a1-eedc7c36d5b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.144850 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.144776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a352d83e-6203-4d16-91a1-eedc7c36d5b6-manifests\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.144995 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.144861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a352d83e-6203-4d16-91a1-eedc7c36d5b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.245850 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.245816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a352d83e-6203-4d16-91a1-eedc7c36d5b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.246029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.245884    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5x8d\" (UniqueName: \"kubernetes.io/projected/a352d83e-6203-4d16-91a1-eedc7c36d5b6-kube-api-access-n5x8d\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.246029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.245915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a352d83e-6203-4d16-91a1-eedc7c36d5b6-tmp\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.246029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.245941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a352d83e-6203-4d16-91a1-eedc7c36d5b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.246029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.245997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a352d83e-6203-4d16-91a1-eedc7c36d5b6-manifests\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.246422 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.246393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a352d83e-6203-4d16-91a1-eedc7c36d5b6-manifests\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.248774 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.248726    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a352d83e-6203-4d16-91a1-eedc7c36d5b6-tmp\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.249090 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.249066    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a352d83e-6203-4d16-91a1-eedc7c36d5b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.249314 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.249293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a352d83e-6203-4d16-91a1-eedc7c36d5b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.254619 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.254591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5x8d\" (UniqueName: \"kubernetes.io/projected/a352d83e-6203-4d16-91a1-eedc7c36d5b6-kube-api-access-n5x8d\") pod \"opendatahub-operator-controller-manager-77f6d9877-f44zn\" (UID: \"a352d83e-6203-4d16-91a1-eedc7c36d5b6\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.368070 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.367990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:37.648682 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.648661    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"]
Sep 16 14:10:37.651174 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:10:37.651149    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda352d83e_6203_4d16_91a1_eedc7c36d5b6.slice/crio-df9fa2dc9ad66115d54fee668442e73c43e9b6a2ed3f87d9e361f9840333294f WatchSource:0}: Error finding container df9fa2dc9ad66115d54fee668442e73c43e9b6a2ed3f87d9e361f9840333294f: Status 404 returned error can't find the container with id df9fa2dc9ad66115d54fee668442e73c43e9b6a2ed3f87d9e361f9840333294f
Sep 16 14:10:37.768895 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.768860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v" event={"ID":"69be3329-2a70-4d8d-b5a8-77c1cae3535d","Type":"ContainerStarted","Data":"e9f54ed56020e3653b97758b9dc954c5f02ab8f3b3d9d41bda5cdc32a8f31c72"}
Sep 16 14:10:37.769097 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.768919    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:37.770091 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.770070    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn" event={"ID":"a352d83e-6203-4d16-91a1-eedc7c36d5b6","Type":"ContainerStarted","Data":"df9fa2dc9ad66115d54fee668442e73c43e9b6a2ed3f87d9e361f9840333294f"}
Sep 16 14:10:37.828845 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:37.828792    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v" podStartSLOduration=2.074551528 podStartE2EDuration="3.828775657s" totalImagesPullingTime="1.754224129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:10:37.826116359 +0000 UTC m=+377.125526626" watchObservedRunningTime="2026-09-16 14:10:37.828775657 +0000 UTC m=+377.128185986"
Sep 16 14:10:41.794502 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:41.794469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn" event={"ID":"a352d83e-6203-4d16-91a1-eedc7c36d5b6","Type":"ContainerStarted","Data":"a50747107d69a3a709274c86490dad877fbf48a21ff7528f073418f1a8e31ab0"}
Sep 16 14:10:42.800801 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:42.800769    2579 generic.go:356] "Generic (PLEG): container finished" podID="a352d83e-6203-4d16-91a1-eedc7c36d5b6" containerID="a50747107d69a3a709274c86490dad877fbf48a21ff7528f073418f1a8e31ab0" exitCode=0
Sep 16 14:10:42.801179 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:42.800858    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn" event={"ID":"a352d83e-6203-4d16-91a1-eedc7c36d5b6","Type":"ContainerDied","Data":"a50747107d69a3a709274c86490dad877fbf48a21ff7528f073418f1a8e31ab0"}
Sep 16 14:10:43.808041 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:43.808005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn" event={"ID":"a352d83e-6203-4d16-91a1-eedc7c36d5b6","Type":"ContainerStarted","Data":"421686c71cd8b2e47c3bcd8514849632ac11e8bd4f757972f7f4ec088f4bea85"}
Sep 16 14:10:43.808432 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:43.808262    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:10:43.842003 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:43.841961    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn" podStartSLOduration=3.017210661 podStartE2EDuration="7.841947407s" totalImagesPullingTime="3.759616717s" totalInitContainerRuntime="1.065120029s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:10:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:10:43.839314216 +0000 UTC m=+383.138724482" watchObservedRunningTime="2026-09-16 14:10:43.841947407 +0000 UTC m=+383.141357673"
Sep 16 14:10:45.796498 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:45.796463    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76fcc7675f-vw7zh"]
Sep 16 14:10:48.779029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:48.778999    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-654b6f4fd4-9kl4v"
Sep 16 14:10:54.814576 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:10:54.814515    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77f6d9877-f44zn"
Sep 16 14:11:09.696641 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:09.696607    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d95qk"]
Sep 16 14:11:09.712731 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:09.712701    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d95qk"]
Sep 16 14:11:09.712883 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:09.712735    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-d95qk"
Sep 16 14:11:09.715673 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:09.715653    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 16 14:11:09.811791 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:09.811762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnxg8\" (UniqueName: \"kubernetes.io/projected/748c5491-cc6c-4f4f-a8fd-fd680ca66c52-kube-api-access-rnxg8\") pod \"model-serving-api-54d89bd5fc-d95qk\" (UID: \"748c5491-cc6c-4f4f-a8fd-fd680ca66c52\") " pod="opendatahub/model-serving-api-54d89bd5fc-d95qk"
Sep 16 14:11:09.811945 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:09.811811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/748c5491-cc6c-4f4f-a8fd-fd680ca66c52-tls-certs\") pod \"model-serving-api-54d89bd5fc-d95qk\" (UID: \"748c5491-cc6c-4f4f-a8fd-fd680ca66c52\") " pod="opendatahub/model-serving-api-54d89bd5fc-d95qk"
Sep 16 14:11:09.912828 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:09.912798    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnxg8\" (UniqueName: \"kubernetes.io/projected/748c5491-cc6c-4f4f-a8fd-fd680ca66c52-kube-api-access-rnxg8\") pod \"model-serving-api-54d89bd5fc-d95qk\" (UID: \"748c5491-cc6c-4f4f-a8fd-fd680ca66c52\") " pod="opendatahub/model-serving-api-54d89bd5fc-d95qk"
Sep 16 14:11:09.912996 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:09.912857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/748c5491-cc6c-4f4f-a8fd-fd680ca66c52-tls-certs\") pod \"model-serving-api-54d89bd5fc-d95qk\" (UID: \"748c5491-cc6c-4f4f-a8fd-fd680ca66c52\") " pod="opendatahub/model-serving-api-54d89bd5fc-d95qk"
Sep 16 14:11:09.912996 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:11:09.912974    2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 16 14:11:09.913073 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:11:09.913034    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/748c5491-cc6c-4f4f-a8fd-fd680ca66c52-tls-certs podName:748c5491-cc6c-4f4f-a8fd-fd680ca66c52 nodeName:}" failed. No retries permitted until 2026-09-16 14:11:10.413016909 +0000 UTC m=+409.712427158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/748c5491-cc6c-4f4f-a8fd-fd680ca66c52-tls-certs") pod "model-serving-api-54d89bd5fc-d95qk" (UID: "748c5491-cc6c-4f4f-a8fd-fd680ca66c52") : secret "model-serving-api-tls" not found
Sep 16 14:11:09.922563 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:09.922527    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnxg8\" (UniqueName: \"kubernetes.io/projected/748c5491-cc6c-4f4f-a8fd-fd680ca66c52-kube-api-access-rnxg8\") pod \"model-serving-api-54d89bd5fc-d95qk\" (UID: \"748c5491-cc6c-4f4f-a8fd-fd680ca66c52\") " pod="opendatahub/model-serving-api-54d89bd5fc-d95qk"
Sep 16 14:11:10.417066 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:10.417028    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/748c5491-cc6c-4f4f-a8fd-fd680ca66c52-tls-certs\") pod \"model-serving-api-54d89bd5fc-d95qk\" (UID: \"748c5491-cc6c-4f4f-a8fd-fd680ca66c52\") " pod="opendatahub/model-serving-api-54d89bd5fc-d95qk"
Sep 16 14:11:10.419448 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:10.419426    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/748c5491-cc6c-4f4f-a8fd-fd680ca66c52-tls-certs\") pod \"model-serving-api-54d89bd5fc-d95qk\" (UID: \"748c5491-cc6c-4f4f-a8fd-fd680ca66c52\") " pod="opendatahub/model-serving-api-54d89bd5fc-d95qk"
Sep 16 14:11:10.623265 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:10.623229    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-d95qk"
Sep 16 14:11:10.818164 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:10.818128    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76fcc7675f-vw7zh" podUID="f669f276-e34b-4527-864a-b648b7cb08cc" containerName="console" containerID="cri-o://99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f" gracePeriod=15
Sep 16 14:11:10.916048 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:10.916025    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d95qk"]
Sep 16 14:11:10.918170 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:11:10.918141    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748c5491_cc6c_4f4f_a8fd_fd680ca66c52.slice/crio-786b7447818d87442febc000eb3661d6a75385ce906580e06ae328a9f972d930 WatchSource:0}: Error finding container 786b7447818d87442febc000eb3661d6a75385ce906580e06ae328a9f972d930: Status 404 returned error can't find the container with id 786b7447818d87442febc000eb3661d6a75385ce906580e06ae328a9f972d930
Sep 16 14:11:10.929336 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:10.929305    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-d95qk" event={"ID":"748c5491-cc6c-4f4f-a8fd-fd680ca66c52","Type":"ContainerStarted","Data":"786b7447818d87442febc000eb3661d6a75385ce906580e06ae328a9f972d930"}
Sep 16 14:11:11.063321 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.063295    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:11:11.122634 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.122604    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-serving-cert\") pod \"f669f276-e34b-4527-864a-b648b7cb08cc\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") "
Sep 16 14:11:11.122776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.122643    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-service-ca\") pod \"f669f276-e34b-4527-864a-b648b7cb08cc\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") "
Sep 16 14:11:11.122776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.122671    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-oauth-serving-cert\") pod \"f669f276-e34b-4527-864a-b648b7cb08cc\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") "
Sep 16 14:11:11.122776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.122695    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqlr9\" (UniqueName: \"kubernetes.io/projected/f669f276-e34b-4527-864a-b648b7cb08cc-kube-api-access-xqlr9\") pod \"f669f276-e34b-4527-864a-b648b7cb08cc\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") "
Sep 16 14:11:11.122776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.122713    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-console-config\") pod \"f669f276-e34b-4527-864a-b648b7cb08cc\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") "
Sep 16 14:11:11.122776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.122752    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-oauth-config\") pod \"f669f276-e34b-4527-864a-b648b7cb08cc\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") "
Sep 16 14:11:11.123037 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.122783    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-trusted-ca-bundle\") pod \"f669f276-e34b-4527-864a-b648b7cb08cc\" (UID: \"f669f276-e34b-4527-864a-b648b7cb08cc\") "
Sep 16 14:11:11.123164 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.123133    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-service-ca" (OuterVolumeSpecName: "service-ca") pod "f669f276-e34b-4527-864a-b648b7cb08cc" (UID: "f669f276-e34b-4527-864a-b648b7cb08cc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:11:11.123164 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.123158    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-console-config" (OuterVolumeSpecName: "console-config") pod "f669f276-e34b-4527-864a-b648b7cb08cc" (UID: "f669f276-e34b-4527-864a-b648b7cb08cc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:11:11.123316 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.123189    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f669f276-e34b-4527-864a-b648b7cb08cc" (UID: "f669f276-e34b-4527-864a-b648b7cb08cc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:11:11.123316 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.123234    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f669f276-e34b-4527-864a-b648b7cb08cc" (UID: "f669f276-e34b-4527-864a-b648b7cb08cc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:11:11.124813 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.124783    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f669f276-e34b-4527-864a-b648b7cb08cc" (UID: "f669f276-e34b-4527-864a-b648b7cb08cc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:11:11.124904 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.124873    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f669f276-e34b-4527-864a-b648b7cb08cc-kube-api-access-xqlr9" (OuterVolumeSpecName: "kube-api-access-xqlr9") pod "f669f276-e34b-4527-864a-b648b7cb08cc" (UID: "f669f276-e34b-4527-864a-b648b7cb08cc"). InnerVolumeSpecName "kube-api-access-xqlr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:11:11.125061 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.125036    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f669f276-e34b-4527-864a-b648b7cb08cc" (UID: "f669f276-e34b-4527-864a-b648b7cb08cc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:11:11.224110 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.224024    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqlr9\" (UniqueName: \"kubernetes.io/projected/f669f276-e34b-4527-864a-b648b7cb08cc-kube-api-access-xqlr9\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:11:11.224110 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.224056    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-console-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:11:11.224110 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.224067    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-oauth-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:11:11.224110 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.224076    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-trusted-ca-bundle\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:11:11.224110 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.224085    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f669f276-e34b-4527-864a-b648b7cb08cc-console-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:11:11.224110 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.224093    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:11:11.224110 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.224102    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f669f276-e34b-4527-864a-b648b7cb08cc-oauth-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:11:11.935323 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.935290    2579 generic.go:356] "Generic (PLEG): container finished" podID="f669f276-e34b-4527-864a-b648b7cb08cc" containerID="99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f" exitCode=0
Sep 16 14:11:11.935744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.935341    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76fcc7675f-vw7zh" event={"ID":"f669f276-e34b-4527-864a-b648b7cb08cc","Type":"ContainerDied","Data":"99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f"}
Sep 16 14:11:11.935744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.935348    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76fcc7675f-vw7zh"
Sep 16 14:11:11.935744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.935378    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76fcc7675f-vw7zh" event={"ID":"f669f276-e34b-4527-864a-b648b7cb08cc","Type":"ContainerDied","Data":"a5bf82f777e00303a3de65961de113ddb37e2006856838feb7a53090828f22f3"}
Sep 16 14:11:11.935744 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.935397    2579 scope.go:117] "RemoveContainer" containerID="99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f"
Sep 16 14:11:11.947449 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.944903    2579 scope.go:117] "RemoveContainer" containerID="99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f"
Sep 16 14:11:11.947449 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:11:11.945371    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f\": container with ID starting with 99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f not found: ID does not exist" containerID="99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f"
Sep 16 14:11:11.947449 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.945399    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f"} err="failed to get container status \"99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f\": rpc error: code = NotFound desc = could not find container \"99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f\": container with ID starting with 99e4f3fab28c5d5b593ee007c53a22b7b4369f6dd4d8e1b8684abcb9866fc06f not found: ID does not exist"
Sep 16 14:11:11.957887 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.957863    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76fcc7675f-vw7zh"]
Sep 16 14:11:11.963339 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:11.963319    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76fcc7675f-vw7zh"]
Sep 16 14:11:13.118212 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:13.118178    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f669f276-e34b-4527-864a-b648b7cb08cc" path="/var/lib/kubelet/pods/f669f276-e34b-4527-864a-b648b7cb08cc/volumes"
Sep 16 14:11:14.952746 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:14.952710    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-d95qk" event={"ID":"748c5491-cc6c-4f4f-a8fd-fd680ca66c52","Type":"ContainerStarted","Data":"3ea23a1e1c3853c5b2870fdd418e219c5bad8aea762c3039c8bb01effe7c3b39"}
Sep 16 14:11:14.953101 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:14.952800    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-d95qk"
Sep 16 14:11:14.975023 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:14.974945    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-d95qk" podStartSLOduration=2.94747068 podStartE2EDuration="5.974931131s" totalImagesPullingTime="3.027460451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:11:14.973603555 +0000 UTC m=+414.273013823" watchObservedRunningTime="2026-09-16 14:11:14.974931131 +0000 UTC m=+414.274341398"
Sep 16 14:11:15.517648 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.517614    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"]
Sep 16 14:11:15.517957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.517942    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f669f276-e34b-4527-864a-b648b7cb08cc" containerName="console"
Sep 16 14:11:15.517957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.517958    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f669f276-e34b-4527-864a-b648b7cb08cc" containerName="console"
Sep 16 14:11:15.518064 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.518033    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f669f276-e34b-4527-864a-b648b7cb08cc" containerName="console"
Sep 16 14:11:15.520786 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.520771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.523841 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.523822    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 14:11:15.524366 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.524351    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-q22zw\""
Sep 16 14:11:15.525632 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.525615    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 14:11:15.526021 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.526003    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 14:11:15.534321 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.534303    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 14:11:15.541052 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.541030    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"]
Sep 16 14:11:15.563680 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.563643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.563815 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.563682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkw75\" (UniqueName: \"kubernetes.io/projected/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-kube-api-access-jkw75\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.563815 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.563772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.563933 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.563852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.563933 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.563890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.563933 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.563928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.564099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.563975    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.665271 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.665235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.665271 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.665275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkw75\" (UniqueName: \"kubernetes.io/projected/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-kube-api-access-jkw75\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.665509 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.665314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.665509 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.665344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.665509 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.665366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.665509 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.665396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.665509 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.665435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.666190 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.666160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.667678 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.667656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.667787 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.667753    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.667857 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.667838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.667895 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.667842    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.708394 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.708374    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.708640 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.708624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkw75\" (UniqueName: \"kubernetes.io/projected/c2df28bd-4393-4d8d-ad83-14ae44e56a8e-kube-api-access-jkw75\") pod \"istiod-openshift-gateway-5677ccb49b-wh64f\" (UID: \"c2df28bd-4393-4d8d-ad83-14ae44e56a8e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:15.829914 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:15.829833    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:16.133012 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:16.132938    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"]
Sep 16 14:11:16.135847 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:11:16.135811    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2df28bd_4393_4d8d_ad83_14ae44e56a8e.slice/crio-c0b72d9feba739605f1ca0e6ed8caacdb9cea20d17a2a0c2f8f305ba5b6a8211 WatchSource:0}: Error finding container c0b72d9feba739605f1ca0e6ed8caacdb9cea20d17a2a0c2f8f305ba5b6a8211: Status 404 returned error can't find the container with id c0b72d9feba739605f1ca0e6ed8caacdb9cea20d17a2a0c2f8f305ba5b6a8211
Sep 16 14:11:16.964325 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:16.964248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f" event={"ID":"c2df28bd-4393-4d8d-ad83-14ae44e56a8e","Type":"ContainerStarted","Data":"c0b72d9feba739605f1ca0e6ed8caacdb9cea20d17a2a0c2f8f305ba5b6a8211"}
Sep 16 14:11:18.392466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:18.392408    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:11:18.392731 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:18.392507    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:11:18.976370 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:18.976333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f" event={"ID":"c2df28bd-4393-4d8d-ad83-14ae44e56a8e","Type":"ContainerStarted","Data":"8181c4e5fcbfe884bc2e470a79b96a10a33826de11bb233ee9b55133432be04b"}
Sep 16 14:11:18.976629 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:18.976467    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:19.006494 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:19.006445    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f" podStartSLOduration=1.752656775 podStartE2EDuration="4.006428802s" totalImagesPullingTime="2.253772027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:11:19.003659127 +0000 UTC m=+418.303069395" watchObservedRunningTime="2026-09-16 14:11:19.006428802 +0000 UTC m=+418.305839070"
Sep 16 14:11:19.982621 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:19.982584    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wh64f"
Sep 16 14:11:25.962231 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:11:25.962202    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-d95qk"
Sep 16 14:13:47.397749 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.397679    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"]
Sep 16 14:13:47.400920 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.400899    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"
Sep 16 14:13:47.403605 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.403583    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 14:13:47.404013 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.403994    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 14:13:47.404013 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.404006    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 16 14:13:47.404824 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.404806    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-bjtkp\""
Sep 16 14:13:47.411715 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.411696    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"]
Sep 16 14:13:47.497449 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.497422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl2jx\" (UniqueName: \"kubernetes.io/projected/9efb6288-efb1-4314-a2ce-051c5f792a0b-kube-api-access-pl2jx\") pod \"postgres-69fb4594cf-q2v6q\" (UID: \"9efb6288-efb1-4314-a2ce-051c5f792a0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"
Sep 16 14:13:47.497621 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.497461    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9efb6288-efb1-4314-a2ce-051c5f792a0b-data\") pod \"postgres-69fb4594cf-q2v6q\" (UID: \"9efb6288-efb1-4314-a2ce-051c5f792a0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"
Sep 16 14:13:47.598267 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.598238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl2jx\" (UniqueName: \"kubernetes.io/projected/9efb6288-efb1-4314-a2ce-051c5f792a0b-kube-api-access-pl2jx\") pod \"postgres-69fb4594cf-q2v6q\" (UID: \"9efb6288-efb1-4314-a2ce-051c5f792a0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"
Sep 16 14:13:47.598429 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.598276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9efb6288-efb1-4314-a2ce-051c5f792a0b-data\") pod \"postgres-69fb4594cf-q2v6q\" (UID: \"9efb6288-efb1-4314-a2ce-051c5f792a0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"
Sep 16 14:13:47.598647 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.598629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9efb6288-efb1-4314-a2ce-051c5f792a0b-data\") pod \"postgres-69fb4594cf-q2v6q\" (UID: \"9efb6288-efb1-4314-a2ce-051c5f792a0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"
Sep 16 14:13:47.611728 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.611708    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl2jx\" (UniqueName: \"kubernetes.io/projected/9efb6288-efb1-4314-a2ce-051c5f792a0b-kube-api-access-pl2jx\") pod \"postgres-69fb4594cf-q2v6q\" (UID: \"9efb6288-efb1-4314-a2ce-051c5f792a0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"
Sep 16 14:13:47.711170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.711089    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"
Sep 16 14:13:47.983335 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:47.983312    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"]
Sep 16 14:13:47.985425 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:13:47.985395    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9efb6288_efb1_4314_a2ce_051c5f792a0b.slice/crio-fcafb58c328a17c1d6bd72dfb1d9de64aa195e769d0aa89670051b3611a908ab WatchSource:0}: Error finding container fcafb58c328a17c1d6bd72dfb1d9de64aa195e769d0aa89670051b3611a908ab: Status 404 returned error can't find the container with id fcafb58c328a17c1d6bd72dfb1d9de64aa195e769d0aa89670051b3611a908ab
Sep 16 14:13:48.661589 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:48.661534    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q" event={"ID":"9efb6288-efb1-4314-a2ce-051c5f792a0b","Type":"ContainerStarted","Data":"fcafb58c328a17c1d6bd72dfb1d9de64aa195e769d0aa89670051b3611a908ab"}
Sep 16 14:13:53.692821 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:53.692778    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q" event={"ID":"9efb6288-efb1-4314-a2ce-051c5f792a0b","Type":"ContainerStarted","Data":"ec7cc8ae30841ed4729ac583b4a660a64ced729198bdbb409f4303f064e4179b"}
Sep 16 14:13:53.693201 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:53.692918    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"
Sep 16 14:13:53.711972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:53.711928    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q" podStartSLOduration=1.778195494 podStartE2EDuration="6.711914631s" totalImagesPullingTime="4.933719137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:13:53.709735708 +0000 UTC m=+573.009145976" watchObservedRunningTime="2026-09-16 14:13:53.711914631 +0000 UTC m=+573.011324898"
Sep 16 14:13:59.724832 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:13:59.724761    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q2v6q"
Sep 16 14:14:21.057760 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:14:21.057719    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:14:21.058279 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:14:21.058125    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:15:00.139594 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:00.139539    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826135-d5xwn"]
Sep 16 14:15:00.142951 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:00.142926    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826135-d5xwn"
Sep 16 14:15:00.146591 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:00.146572    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g952z\""
Sep 16 14:15:00.153382 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:00.153354    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826135-d5xwn"]
Sep 16 14:15:00.153477 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:00.153402    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826135-d5xwn"
Sep 16 14:15:00.422837 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:00.422812    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826135-d5xwn"]
Sep 16 14:15:00.424744 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:15:00.424716    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod974fd0d1_d8b8_42eb_bc97_1e9c58ecf060.slice/crio-39cd647945fa2daf7b295ede332b302c1176705e78c97dabdddd7e7132c1514a WatchSource:0}: Error finding container 39cd647945fa2daf7b295ede332b302c1176705e78c97dabdddd7e7132c1514a: Status 404 returned error can't find the container with id 39cd647945fa2daf7b295ede332b302c1176705e78c97dabdddd7e7132c1514a
Sep 16 14:15:00.426597 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:00.426576    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:15:01.011348 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:01.011306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826135-d5xwn" event={"ID":"974fd0d1-d8b8-42eb-bc97-1e9c58ecf060","Type":"ContainerStarted","Data":"39cd647945fa2daf7b295ede332b302c1176705e78c97dabdddd7e7132c1514a"}
Sep 16 14:15:04.028116 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:04.028081    2579 generic.go:356] "Generic (PLEG): container finished" podID="974fd0d1-d8b8-42eb-bc97-1e9c58ecf060" containerID="28d809207b93b6ab625802139e8eff21223fb511d494f566d5d76163ef0b019c" exitCode=0
Sep 16 14:15:04.028462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:04.028120    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826135-d5xwn" event={"ID":"974fd0d1-d8b8-42eb-bc97-1e9c58ecf060","Type":"ContainerDied","Data":"28d809207b93b6ab625802139e8eff21223fb511d494f566d5d76163ef0b019c"}
Sep 16 14:15:05.159127 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:05.159100    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826135-d5xwn"
Sep 16 14:15:06.045359 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:06.045331    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826135-d5xwn"
Sep 16 14:15:06.045520 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:06.045326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826135-d5xwn" event={"ID":"974fd0d1-d8b8-42eb-bc97-1e9c58ecf060","Type":"ContainerDied","Data":"39cd647945fa2daf7b295ede332b302c1176705e78c97dabdddd7e7132c1514a"}
Sep 16 14:15:06.045520 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:06.045486    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39cd647945fa2daf7b295ede332b302c1176705e78c97dabdddd7e7132c1514a"
Sep 16 14:15:22.074114 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.074074    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"]
Sep 16 14:15:22.074593 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.074385    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="974fd0d1-d8b8-42eb-bc97-1e9c58ecf060" containerName="cleanup"
Sep 16 14:15:22.074593 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.074396    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="974fd0d1-d8b8-42eb-bc97-1e9c58ecf060" containerName="cleanup"
Sep 16 14:15:22.074593 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.074468    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="974fd0d1-d8b8-42eb-bc97-1e9c58ecf060" containerName="cleanup"
Sep 16 14:15:22.077448 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.077428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.081512 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.081485    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 16 14:15:22.081512 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.081506    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 14:15:22.081695 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.081570    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 14:15:22.081695 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.081615    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-k6tqt\""
Sep 16 14:15:22.086717 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.086693    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"]
Sep 16 14:15:22.162278 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.162243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.162278 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.162278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.162469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.162313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.162469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.162338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tbch\" (UniqueName: \"kubernetes.io/projected/e6448241-aefc-4717-b3cf-52f753773a0d-kube-api-access-9tbch\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.162469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.162406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6448241-aefc-4717-b3cf-52f753773a0d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.162469 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.162442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.263616 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.263582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.263616 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.263620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.263808 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.263659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.263808 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.263685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tbch\" (UniqueName: \"kubernetes.io/projected/e6448241-aefc-4717-b3cf-52f753773a0d-kube-api-access-9tbch\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.263808 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.263704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6448241-aefc-4717-b3cf-52f753773a0d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.263808 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.263778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.264135 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.264114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.264202 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.264134    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.264202 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.264193    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.265914 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.265895    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6448241-aefc-4717-b3cf-52f753773a0d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.266090 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.266074    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6448241-aefc-4717-b3cf-52f753773a0d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.272020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.271999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tbch\" (UniqueName: \"kubernetes.io/projected/e6448241-aefc-4717-b3cf-52f753773a0d-kube-api-access-9tbch\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd\" (UID: \"e6448241-aefc-4717-b3cf-52f753773a0d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.388062 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.387997    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:22.664057 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:22.664027    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"]
Sep 16 14:15:22.665921 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:15:22.665892    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6448241_aefc_4717_b3cf_52f753773a0d.slice/crio-3964ae3137b5624b9d2423229c06443a2bb5d27d43d87c59273022c2f96bbc6f WatchSource:0}: Error finding container 3964ae3137b5624b9d2423229c06443a2bb5d27d43d87c59273022c2f96bbc6f: Status 404 returned error can't find the container with id 3964ae3137b5624b9d2423229c06443a2bb5d27d43d87c59273022c2f96bbc6f
Sep 16 14:15:23.121542 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:23.121453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd" event={"ID":"e6448241-aefc-4717-b3cf-52f753773a0d","Type":"ContainerStarted","Data":"3964ae3137b5624b9d2423229c06443a2bb5d27d43d87c59273022c2f96bbc6f"}
Sep 16 14:15:24.127906 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:24.127821    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd" event={"ID":"e6448241-aefc-4717-b3cf-52f753773a0d","Type":"ContainerStarted","Data":"447626a688e47777b78d02647be7d93cdb38183e54f450f2c5d7fc591afbb6c4"}
Sep 16 14:15:24.150035 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:24.149982    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd" podStartSLOduration=1.016185567 podStartE2EDuration="2.149965661s" totalImagesPullingTime="1.133780094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:24.148668724 +0000 UTC m=+663.448078994" watchObservedRunningTime="2026-09-16 14:15:24.149965661 +0000 UTC m=+663.449375927"
Sep 16 14:15:32.389169 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:32.389130    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:32.389715 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:32.389197    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:32.401674 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:32.401650    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:33.182971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:33.182939    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cskfd"
Sep 16 14:15:46.766416 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.766374    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"]
Sep 16 14:15:46.769748 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.769732    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.772801 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.772778    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 16 14:15:46.780205 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.780184    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"]
Sep 16 14:15:46.869410 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.869378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.869585 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.869425    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.869585 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.869460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.869585 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.869491    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.869585 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.869521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grftf\" (UniqueName: \"kubernetes.io/projected/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-kube-api-access-grftf\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.869781 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.869613    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.970217 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.970185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.970370 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.970221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.970370 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.970243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grftf\" (UniqueName: \"kubernetes.io/projected/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-kube-api-access-grftf\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.970370 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.970315    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.970540 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.970376    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.970540 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.970412    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.970726 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.970704    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.971004 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.970778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.971004 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.970881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.972829 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.972809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.972921 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.972830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:46.981971 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:46.981952    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grftf\" (UniqueName: \"kubernetes.io/projected/3c659ca9-3fe3-4db7-aef0-b089f0b47ede-kube-api-access-grftf\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9\" (UID: \"3c659ca9-3fe3-4db7-aef0-b089f0b47ede\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:47.081124 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:47.081052    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:47.364639 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:47.364615    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"]
Sep 16 14:15:47.367020 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:15:47.366987    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c659ca9_3fe3_4db7_aef0_b089f0b47ede.slice/crio-46a0643c498ca64290465576d846a0e5aa2e2024c112026bacca284585723b3e WatchSource:0}: Error finding container 46a0643c498ca64290465576d846a0e5aa2e2024c112026bacca284585723b3e: Status 404 returned error can't find the container with id 46a0643c498ca64290465576d846a0e5aa2e2024c112026bacca284585723b3e
Sep 16 14:15:48.243185 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:48.243151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9" event={"ID":"3c659ca9-3fe3-4db7-aef0-b089f0b47ede","Type":"ContainerStarted","Data":"3bc9fb041c227c55bee62807b66eb0c8b3ba7e957ab58a5877bf2a7907b8d334"}
Sep 16 14:15:48.243681 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:48.243203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9" event={"ID":"3c659ca9-3fe3-4db7-aef0-b089f0b47ede","Type":"ContainerStarted","Data":"46a0643c498ca64290465576d846a0e5aa2e2024c112026bacca284585723b3e"}
Sep 16 14:15:48.272993 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:48.272947    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9" podStartSLOduration=2.081103034 podStartE2EDuration="2.272931619s" totalImagesPullingTime="191.828585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:48.271864997 +0000 UTC m=+687.571275264" watchObservedRunningTime="2026-09-16 14:15:48.272931619 +0000 UTC m=+687.572341901"
Sep 16 14:15:57.082163 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:57.082129    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:57.082578 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:57.082186    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:57.094593 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:57.094567    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:15:57.298674 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:15:57.298645    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jncn9"
Sep 16 14:16:08.873252 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:08.873218    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"]
Sep 16 14:16:08.876864 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:08.876845    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:08.879533 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:08.879508    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 16 14:16:08.891041 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:08.891016    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"]
Sep 16 14:16:08.944435 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:08.944405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:08.944593 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:08.944446    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:08.944593 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:08.944470    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:08.944593 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:08.944508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxntp\" (UniqueName: \"kubernetes.io/projected/77ab3078-a01c-48ef-af0f-0eec1f7beef6-kube-api-access-hxntp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:08.944593 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:08.944587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77ab3078-a01c-48ef-af0f-0eec1f7beef6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:08.944749 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:08.944618    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.045096 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.045056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77ab3078-a01c-48ef-af0f-0eec1f7beef6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.045096 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.045100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.045354 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.045130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.045354 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.045149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.045354 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.045171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.045354 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.045197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxntp\" (UniqueName: \"kubernetes.io/projected/77ab3078-a01c-48ef-af0f-0eec1f7beef6-kube-api-access-hxntp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.045620 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.045592    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.045735 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.045638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.045793 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.045733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.047354 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.047330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77ab3078-a01c-48ef-af0f-0eec1f7beef6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.047486 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.047470    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77ab3078-a01c-48ef-af0f-0eec1f7beef6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.061914 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.061887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxntp\" (UniqueName: \"kubernetes.io/projected/77ab3078-a01c-48ef-af0f-0eec1f7beef6-kube-api-access-hxntp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-22jfx\" (UID: \"77ab3078-a01c-48ef-af0f-0eec1f7beef6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.188053 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.188017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:09.469244 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:09.469216    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"]
Sep 16 14:16:09.470978 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:16:09.470951    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ab3078_a01c_48ef_af0f_0eec1f7beef6.slice/crio-bc911437a597d57f8e524f335c0e49e93f5f2f94a80acf39e21cce3c0ef85cbe WatchSource:0}: Error finding container bc911437a597d57f8e524f335c0e49e93f5f2f94a80acf39e21cce3c0ef85cbe: Status 404 returned error can't find the container with id bc911437a597d57f8e524f335c0e49e93f5f2f94a80acf39e21cce3c0ef85cbe
Sep 16 14:16:10.351017 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:10.350980    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx" event={"ID":"77ab3078-a01c-48ef-af0f-0eec1f7beef6","Type":"ContainerStarted","Data":"d2286e42debf2fd21b77f13967211ee065a5d508e350c54e99d5b526ac8b86ea"}
Sep 16 14:16:10.351388 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:10.351032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx" event={"ID":"77ab3078-a01c-48ef-af0f-0eec1f7beef6","Type":"ContainerStarted","Data":"bc911437a597d57f8e524f335c0e49e93f5f2f94a80acf39e21cce3c0ef85cbe"}
Sep 16 14:16:10.387718 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:10.387666    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx" podStartSLOduration=2.188595648 podStartE2EDuration="2.387652149s" totalImagesPullingTime="199.056501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:16:10.386718146 +0000 UTC m=+709.686128414" watchObservedRunningTime="2026-09-16 14:16:10.387652149 +0000 UTC m=+709.687062407"
Sep 16 14:16:19.189147 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:19.189072    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:19.189147 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:19.189140    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:19.201678 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:19.201650    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:16:19.403815 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:16:19.403784    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-22jfx"
Sep 16 14:18:15.178124 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.178094    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"]
Sep 16 14:18:15.181531 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.181511    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.184560 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.184523    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e24c87-serving-cert\""
Sep 16 14:18:15.184696 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.184558    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b7mcl\""
Sep 16 14:18:15.184696 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.184634    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 14:18:15.193282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.193257    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"]
Sep 16 14:18:15.330858 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.330825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzndk\" (UniqueName: \"kubernetes.io/projected/fb49c0b4-6990-4253-bda6-79526a569cfc-kube-api-access-wzndk\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.330858 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.330868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb49c0b4-6990-4253-bda6-79526a569cfc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.331068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.330902    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-metrics-certs\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.331068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.330979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-maas-api-tls\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.431743 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.431651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzndk\" (UniqueName: \"kubernetes.io/projected/fb49c0b4-6990-4253-bda6-79526a569cfc-kube-api-access-wzndk\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.431743 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.431689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb49c0b4-6990-4253-bda6-79526a569cfc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.431743 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.431710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-metrics-certs\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.431743 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.431747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-maas-api-tls\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.432397 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.432363    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb49c0b4-6990-4253-bda6-79526a569cfc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.434281 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.434258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-metrics-certs\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.434386 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.434293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-maas-api-tls\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.448789 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.448767    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzndk\" (UniqueName: \"kubernetes.io/projected/fb49c0b4-6990-4253-bda6-79526a569cfc-kube-api-access-wzndk\") pod \"maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.493930 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.493894    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:15.769819 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.769795    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"]
Sep 16 14:18:15.771501 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:18:15.771478    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb49c0b4_6990_4253_bda6_79526a569cfc.slice/crio-f80dad5838ca73040d529bfcb24f368d2c552543177357eb4dcc7bcb87da2935 WatchSource:0}: Error finding container f80dad5838ca73040d529bfcb24f368d2c552543177357eb4dcc7bcb87da2935: Status 404 returned error can't find the container with id f80dad5838ca73040d529bfcb24f368d2c552543177357eb4dcc7bcb87da2935
Sep 16 14:18:15.962616 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:15.962580    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8" event={"ID":"fb49c0b4-6990-4253-bda6-79526a569cfc","Type":"ContainerStarted","Data":"f80dad5838ca73040d529bfcb24f368d2c552543177357eb4dcc7bcb87da2935"}
Sep 16 14:18:18.981704 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:18.981663    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8" event={"ID":"fb49c0b4-6990-4253-bda6-79526a569cfc","Type":"ContainerStarted","Data":"1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205"}
Sep 16 14:18:18.982056 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:18.981831    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:19.008858 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:19.008813    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8" podStartSLOduration=1.408762145 podStartE2EDuration="4.008800036s" totalImagesPullingTime="2.600037891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:18:19.007633574 +0000 UTC m=+838.307043841" watchObservedRunningTime="2026-09-16 14:18:19.008800036 +0000 UTC m=+838.308210303"
Sep 16 14:18:24.992645 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:24.992610    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:18:37.551144 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.551112    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"]
Sep 16 14:18:37.554748 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.554730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.557599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.557578    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-46e82d-openshift-default-dockercfg-xs2gs\""
Sep 16 14:18:37.569391 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.569370    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"]
Sep 16 14:18:37.738337 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.738309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7nwd\" (UniqueName: \"kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-kube-api-access-l7nwd\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.738527 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.738344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-envoy\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.738527 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.738362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-token\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.738527 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.738379    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-certs\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.738527 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.738498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee8a75db-2de3-46ed-8109-cf105d6fd962-istiod-ca-cert\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.738779 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.738606    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-socket\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.738779 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.738637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-credential-socket\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.738779 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.738685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-data\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.738779 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.738719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-podinfo\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.839729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.839643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee8a75db-2de3-46ed-8109-cf105d6fd962-istiod-ca-cert\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.839729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.839700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-socket\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.839729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.839724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-credential-socket\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.839965 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.839760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-data\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.839965 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.839880    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-podinfo\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.839965 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.839953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7nwd\" (UniqueName: \"kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-kube-api-access-l7nwd\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.840123 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.839977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-envoy\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.840123 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.839995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-token\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.840123 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.840021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-certs\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.840275 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.840219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-credential-socket\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.840275 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.840229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-data\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.840275 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.840236    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-socket\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.840416 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.840344    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-certs\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.840477 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.840417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee8a75db-2de3-46ed-8109-cf105d6fd962-istiod-ca-cert\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.842198 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.842179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-envoy\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.842427 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.842408    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-podinfo\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.852181 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.852152    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-token\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.852438 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.852419    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7nwd\" (UniqueName: \"kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-kube-api-access-l7nwd\") pod \"e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") " pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:37.865281 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:37.865264    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:38.141887 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:38.141665    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"]
Sep 16 14:18:38.144636 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:18:38.144607    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee8a75db_2de3_46ed_8109_cf105d6fd962.slice/crio-2c6ec8889ceabb2ac03c5bde01e002b1844655d154f2ccb15159c68ebb7b2de8 WatchSource:0}: Error finding container 2c6ec8889ceabb2ac03c5bde01e002b1844655d154f2ccb15159c68ebb7b2de8: Status 404 returned error can't find the container with id 2c6ec8889ceabb2ac03c5bde01e002b1844655d154f2ccb15159c68ebb7b2de8
Sep 16 14:18:39.082598 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:39.082522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" event={"ID":"ee8a75db-2de3-46ed-8109-cf105d6fd962","Type":"ContainerStarted","Data":"2c6ec8889ceabb2ac03c5bde01e002b1844655d154f2ccb15159c68ebb7b2de8"}
Sep 16 14:18:40.570003 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:40.569969    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:18:40.570270 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:40.570034    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:18:40.570270 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:40.570065    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:18:41.095353 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:41.095311    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" event={"ID":"ee8a75db-2de3-46ed-8109-cf105d6fd962","Type":"ContainerStarted","Data":"cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802"}
Sep 16 14:18:41.119990 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:41.119942    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" podStartSLOduration=1.696769459 podStartE2EDuration="4.119927357s" totalImagesPullingTime="2.423157898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:18:41.117398922 +0000 UTC m=+860.416809230" watchObservedRunningTime="2026-09-16 14:18:41.119927357 +0000 UTC m=+860.419337624"
Sep 16 14:18:41.866016 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:41.865975    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:41.870936 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:41.870914    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:42.100681 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:42.100651    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:42.101767 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:42.101749    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:18:46.183044 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.183010    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"]
Sep 16 14:18:46.186841 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.186819    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.189648 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.189627    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-46e82d-serving-cert\""
Sep 16 14:18:46.200453 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.200427    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"]
Sep 16 14:18:46.297512 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.297477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-maas-api-tls\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.297712 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.297588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffdpg\" (UniqueName: \"kubernetes.io/projected/e3d12beb-cdf8-422d-be76-30fa894f4130-kube-api-access-ffdpg\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.297712 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.297684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-metrics-certs\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.297828 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.297741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3d12beb-cdf8-422d-be76-30fa894f4130-openshift-service-ca\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.398652 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.398621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-maas-api-tls\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.398844 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.398668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffdpg\" (UniqueName: \"kubernetes.io/projected/e3d12beb-cdf8-422d-be76-30fa894f4130-kube-api-access-ffdpg\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.398844 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.398695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-metrics-certs\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.398844 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.398720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3d12beb-cdf8-422d-be76-30fa894f4130-openshift-service-ca\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.398844 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:18:46.398764    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-serving-cert: secret "maas-api-e2e-inf-b-46e82d-serving-cert" not found
Sep 16 14:18:46.398844 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:18:46.398827    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-maas-api-tls podName:e3d12beb-cdf8-422d-be76-30fa894f4130 nodeName:}" failed. No retries permitted until 2026-09-16 14:18:46.898813993 +0000 UTC m=+866.198224238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-maas-api-tls") pod "maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd" (UID: "e3d12beb-cdf8-422d-be76-30fa894f4130") : secret "maas-api-e2e-inf-b-46e82d-serving-cert" not found
Sep 16 14:18:46.399309 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.399288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3d12beb-cdf8-422d-be76-30fa894f4130-openshift-service-ca\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.401141 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.401120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-metrics-certs\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.410006 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.409987    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffdpg\" (UniqueName: \"kubernetes.io/projected/e3d12beb-cdf8-422d-be76-30fa894f4130-kube-api-access-ffdpg\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.901965 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.901925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-maas-api-tls\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:46.904195 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:46.904170    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-maas-api-tls\") pod \"maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:47.100146 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:47.100105    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:47.380596 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:47.380562    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"]
Sep 16 14:18:47.384416 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:18:47.384386    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d12beb_cdf8_422d_be76_30fa894f4130.slice/crio-85e60c2f330d3245513c1eb2b2b570f27a9c55455fe5d443acf7c7e38ff96ece WatchSource:0}: Error finding container 85e60c2f330d3245513c1eb2b2b570f27a9c55455fe5d443acf7c7e38ff96ece: Status 404 returned error can't find the container with id 85e60c2f330d3245513c1eb2b2b570f27a9c55455fe5d443acf7c7e38ff96ece
Sep 16 14:18:48.132727 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:48.132638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd" event={"ID":"e3d12beb-cdf8-422d-be76-30fa894f4130","Type":"ContainerStarted","Data":"6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6"}
Sep 16 14:18:48.132727 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:48.132688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd" event={"ID":"e3d12beb-cdf8-422d-be76-30fa894f4130","Type":"ContainerStarted","Data":"85e60c2f330d3245513c1eb2b2b570f27a9c55455fe5d443acf7c7e38ff96ece"}
Sep 16 14:18:48.132903 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:48.132804    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:18:48.151484 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:48.151411    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd" podStartSLOduration=1.72165448 podStartE2EDuration="2.15139065s" totalImagesPullingTime="429.73617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:18:48.149826451 +0000 UTC m=+867.449236717" watchObservedRunningTime="2026-09-16 14:18:48.15139065 +0000 UTC m=+867.450800918"
Sep 16 14:18:54.143979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:18:54.143952    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:19:02.203300 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:02.203268    2579 generic.go:356] "Generic (PLEG): container finished" podID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerID="cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802" exitCode=0
Sep 16 14:19:02.203721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:02.203343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" event={"ID":"ee8a75db-2de3-46ed-8109-cf105d6fd962","Type":"ContainerDied","Data":"cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802"}
Sep 16 14:19:02.203721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:02.203699    2579 scope.go:117] "RemoveContainer" containerID="cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802"
Sep 16 14:19:02.204748 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:02.204721    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:19:02.204834 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:02.204783    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:19:02.204834 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:02.204814    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:19:03.209829 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:03.209795    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" event={"ID":"ee8a75db-2de3-46ed-8109-cf105d6fd962","Type":"ContainerStarted","Data":"c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18"}
Sep 16 14:19:03.865824 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:03.865793    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:19:03.866022 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:03.865991    2579 patch_prober.go:28] interesting pod/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 16 14:19:03.866099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:03.866069    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 16 14:19:04.866618 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:04.866583    2579 patch_prober.go:28] interesting pod/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 16 14:19:04.866986 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:04.866636    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 16 14:19:05.866399 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:05.866362    2579 patch_prober.go:28] interesting pod/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 16 14:19:05.866608 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:05.866430    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 16 14:19:06.865996 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:06.865955    2579 patch_prober.go:28] interesting pod/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 16 14:19:06.866454 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:06.866021    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 16 14:19:07.866613 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:07.866574    2579 patch_prober.go:28] interesting pod/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 16 14:19:07.867016 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:07.866669    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 16 14:19:08.866299 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:08.866265    2579 patch_prober.go:28] interesting pod/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 16 14:19:08.866542 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:08.866318    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 16 14:19:09.869704 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:09.869672    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:19:09.870094 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:09.869956    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:19:09.870723 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:09.870703    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:19:21.089679 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:21.089587    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:19:21.090860 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:21.090838    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:19:39.279352 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.279320    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"]
Sep 16 14:19:39.283188 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.283168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.287054 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.287033    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e24c87\"/\"test-model-e24c87-kserve-self-signed-certs\""
Sep 16 14:19:39.287054 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.287050    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e24c87\"/\"openshift-service-ca.crt\""
Sep 16 14:19:39.287244 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.287081    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e24c87\"/\"kube-root-ca.crt\""
Sep 16 14:19:39.287244 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.287083    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e24c87\"/\"default-dockercfg-np4mm\""
Sep 16 14:19:39.293559 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.293525    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"]
Sep 16 14:19:39.386232 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.386200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-dshm\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.386400 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.386239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-tmp-dir\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.386400 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.386295    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-model-cache\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.386400 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.386349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86abb242-9051-4102-a7a6-c2d00e338f4a-tls-certs\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.386528 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.386416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrdxc\" (UniqueName: \"kubernetes.io/projected/86abb242-9051-4102-a7a6-c2d00e338f4a-kube-api-access-wrdxc\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.386528 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.386442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-home\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.487624 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.487591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrdxc\" (UniqueName: \"kubernetes.io/projected/86abb242-9051-4102-a7a6-c2d00e338f4a-kube-api-access-wrdxc\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.487800 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.487642    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-home\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.487800 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.487674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-dshm\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.487800 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.487691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-tmp-dir\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.487800 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.487712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-model-cache\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.488019 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.487811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86abb242-9051-4102-a7a6-c2d00e338f4a-tls-certs\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.488169 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.488144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-model-cache\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.488246 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.488201    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-home\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.488246 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.488234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-tmp-dir\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.489955 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.489937    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-dshm\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.490247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.490229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86abb242-9051-4102-a7a6-c2d00e338f4a-tls-certs\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.497803 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.497777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrdxc\" (UniqueName: \"kubernetes.io/projected/86abb242-9051-4102-a7a6-c2d00e338f4a-kube-api-access-wrdxc\") pod \"test-model-e24c87-kserve-5c98bf65c9-64xtx\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") " pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.592881 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.592794    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:39.867304 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:39.867276    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"]
Sep 16 14:19:39.869520 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:19:39.869489    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86abb242_9051_4102_a7a6_c2d00e338f4a.slice/crio-d78b2a9ca9fb6248b9ba30b1d06cc209f3c07fb2763d7befded54a44a64392d8 WatchSource:0}: Error finding container d78b2a9ca9fb6248b9ba30b1d06cc209f3c07fb2763d7befded54a44a64392d8: Status 404 returned error can't find the container with id d78b2a9ca9fb6248b9ba30b1d06cc209f3c07fb2763d7befded54a44a64392d8
Sep 16 14:19:40.394123 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:40.394090    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx" event={"ID":"86abb242-9051-4102-a7a6-c2d00e338f4a","Type":"ContainerStarted","Data":"c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040"}
Sep 16 14:19:40.394123 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:40.394129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx" event={"ID":"86abb242-9051-4102-a7a6-c2d00e338f4a","Type":"ContainerStarted","Data":"d78b2a9ca9fb6248b9ba30b1d06cc209f3c07fb2763d7befded54a44a64392d8"}
Sep 16 14:19:40.428490 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:40.428432    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx" podStartSLOduration=1.428415527 podStartE2EDuration="1.428415527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:19:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:19:40.427525546 +0000 UTC m=+919.726935814" watchObservedRunningTime="2026-09-16 14:19:40.428415527 +0000 UTC m=+919.727825794"
Sep 16 14:19:49.593873 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:49.593835    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:49.594310 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:49.593887    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:49.606222 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:49.606194    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:19:50.457698 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:19:50.457664    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:21:09.589114 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.589071    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"]
Sep 16 14:21:09.592520 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.592500    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.595475 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.595339    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-46e82d\"/\"kube-root-ca.crt\""
Sep 16 14:21:09.596375 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.596196    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-46e82d\"/\"default-dockercfg-bhvxj\""
Sep 16 14:21:09.596825 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.596799    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-46e82d\"/\"openshift-service-ca.crt\""
Sep 16 14:21:09.597036 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.597014    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-46e82d\"/\"test-model-46e82d-kserve-self-signed-certs\""
Sep 16 14:21:09.610322 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.610298    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"]
Sep 16 14:21:09.686102 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.686033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-home\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.686294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.686130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-dshm\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.686294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.686193    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkxvw\" (UniqueName: \"kubernetes.io/projected/ff83f387-ef10-4819-9d10-4ea5d38c84fe-kube-api-access-xkxvw\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.686294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.686261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tls-certs\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.686452 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.686322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-model-cache\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.686452 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.686345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tmp-dir\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.787005 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.786974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-model-cache\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.787005 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.787009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tmp-dir\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.787219 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.787047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-home\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.787219 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.787090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-dshm\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.787219 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.787141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkxvw\" (UniqueName: \"kubernetes.io/projected/ff83f387-ef10-4819-9d10-4ea5d38c84fe-kube-api-access-xkxvw\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.787219 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.787202    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tls-certs\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.787480 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.787457    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-home\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.787568 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.787462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-model-cache\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.787568 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.787495    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tmp-dir\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.789493 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.789467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-dshm\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.789790 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.789606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tls-certs\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.800227 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.800201    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkxvw\" (UniqueName: \"kubernetes.io/projected/ff83f387-ef10-4819-9d10-4ea5d38c84fe-kube-api-access-xkxvw\") pod \"test-model-46e82d-kserve-867877659f-hqzw7\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") " pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:09.903766 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:09.903735    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:10.197155 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:10.197084    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"]
Sep 16 14:21:10.200604 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:21:10.200578    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff83f387_ef10_4819_9d10_4ea5d38c84fe.slice/crio-a051b7a73afdbbb01761de7da89093eccf24a44dd4bf9daab61792abca1f26ac WatchSource:0}: Error finding container a051b7a73afdbbb01761de7da89093eccf24a44dd4bf9daab61792abca1f26ac: Status 404 returned error can't find the container with id a051b7a73afdbbb01761de7da89093eccf24a44dd4bf9daab61792abca1f26ac
Sep 16 14:21:10.849227 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:10.849199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7" event={"ID":"ff83f387-ef10-4819-9d10-4ea5d38c84fe","Type":"ContainerStarted","Data":"1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a"}
Sep 16 14:21:10.849621 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:10.849238    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7" event={"ID":"ff83f387-ef10-4819-9d10-4ea5d38c84fe","Type":"ContainerStarted","Data":"a051b7a73afdbbb01761de7da89093eccf24a44dd4bf9daab61792abca1f26ac"}
Sep 16 14:21:10.876376 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:10.876333    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7" podStartSLOduration=1.876319202 podStartE2EDuration="1.876319202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:21:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:21:10.873872526 +0000 UTC m=+1010.173282793" watchObservedRunningTime="2026-09-16 14:21:10.876319202 +0000 UTC m=+1010.175729470"
Sep 16 14:21:19.904037 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:19.904002    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:19.904589 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:19.904176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:19.916988 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:19.916968    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:21:20.910668 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:21:20.910634    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:22:15.945600 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:15.945511    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"]
Sep 16 14:22:15.949192 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:15.949173    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:15.973809 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:15.973780    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-597ea191-openshift-default-dockercfg-9xvtq\""
Sep 16 14:22:16.020728 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.020699    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"]
Sep 16 14:22:16.085051 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.085022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-envoy\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.085051 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.085054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-certs\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.085245 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.085074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27449689-86d6-4e70-89cb-ae35f12fa1fa-istiod-ca-cert\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.085245 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.085130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-socket\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.085245 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.085178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-token\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.085354 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.085242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-podinfo\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.085354 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.085269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xwl8\" (UniqueName: \"kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-kube-api-access-7xwl8\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.085354 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.085296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-credential-socket\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.085465 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.085417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-data\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.186066 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.186036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-data\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.186237 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.186076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-envoy\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.186237 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.186095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-certs\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.186237 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.186111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27449689-86d6-4e70-89cb-ae35f12fa1fa-istiod-ca-cert\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.186237 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.186226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-socket\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.186466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.186286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-token\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.186466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.186335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-podinfo\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.186466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.186361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xwl8\" (UniqueName: \"kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-kube-api-access-7xwl8\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.186466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.186394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-credential-socket\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.186733 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.186531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-data\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.186835 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.186813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-certs\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.187025 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.187004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27449689-86d6-4e70-89cb-ae35f12fa1fa-istiod-ca-cert\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.187088 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.187047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-credential-socket\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.187139 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.187107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-socket\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.188540 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.188520    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-envoy\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.189110 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.189093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-podinfo\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.221262 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.221204    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-token\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.225176 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.225148    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xwl8\" (UniqueName: \"kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-kube-api-access-7xwl8\") pod \"e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") " pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.259790 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.259764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:16.564750 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.564722    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"]
Sep 16 14:22:16.564885 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:22:16.564825    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27449689_86d6_4e70_89cb_ae35f12fa1fa.slice/crio-ffdea5bc73fe28add940a04f4dc1a7289242ea794bc579f0820160984ad00961 WatchSource:0}: Error finding container ffdea5bc73fe28add940a04f4dc1a7289242ea794bc579f0820160984ad00961: Status 404 returned error can't find the container with id ffdea5bc73fe28add940a04f4dc1a7289242ea794bc579f0820160984ad00961
Sep 16 14:22:16.567080 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.567047    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:22:16.567178 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.567126    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:22:16.567178 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:16.567171    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:22:17.187086 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:17.187052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" event={"ID":"27449689-86d6-4e70-89cb-ae35f12fa1fa","Type":"ContainerStarted","Data":"157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e"}
Sep 16 14:22:17.187617 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:17.187109    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" event={"ID":"27449689-86d6-4e70-89cb-ae35f12fa1fa","Type":"ContainerStarted","Data":"ffdea5bc73fe28add940a04f4dc1a7289242ea794bc579f0820160984ad00961"}
Sep 16 14:22:17.260203 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:17.260172    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:17.265445 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:17.265421    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:17.309441 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:17.309398    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" podStartSLOduration=2.309383429 podStartE2EDuration="2.309383429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:22:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:22:17.226962546 +0000 UTC m=+1076.526372824" watchObservedRunningTime="2026-09-16 14:22:17.309383429 +0000 UTC m=+1076.608793701"
Sep 16 14:22:18.191995 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:18.191968    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:18.192965 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:18.192947    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:24.027020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.026985    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"]
Sep 16 14:22:24.030538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.030521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.034455 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.034429    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-597ea191-serving-cert\""
Sep 16 14:22:24.062665 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.062640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"]
Sep 16 14:22:24.161406 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.161377    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/114b6629-b180-43b0-a90d-1c116baea55a-openshift-service-ca\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.161623 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.161453    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-maas-api-tls\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.161623 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.161513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-metrics-certs\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.161732 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.161645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4cvf\" (UniqueName: \"kubernetes.io/projected/114b6629-b180-43b0-a90d-1c116baea55a-kube-api-access-c4cvf\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.262313 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.262272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-metrics-certs\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.262495 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.262339    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4cvf\" (UniqueName: \"kubernetes.io/projected/114b6629-b180-43b0-a90d-1c116baea55a-kube-api-access-c4cvf\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.262495 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.262383    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/114b6629-b180-43b0-a90d-1c116baea55a-openshift-service-ca\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.262495 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.262449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-maas-api-tls\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.262684 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:22:24.262640    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-serving-cert: secret "maas-api-e2e-ait-597ea191-serving-cert" not found
Sep 16 14:22:24.262750 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:22:24.262719    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-maas-api-tls podName:114b6629-b180-43b0-a90d-1c116baea55a nodeName:}" failed. No retries permitted until 2026-09-16 14:22:24.762687797 +0000 UTC m=+1084.062098062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-maas-api-tls") pod "maas-api-e2e-ait-597ea191-6d56489b96-tdkbc" (UID: "114b6629-b180-43b0-a90d-1c116baea55a") : secret "maas-api-e2e-ait-597ea191-serving-cert" not found
Sep 16 14:22:24.263181 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.263161    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/114b6629-b180-43b0-a90d-1c116baea55a-openshift-service-ca\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.264860 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.264841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-metrics-certs\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.271595 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.271576    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4cvf\" (UniqueName: \"kubernetes.io/projected/114b6629-b180-43b0-a90d-1c116baea55a-kube-api-access-c4cvf\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.766742 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.766709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-maas-api-tls\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.769009 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.768991    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-maas-api-tls\") pod \"maas-api-e2e-ait-597ea191-6d56489b96-tdkbc\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:24.941196 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:24.941159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:25.247321 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:25.247294    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"]
Sep 16 14:22:25.249234 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:22:25.249202    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114b6629_b180_43b0_a90d_1c116baea55a.slice/crio-0ab99364de9e471f03af85f6106a398f97b8492e7ca28e1b228c9eb2726d10d9 WatchSource:0}: Error finding container 0ab99364de9e471f03af85f6106a398f97b8492e7ca28e1b228c9eb2726d10d9: Status 404 returned error can't find the container with id 0ab99364de9e471f03af85f6106a398f97b8492e7ca28e1b228c9eb2726d10d9
Sep 16 14:22:25.250573 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:25.250533    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:22:26.237035 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:26.237012    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc" event={"ID":"114b6629-b180-43b0-a90d-1c116baea55a","Type":"ContainerStarted","Data":"0ab99364de9e471f03af85f6106a398f97b8492e7ca28e1b228c9eb2726d10d9"}
Sep 16 14:22:27.243800 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:27.243761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc" event={"ID":"114b6629-b180-43b0-a90d-1c116baea55a","Type":"ContainerStarted","Data":"223ba43cf3add396f84f533df0d4ed9f9896ed6631f29fb234c6853f7bcb9cb4"}
Sep 16 14:22:27.244174 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:27.243828    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:27.281129 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:27.281079    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc" podStartSLOduration=3.352932342 podStartE2EDuration="4.281064294s" totalImagesPullingTime="928.131952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:22:27.278872873 +0000 UTC m=+1086.578283142" watchObservedRunningTime="2026-09-16 14:22:27.281064294 +0000 UTC m=+1086.580474561"
Sep 16 14:22:33.254529 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:33.254491    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:22:34.882248 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:34.882217    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"]
Sep 16 14:22:49.234699 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:49.234666    2579 patch_prober.go:28] interesting pod/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 14:22:49.235142 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:49.234725    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 14:22:49.901071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:49.901030    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx" podUID="86abb242-9051-4102-a7a6-c2d00e338f4a" containerName="main" containerID="cri-o://c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040" gracePeriod=45
Sep 16 14:22:50.168713 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.168689    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:22:50.316655 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.316628    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86abb242-9051-4102-a7a6-c2d00e338f4a-tls-certs\") pod \"86abb242-9051-4102-a7a6-c2d00e338f4a\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") "
Sep 16 14:22:50.317071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.316678    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-dshm\") pod \"86abb242-9051-4102-a7a6-c2d00e338f4a\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") "
Sep 16 14:22:50.317071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.316693    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-home\") pod \"86abb242-9051-4102-a7a6-c2d00e338f4a\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") "
Sep 16 14:22:50.317071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.316743    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-model-cache\") pod \"86abb242-9051-4102-a7a6-c2d00e338f4a\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") "
Sep 16 14:22:50.317071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.316772    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-tmp-dir\") pod \"86abb242-9051-4102-a7a6-c2d00e338f4a\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") "
Sep 16 14:22:50.317071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.316811    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrdxc\" (UniqueName: \"kubernetes.io/projected/86abb242-9051-4102-a7a6-c2d00e338f4a-kube-api-access-wrdxc\") pod \"86abb242-9051-4102-a7a6-c2d00e338f4a\" (UID: \"86abb242-9051-4102-a7a6-c2d00e338f4a\") "
Sep 16 14:22:50.317071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.317002    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-home" (OuterVolumeSpecName: "home") pod "86abb242-9051-4102-a7a6-c2d00e338f4a" (UID: "86abb242-9051-4102-a7a6-c2d00e338f4a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:22:50.317071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.317035    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-model-cache" (OuterVolumeSpecName: "model-cache") pod "86abb242-9051-4102-a7a6-c2d00e338f4a" (UID: "86abb242-9051-4102-a7a6-c2d00e338f4a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:22:50.317478 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.317080    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "86abb242-9051-4102-a7a6-c2d00e338f4a" (UID: "86abb242-9051-4102-a7a6-c2d00e338f4a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:22:50.317478 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.317216    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-home\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:22:50.317478 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.317236    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-model-cache\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:22:50.317478 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.317251    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-tmp-dir\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:22:50.318953 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.318930    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86abb242-9051-4102-a7a6-c2d00e338f4a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "86abb242-9051-4102-a7a6-c2d00e338f4a" (UID: "86abb242-9051-4102-a7a6-c2d00e338f4a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:22:50.319047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.318971    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-dshm" (OuterVolumeSpecName: "dshm") pod "86abb242-9051-4102-a7a6-c2d00e338f4a" (UID: "86abb242-9051-4102-a7a6-c2d00e338f4a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:22:50.319047 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.319011    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86abb242-9051-4102-a7a6-c2d00e338f4a-kube-api-access-wrdxc" (OuterVolumeSpecName: "kube-api-access-wrdxc") pod "86abb242-9051-4102-a7a6-c2d00e338f4a" (UID: "86abb242-9051-4102-a7a6-c2d00e338f4a"). InnerVolumeSpecName "kube-api-access-wrdxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:22:50.365416 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.365393    2579 generic.go:356] "Generic (PLEG): container finished" podID="86abb242-9051-4102-a7a6-c2d00e338f4a" containerID="c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040" exitCode=0
Sep 16 14:22:50.365520 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.365435    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"
Sep 16 14:22:50.365520 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.365477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx" event={"ID":"86abb242-9051-4102-a7a6-c2d00e338f4a","Type":"ContainerDied","Data":"c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040"}
Sep 16 14:22:50.365662 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.365523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx" event={"ID":"86abb242-9051-4102-a7a6-c2d00e338f4a","Type":"ContainerDied","Data":"d78b2a9ca9fb6248b9ba30b1d06cc209f3c07fb2763d7befded54a44a64392d8"}
Sep 16 14:22:50.365662 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.365563    2579 scope.go:117] "RemoveContainer" containerID="c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040"
Sep 16 14:22:50.367256 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.367235    2579 generic.go:356] "Generic (PLEG): container finished" podID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerID="157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e" exitCode=0
Sep 16 14:22:50.367354 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.367289    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" event={"ID":"27449689-86d6-4e70-89cb-ae35f12fa1fa","Type":"ContainerDied","Data":"157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e"}
Sep 16 14:22:50.367702 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.367684    2579 scope.go:117] "RemoveContainer" containerID="157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e"
Sep 16 14:22:50.368788 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.368762    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:22:50.368888 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.368862    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:22:50.368956 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.368920    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:22:50.374676 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.374658    2579 scope.go:117] "RemoveContainer" containerID="c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040"
Sep 16 14:22:50.374958 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:22:50.374941    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040\": container with ID starting with c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040 not found: ID does not exist" containerID="c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040"
Sep 16 14:22:50.375024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.374970    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040"} err="failed to get container status \"c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040\": rpc error: code = NotFound desc = could not find container \"c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040\": container with ID starting with c0891cbffc4d56055a38e5099a7c3c5597e3d6ab6d2d84e8731cbc8a3e89e040 not found: ID does not exist"
Sep 16 14:22:50.406313 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.406261    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"]
Sep 16 14:22:50.414348 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.414327    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-e24c87/test-model-e24c87-kserve-5c98bf65c9-64xtx"]
Sep 16 14:22:50.417808 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.417788    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86abb242-9051-4102-a7a6-c2d00e338f4a-tls-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:22:50.417808 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.417808    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86abb242-9051-4102-a7a6-c2d00e338f4a-dshm\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:22:50.417960 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:50.417816    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrdxc\" (UniqueName: \"kubernetes.io/projected/86abb242-9051-4102-a7a6-c2d00e338f4a-kube-api-access-wrdxc\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:22:51.118472 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:51.118435    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86abb242-9051-4102-a7a6-c2d00e338f4a" path="/var/lib/kubelet/pods/86abb242-9051-4102-a7a6-c2d00e338f4a/volumes"
Sep 16 14:22:51.376689 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:51.376605    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" event={"ID":"27449689-86d6-4e70-89cb-ae35f12fa1fa","Type":"ContainerStarted","Data":"48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4"}
Sep 16 14:22:52.260416 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:52.260382    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:52.260633 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:52.260611    2579 patch_prober.go:28] interesting pod/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 16 14:22:52.260690 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:52.260658    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 16 14:22:53.260236 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:53.260197    2579 patch_prober.go:28] interesting pod/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 16 14:22:53.260639 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:53.260264    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 16 14:22:54.260906 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:54.260871    2579 patch_prober.go:28] interesting pod/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 16 14:22:54.261273 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:54.260937    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 16 14:22:55.260813 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:55.260780    2579 patch_prober.go:28] interesting pod/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 16 14:22:55.260986 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:55.260829    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 16 14:22:56.260894 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:56.260857    2579 patch_prober.go:28] interesting pod/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 16 14:22:56.261066 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:56.260909    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 16 14:22:57.264369 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:57.264340    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:57.264757 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:57.264675    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:22:57.265178 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:22:57.265159    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:23:01.287703 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.287662    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"]
Sep 16 14:23:01.288187 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.287918    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc" podUID="114b6629-b180-43b0-a90d-1c116baea55a" containerName="maas-api" containerID="cri-o://223ba43cf3add396f84f533df0d4ed9f9896ed6631f29fb234c6853f7bcb9cb4" gracePeriod=30
Sep 16 14:23:01.441503 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.441471    2579 generic.go:356] "Generic (PLEG): container finished" podID="114b6629-b180-43b0-a90d-1c116baea55a" containerID="223ba43cf3add396f84f533df0d4ed9f9896ed6631f29fb234c6853f7bcb9cb4" exitCode=0
Sep 16 14:23:01.441729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.441665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc" event={"ID":"114b6629-b180-43b0-a90d-1c116baea55a","Type":"ContainerDied","Data":"223ba43cf3add396f84f533df0d4ed9f9896ed6631f29fb234c6853f7bcb9cb4"}
Sep 16 14:23:01.552270 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.552214    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:23:01.626168 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.626110    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-metrics-certs\") pod \"114b6629-b180-43b0-a90d-1c116baea55a\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") "
Sep 16 14:23:01.626345 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.626220    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-maas-api-tls\") pod \"114b6629-b180-43b0-a90d-1c116baea55a\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") "
Sep 16 14:23:01.626345 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.626261    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/114b6629-b180-43b0-a90d-1c116baea55a-openshift-service-ca\") pod \"114b6629-b180-43b0-a90d-1c116baea55a\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") "
Sep 16 14:23:01.626345 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.626283    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4cvf\" (UniqueName: \"kubernetes.io/projected/114b6629-b180-43b0-a90d-1c116baea55a-kube-api-access-c4cvf\") pod \"114b6629-b180-43b0-a90d-1c116baea55a\" (UID: \"114b6629-b180-43b0-a90d-1c116baea55a\") "
Sep 16 14:23:01.626807 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.626741    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/114b6629-b180-43b0-a90d-1c116baea55a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "114b6629-b180-43b0-a90d-1c116baea55a" (UID: "114b6629-b180-43b0-a90d-1c116baea55a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:23:01.628939 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.628894    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "114b6629-b180-43b0-a90d-1c116baea55a" (UID: "114b6629-b180-43b0-a90d-1c116baea55a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:23:01.629234 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.629202    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "114b6629-b180-43b0-a90d-1c116baea55a" (UID: "114b6629-b180-43b0-a90d-1c116baea55a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:23:01.629360 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.629270    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/114b6629-b180-43b0-a90d-1c116baea55a-kube-api-access-c4cvf" (OuterVolumeSpecName: "kube-api-access-c4cvf") pod "114b6629-b180-43b0-a90d-1c116baea55a" (UID: "114b6629-b180-43b0-a90d-1c116baea55a"). InnerVolumeSpecName "kube-api-access-c4cvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:01.727788 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.727755    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:01.727788 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.727783    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114b6629-b180-43b0-a90d-1c116baea55a-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:01.727957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.727796    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/114b6629-b180-43b0-a90d-1c116baea55a-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:01.727957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:01.727808    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4cvf\" (UniqueName: \"kubernetes.io/projected/114b6629-b180-43b0-a90d-1c116baea55a-kube-api-access-c4cvf\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:02.448478 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:02.448448    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"
Sep 16 14:23:02.448898 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:02.448490    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc" event={"ID":"114b6629-b180-43b0-a90d-1c116baea55a","Type":"ContainerDied","Data":"0ab99364de9e471f03af85f6106a398f97b8492e7ca28e1b228c9eb2726d10d9"}
Sep 16 14:23:02.448898 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:02.448582    2579 scope.go:117] "RemoveContainer" containerID="223ba43cf3add396f84f533df0d4ed9f9896ed6631f29fb234c6853f7bcb9cb4"
Sep 16 14:23:02.462806 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:02.462783    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"]
Sep 16 14:23:02.462978 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:02.462941    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy" containerID="cri-o://48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4" gracePeriod=30
Sep 16 14:23:02.577632 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:02.577594    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"]
Sep 16 14:23:02.588993 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:02.588970    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-597ea191-6d56489b96-tdkbc"]
Sep 16 14:23:03.117116 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.117082    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="114b6629-b180-43b0-a90d-1c116baea55a" path="/var/lib/kubelet/pods/114b6629-b180-43b0-a90d-1c116baea55a/volumes"
Sep 16 14:23:03.785661 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.785627    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"]
Sep 16 14:23:03.786190 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.786170    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="114b6629-b180-43b0-a90d-1c116baea55a" containerName="maas-api"
Sep 16 14:23:03.786275 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.786193    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="114b6629-b180-43b0-a90d-1c116baea55a" containerName="maas-api"
Sep 16 14:23:03.786275 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.786212    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86abb242-9051-4102-a7a6-c2d00e338f4a" containerName="main"
Sep 16 14:23:03.786275 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.786222    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86abb242-9051-4102-a7a6-c2d00e338f4a" containerName="main"
Sep 16 14:23:03.786429 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.786335    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="114b6629-b180-43b0-a90d-1c116baea55a" containerName="maas-api"
Sep 16 14:23:03.786429 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.786350    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="86abb242-9051-4102-a7a6-c2d00e338f4a" containerName="main"
Sep 16 14:23:03.791114 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.791092    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:03.797815 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.797708    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e5e410b2-gw-openshift-default-dockercfg-q8pcx\""
Sep 16 14:23:03.914448 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.914414    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"]
Sep 16 14:23:03.949631 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.949597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-credential-socket\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:03.949798 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.949650    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-socket\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:03.949798 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.949710    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa85b139-6112-49b2-af94-132072c16853-istiod-ca-cert\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:03.949798 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.949778    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-data\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:03.949939 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.949820    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-envoy\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:03.949939 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.949852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7k9x\" (UniqueName: \"kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-kube-api-access-n7k9x\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:03.949939 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.949871    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-istio-token\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:03.949939 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.949914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-certs\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:03.950115 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:03.949959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa85b139-6112-49b2-af94-132072c16853-istio-podinfo\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.051406 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-data\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.051406 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-envoy\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.051645 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7k9x\" (UniqueName: \"kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-kube-api-access-n7k9x\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.051645 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-istio-token\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.051645 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-certs\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.051645 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa85b139-6112-49b2-af94-132072c16853-istio-podinfo\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.051645 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-credential-socket\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.051645 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-socket\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.051645 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa85b139-6112-49b2-af94-132072c16853-istiod-ca-cert\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.052041 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051772    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-data\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.052041 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051920    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-credential-socket\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.052041 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.051985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-socket\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.052165 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.052106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-certs\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.052449 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.052426    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa85b139-6112-49b2-af94-132072c16853-istiod-ca-cert\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.053611 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.053590    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-envoy\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.054004 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.053983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa85b139-6112-49b2-af94-132072c16853-istio-podinfo\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.083384 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.083358    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7k9x\" (UniqueName: \"kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-kube-api-access-n7k9x\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.103590 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.103565    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-istio-token\") pod \"e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") " pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.401920 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.401887    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:04.701153 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.701126    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"]
Sep 16 14:23:04.702719 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:23:04.702695    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa85b139_6112_49b2_af94_132072c16853.slice/crio-b50979810a1cf37b4d909531fce126c9060110653ad2d5911a66c8fa4f2c3e3f WatchSource:0}: Error finding container b50979810a1cf37b4d909531fce126c9060110653ad2d5911a66c8fa4f2c3e3f: Status 404 returned error can't find the container with id b50979810a1cf37b4d909531fce126c9060110653ad2d5911a66c8fa4f2c3e3f
Sep 16 14:23:04.705079 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.705042    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:04.705183 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.705129    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:04.705183 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:04.705160    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:05.471654 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:05.471616    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw" event={"ID":"aa85b139-6112-49b2-af94-132072c16853","Type":"ContainerStarted","Data":"30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e"}
Sep 16 14:23:05.472048 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:05.471670    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw" event={"ID":"aa85b139-6112-49b2-af94-132072c16853","Type":"ContainerStarted","Data":"b50979810a1cf37b4d909531fce126c9060110653ad2d5911a66c8fa4f2c3e3f"}
Sep 16 14:23:05.521284 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:05.521228    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw" podStartSLOduration=2.521209294 podStartE2EDuration="2.521209294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:23:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:23:05.518434373 +0000 UTC m=+1124.817844641" watchObservedRunningTime="2026-09-16 14:23:05.521209294 +0000 UTC m=+1124.820619563"
Sep 16 14:23:06.403069 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:06.403034    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:06.407851 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:06.407826    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:06.476675 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:06.476645    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:06.477533 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:06.477513    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:07.726126 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.726069    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:23:07.888395 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.888361    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-data\") pod \"27449689-86d6-4e70-89cb-ae35f12fa1fa\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") "
Sep 16 14:23:07.888395 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.888394    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-token\") pod \"27449689-86d6-4e70-89cb-ae35f12fa1fa\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") "
Sep 16 14:23:07.888680 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.888414    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-podinfo\") pod \"27449689-86d6-4e70-89cb-ae35f12fa1fa\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") "
Sep 16 14:23:07.888680 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.888442    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-envoy\") pod \"27449689-86d6-4e70-89cb-ae35f12fa1fa\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") "
Sep 16 14:23:07.888680 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.888470    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-credential-socket\") pod \"27449689-86d6-4e70-89cb-ae35f12fa1fa\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") "
Sep 16 14:23:07.888680 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.888496    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-certs\") pod \"27449689-86d6-4e70-89cb-ae35f12fa1fa\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") "
Sep 16 14:23:07.888680 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.888644    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-socket\") pod \"27449689-86d6-4e70-89cb-ae35f12fa1fa\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") "
Sep 16 14:23:07.888680 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.888678    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27449689-86d6-4e70-89cb-ae35f12fa1fa-istiod-ca-cert\") pod \"27449689-86d6-4e70-89cb-ae35f12fa1fa\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") "
Sep 16 14:23:07.889003 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.888708    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xwl8\" (UniqueName: \"kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-kube-api-access-7xwl8\") pod \"27449689-86d6-4e70-89cb-ae35f12fa1fa\" (UID: \"27449689-86d6-4e70-89cb-ae35f12fa1fa\") "
Sep 16 14:23:07.889003 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.888717    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "27449689-86d6-4e70-89cb-ae35f12fa1fa" (UID: "27449689-86d6-4e70-89cb-ae35f12fa1fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:07.889003 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.888861    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "27449689-86d6-4e70-89cb-ae35f12fa1fa" (UID: "27449689-86d6-4e70-89cb-ae35f12fa1fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:07.889160 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.889046    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "27449689-86d6-4e70-89cb-ae35f12fa1fa" (UID: "27449689-86d6-4e70-89cb-ae35f12fa1fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:07.889160 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.889108    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "27449689-86d6-4e70-89cb-ae35f12fa1fa" (UID: "27449689-86d6-4e70-89cb-ae35f12fa1fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:07.889160 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.889152    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27449689-86d6-4e70-89cb-ae35f12fa1fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "27449689-86d6-4e70-89cb-ae35f12fa1fa" (UID: "27449689-86d6-4e70-89cb-ae35f12fa1fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:23:07.889321 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.889159    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-data\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:07.889321 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.889177    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-credential-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:07.889321 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.889188    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:07.890878 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.890850    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "27449689-86d6-4e70-89cb-ae35f12fa1fa" (UID: "27449689-86d6-4e70-89cb-ae35f12fa1fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:23:07.891016 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.890889    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "27449689-86d6-4e70-89cb-ae35f12fa1fa" (UID: "27449689-86d6-4e70-89cb-ae35f12fa1fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:07.891100 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.891084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-kube-api-access-7xwl8" (OuterVolumeSpecName: "kube-api-access-7xwl8") pod "27449689-86d6-4e70-89cb-ae35f12fa1fa" (UID: "27449689-86d6-4e70-89cb-ae35f12fa1fa"). InnerVolumeSpecName "kube-api-access-7xwl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:07.891168 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.891098    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "27449689-86d6-4e70-89cb-ae35f12fa1fa" (UID: "27449689-86d6-4e70-89cb-ae35f12fa1fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:07.990145 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.990062    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-workload-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:07.990145 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.990088    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27449689-86d6-4e70-89cb-ae35f12fa1fa-istiod-ca-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:07.990145 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.990100    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xwl8\" (UniqueName: \"kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-kube-api-access-7xwl8\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:07.990145 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.990108    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:07.990145 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.990116    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-podinfo\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:07.990145 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:07.990124    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27449689-86d6-4e70-89cb-ae35f12fa1fa-istio-envoy\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:08.488247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.488213    2579 generic.go:356] "Generic (PLEG): container finished" podID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerID="48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4" exitCode=0
Sep 16 14:23:08.488424 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.488262    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"
Sep 16 14:23:08.488424 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.488298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" event={"ID":"27449689-86d6-4e70-89cb-ae35f12fa1fa","Type":"ContainerDied","Data":"48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4"}
Sep 16 14:23:08.488424 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.488358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb" event={"ID":"27449689-86d6-4e70-89cb-ae35f12fa1fa","Type":"ContainerDied","Data":"ffdea5bc73fe28add940a04f4dc1a7289242ea794bc579f0820160984ad00961"}
Sep 16 14:23:08.488424 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.488391    2579 scope.go:117] "RemoveContainer" containerID="48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4"
Sep 16 14:23:08.498371 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.498354    2579 scope.go:117] "RemoveContainer" containerID="157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e"
Sep 16 14:23:08.506441 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.506426    2579 scope.go:117] "RemoveContainer" containerID="48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4"
Sep 16 14:23:08.506685 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:08.506668    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4\": container with ID starting with 48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4 not found: ID does not exist" containerID="48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4"
Sep 16 14:23:08.506733 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.506691    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4"} err="failed to get container status \"48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4\": rpc error: code = NotFound desc = could not find container \"48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4\": container with ID starting with 48dbf1310ca5a7fd252fb1f918e6291d8a57cd5e4e16635d22bd5de76e81f6a4 not found: ID does not exist"
Sep 16 14:23:08.506733 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.506705    2579 scope.go:117] "RemoveContainer" containerID="157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e"
Sep 16 14:23:08.506983 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:08.506964    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e\": container with ID starting with 157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e not found: ID does not exist" containerID="157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e"
Sep 16 14:23:08.507027 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.506988    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e"} err="failed to get container status \"157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e\": rpc error: code = NotFound desc = could not find container \"157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e\": container with ID starting with 157f1c5c58265fca2edd80f91e359f0c1427574db59c865850fc342d3d83776e not found: ID does not exist"
Sep 16 14:23:08.549706 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.549677    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"]
Sep 16 14:23:08.558210 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:08.558185    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-597ea191-openshift-default-67b59c85c6-ctzlb"]
Sep 16 14:23:09.016046 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:09.016013    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"]
Sep 16 14:23:09.117523 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:09.117484    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" path="/var/lib/kubelet/pods/27449689-86d6-4e70-89cb-ae35f12fa1fa/volumes"
Sep 16 14:23:11.701011 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.700975    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"]
Sep 16 14:23:11.701384 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.701351    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy"
Sep 16 14:23:11.701384 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.701362    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy"
Sep 16 14:23:11.701384 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.701372    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy"
Sep 16 14:23:11.701384 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.701378    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy"
Sep 16 14:23:11.701565 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.701440    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy"
Sep 16 14:23:11.705681 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.705665    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:11.709052 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.709030    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-e5e410b2-serving-cert\""
Sep 16 14:23:11.782242 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.782209    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"]
Sep 16 14:23:11.826949 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.826917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-openshift-service-ca\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:11.826949 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.826951    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgcln\" (UniqueName: \"kubernetes.io/projected/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-kube-api-access-lgcln\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:11.827143 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.827034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-metrics-certs\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:11.827143 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.827136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-maas-api-tls\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:11.928019 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.927986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-metrics-certs\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:11.928166 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.928054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-maas-api-tls\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:11.928166 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.928075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-openshift-service-ca\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:11.928166 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.928098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgcln\" (UniqueName: \"kubernetes.io/projected/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-kube-api-access-lgcln\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:11.928308 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:11.928187    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-serving-cert: secret "maas-api-e2e-migrate-e5e410b2-serving-cert" not found
Sep 16 14:23:11.928308 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:11.928245    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-maas-api-tls podName:2349307d-ea97-4a15-b42a-6c67b8c3f9f7 nodeName:}" failed. No retries permitted until 2026-09-16 14:23:12.428231339 +0000 UTC m=+1131.727641584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-maas-api-tls") pod "maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68" (UID: "2349307d-ea97-4a15-b42a-6c67b8c3f9f7") : secret "maas-api-e2e-migrate-e5e410b2-serving-cert" not found
Sep 16 14:23:11.928791 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.928775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-openshift-service-ca\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:11.930419 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.930396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-metrics-certs\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:11.947504 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:11.947477    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgcln\" (UniqueName: \"kubernetes.io/projected/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-kube-api-access-lgcln\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:12.433777 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:12.433743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-maas-api-tls\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:12.436095 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:12.436072    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-maas-api-tls\") pod \"maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:12.615720 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:12.615683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:12.942094 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:12.942070    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"]
Sep 16 14:23:12.944140 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:23:12.944114    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2349307d_ea97_4a15_b42a_6c67b8c3f9f7.slice/crio-aa5dd2ec82524b1635118997c887d56ce9c08cdbc911282b11ecc7e9f0e28fa3 WatchSource:0}: Error finding container aa5dd2ec82524b1635118997c887d56ce9c08cdbc911282b11ecc7e9f0e28fa3: Status 404 returned error can't find the container with id aa5dd2ec82524b1635118997c887d56ce9c08cdbc911282b11ecc7e9f0e28fa3
Sep 16 14:23:13.516283 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:13.516256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68" event={"ID":"2349307d-ea97-4a15-b42a-6c67b8c3f9f7","Type":"ContainerStarted","Data":"c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0"}
Sep 16 14:23:13.516412 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:13.516305    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68" event={"ID":"2349307d-ea97-4a15-b42a-6c67b8c3f9f7","Type":"ContainerStarted","Data":"aa5dd2ec82524b1635118997c887d56ce9c08cdbc911282b11ecc7e9f0e28fa3"}
Sep 16 14:23:13.516412 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:13.516407    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:16.744373 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:16.744313    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68" podStartSLOduration=5.251369687 podStartE2EDuration="5.744295687s" totalImagesPullingTime="492.926ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:23:13.56201719 +0000 UTC m=+1132.861427457" watchObservedRunningTime="2026-09-16 14:23:16.744295687 +0000 UTC m=+1136.043705956"
Sep 16 14:23:16.744822 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:16.744465    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"]
Sep 16 14:23:16.744822 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:16.744738    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8" podUID="fb49c0b4-6990-4253-bda6-79526a569cfc" containerName="maas-api" containerID="cri-o://1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205" gracePeriod=30
Sep 16 14:23:17.011110 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.011086    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:23:17.078593 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.078564    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzndk\" (UniqueName: \"kubernetes.io/projected/fb49c0b4-6990-4253-bda6-79526a569cfc-kube-api-access-wzndk\") pod \"fb49c0b4-6990-4253-bda6-79526a569cfc\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") "
Sep 16 14:23:17.078725 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.078638    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-maas-api-tls\") pod \"fb49c0b4-6990-4253-bda6-79526a569cfc\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") "
Sep 16 14:23:17.078725 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.078668    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb49c0b4-6990-4253-bda6-79526a569cfc-openshift-service-ca\") pod \"fb49c0b4-6990-4253-bda6-79526a569cfc\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") "
Sep 16 14:23:17.078725 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.078686    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-metrics-certs\") pod \"fb49c0b4-6990-4253-bda6-79526a569cfc\" (UID: \"fb49c0b4-6990-4253-bda6-79526a569cfc\") "
Sep 16 14:23:17.079060 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.079030    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb49c0b4-6990-4253-bda6-79526a569cfc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb49c0b4-6990-4253-bda6-79526a569cfc" (UID: "fb49c0b4-6990-4253-bda6-79526a569cfc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:23:17.080791 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.080752    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fb49c0b4-6990-4253-bda6-79526a569cfc" (UID: "fb49c0b4-6990-4253-bda6-79526a569cfc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:23:17.080896 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.080845    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb49c0b4-6990-4253-bda6-79526a569cfc" (UID: "fb49c0b4-6990-4253-bda6-79526a569cfc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:23:17.080896 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.080877    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb49c0b4-6990-4253-bda6-79526a569cfc-kube-api-access-wzndk" (OuterVolumeSpecName: "kube-api-access-wzndk") pod "fb49c0b4-6990-4253-bda6-79526a569cfc" (UID: "fb49c0b4-6990-4253-bda6-79526a569cfc"). InnerVolumeSpecName "kube-api-access-wzndk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:17.180330 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.180301    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzndk\" (UniqueName: \"kubernetes.io/projected/fb49c0b4-6990-4253-bda6-79526a569cfc-kube-api-access-wzndk\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:17.180330 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.180332    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:17.180565 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.180346    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb49c0b4-6990-4253-bda6-79526a569cfc-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:17.180565 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.180359    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb49c0b4-6990-4253-bda6-79526a569cfc-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:17.538109 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.538074    2579 generic.go:356] "Generic (PLEG): container finished" podID="fb49c0b4-6990-4253-bda6-79526a569cfc" containerID="1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205" exitCode=0
Sep 16 14:23:17.538302 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.538121    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"
Sep 16 14:23:17.538302 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.538165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8" event={"ID":"fb49c0b4-6990-4253-bda6-79526a569cfc","Type":"ContainerDied","Data":"1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205"}
Sep 16 14:23:17.538302 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.538233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8" event={"ID":"fb49c0b4-6990-4253-bda6-79526a569cfc","Type":"ContainerDied","Data":"f80dad5838ca73040d529bfcb24f368d2c552543177357eb4dcc7bcb87da2935"}
Sep 16 14:23:17.538302 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.538263    2579 scope.go:117] "RemoveContainer" containerID="1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205"
Sep 16 14:23:17.547089 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.547072    2579 scope.go:117] "RemoveContainer" containerID="1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205"
Sep 16 14:23:17.547350 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:17.547335    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205\": container with ID starting with 1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205 not found: ID does not exist" containerID="1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205"
Sep 16 14:23:17.547391 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.547358    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205"} err="failed to get container status \"1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205\": rpc error: code = NotFound desc = could not find container \"1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205\": container with ID starting with 1360e5b424322f9583e313be1a65ae9c56b24a992b444b9ec858713f8c2cf205 not found: ID does not exist"
Sep 16 14:23:17.573264 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.573236    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"]
Sep 16 14:23:17.579847 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:17.579823    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e24c87-54d4765d48-77mr8"]
Sep 16 14:23:19.116740 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:19.116703    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb49c0b4-6990-4253-bda6-79526a569cfc" path="/var/lib/kubelet/pods/fb49c0b4-6990-4253-bda6-79526a569cfc/volumes"
Sep 16 14:23:19.526897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:19.526867    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:24.035418 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.035355    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7" podUID="ff83f387-ef10-4819-9d10-4ea5d38c84fe" containerName="main" containerID="cri-o://1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a" gracePeriod=45
Sep 16 14:23:24.275534 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.275509    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:23:24.347029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.346957    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-model-cache\") pod \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") "
Sep 16 14:23:24.347029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.347003    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tmp-dir\") pod \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") "
Sep 16 14:23:24.347198 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.347083    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkxvw\" (UniqueName: \"kubernetes.io/projected/ff83f387-ef10-4819-9d10-4ea5d38c84fe-kube-api-access-xkxvw\") pod \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") "
Sep 16 14:23:24.347198 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.347119    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-home\") pod \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") "
Sep 16 14:23:24.347198 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.347178    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-dshm\") pod \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") "
Sep 16 14:23:24.347355 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.347229    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tls-certs\") pod \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\" (UID: \"ff83f387-ef10-4819-9d10-4ea5d38c84fe\") "
Sep 16 14:23:24.347355 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.347252    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "ff83f387-ef10-4819-9d10-4ea5d38c84fe" (UID: "ff83f387-ef10-4819-9d10-4ea5d38c84fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:24.347355 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.347307    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ff83f387-ef10-4819-9d10-4ea5d38c84fe" (UID: "ff83f387-ef10-4819-9d10-4ea5d38c84fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:24.347525 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.347391    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-home" (OuterVolumeSpecName: "home") pod "ff83f387-ef10-4819-9d10-4ea5d38c84fe" (UID: "ff83f387-ef10-4819-9d10-4ea5d38c84fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:24.347655 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.347579    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-home\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:24.347655 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.347593    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-model-cache\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:24.347655 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.347603    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tmp-dir\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:24.349311 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.349285    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff83f387-ef10-4819-9d10-4ea5d38c84fe-kube-api-access-xkxvw" (OuterVolumeSpecName: "kube-api-access-xkxvw") pod "ff83f387-ef10-4819-9d10-4ea5d38c84fe" (UID: "ff83f387-ef10-4819-9d10-4ea5d38c84fe"). InnerVolumeSpecName "kube-api-access-xkxvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:24.349416 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.349357    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ff83f387-ef10-4819-9d10-4ea5d38c84fe" (UID: "ff83f387-ef10-4819-9d10-4ea5d38c84fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:23:24.349462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.349432    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-dshm" (OuterVolumeSpecName: "dshm") pod "ff83f387-ef10-4819-9d10-4ea5d38c84fe" (UID: "ff83f387-ef10-4819-9d10-4ea5d38c84fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:24.449159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.449131    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff83f387-ef10-4819-9d10-4ea5d38c84fe-dshm\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:24.449159 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.449158    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff83f387-ef10-4819-9d10-4ea5d38c84fe-tls-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:24.449341 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.449171    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkxvw\" (UniqueName: \"kubernetes.io/projected/ff83f387-ef10-4819-9d10-4ea5d38c84fe-kube-api-access-xkxvw\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:24.575958 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.575924    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff83f387-ef10-4819-9d10-4ea5d38c84fe" containerID="1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a" exitCode=0
Sep 16 14:23:24.576137 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.575969    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"
Sep 16 14:23:24.576137 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.575963    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7" event={"ID":"ff83f387-ef10-4819-9d10-4ea5d38c84fe","Type":"ContainerDied","Data":"1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a"}
Sep 16 14:23:24.576137 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.576080    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7" event={"ID":"ff83f387-ef10-4819-9d10-4ea5d38c84fe","Type":"ContainerDied","Data":"a051b7a73afdbbb01761de7da89093eccf24a44dd4bf9daab61792abca1f26ac"}
Sep 16 14:23:24.576137 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.576097    2579 scope.go:117] "RemoveContainer" containerID="1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a"
Sep 16 14:23:24.584927 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.584911    2579 scope.go:117] "RemoveContainer" containerID="1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a"
Sep 16 14:23:24.585189 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:24.585173    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a\": container with ID starting with 1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a not found: ID does not exist" containerID="1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a"
Sep 16 14:23:24.585231 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.585198    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a"} err="failed to get container status \"1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a\": rpc error: code = NotFound desc = could not find container \"1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a\": container with ID starting with 1acd0ff5926bcb96d4558710cc924e810f2cec235f48b4ba000d988b98ade85a not found: ID does not exist"
Sep 16 14:23:24.614050 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.613988    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"]
Sep 16 14:23:24.626438 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:24.626414    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-46e82d/test-model-46e82d-kserve-867877659f-hqzw7"]
Sep 16 14:23:25.117347 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:25.117309    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff83f387-ef10-4819-9d10-4ea5d38c84fe" path="/var/lib/kubelet/pods/ff83f387-ef10-4819-9d10-4ea5d38c84fe/volumes"
Sep 16 14:23:37.639709 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:37.639674    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"]
Sep 16 14:23:37.640189 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:37.639928    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68" podUID="2349307d-ea97-4a15-b42a-6c67b8c3f9f7" containerName="maas-api" containerID="cri-o://c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0" gracePeriod=30
Sep 16 14:23:37.921571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:37.916295    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"]
Sep 16 14:23:37.921571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:37.916562    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd" podUID="e3d12beb-cdf8-422d-be76-30fa894f4130" containerName="maas-api" containerID="cri-o://6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6" gracePeriod=30
Sep 16 14:23:38.008051 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.007778    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:38.070646 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.070615    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgcln\" (UniqueName: \"kubernetes.io/projected/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-kube-api-access-lgcln\") pod \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") "
Sep 16 14:23:38.070646 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.070652    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-maas-api-tls\") pod \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") "
Sep 16 14:23:38.070906 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.070730    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-openshift-service-ca\") pod \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") "
Sep 16 14:23:38.070906 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.070763    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-metrics-certs\") pod \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\" (UID: \"2349307d-ea97-4a15-b42a-6c67b8c3f9f7\") "
Sep 16 14:23:38.071282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.071243    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2349307d-ea97-4a15-b42a-6c67b8c3f9f7" (UID: "2349307d-ea97-4a15-b42a-6c67b8c3f9f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:23:38.074712 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.074669    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2349307d-ea97-4a15-b42a-6c67b8c3f9f7" (UID: "2349307d-ea97-4a15-b42a-6c67b8c3f9f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:23:38.075260 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.075235    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-kube-api-access-lgcln" (OuterVolumeSpecName: "kube-api-access-lgcln") pod "2349307d-ea97-4a15-b42a-6c67b8c3f9f7" (UID: "2349307d-ea97-4a15-b42a-6c67b8c3f9f7"). InnerVolumeSpecName "kube-api-access-lgcln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:38.076991 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.076955    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2349307d-ea97-4a15-b42a-6c67b8c3f9f7" (UID: "2349307d-ea97-4a15-b42a-6c67b8c3f9f7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:23:38.171819 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.171725    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:38.171819 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.171762    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:38.171819 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.171776    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgcln\" (UniqueName: \"kubernetes.io/projected/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-kube-api-access-lgcln\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:38.171819 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.171788    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2349307d-ea97-4a15-b42a-6c67b8c3f9f7-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:38.219343 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.219308    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:23:38.274784 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.272722    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffdpg\" (UniqueName: \"kubernetes.io/projected/e3d12beb-cdf8-422d-be76-30fa894f4130-kube-api-access-ffdpg\") pod \"e3d12beb-cdf8-422d-be76-30fa894f4130\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") "
Sep 16 14:23:38.274784 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.272845    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-maas-api-tls\") pod \"e3d12beb-cdf8-422d-be76-30fa894f4130\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") "
Sep 16 14:23:38.274784 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.272899    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-metrics-certs\") pod \"e3d12beb-cdf8-422d-be76-30fa894f4130\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") "
Sep 16 14:23:38.274784 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.272927    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3d12beb-cdf8-422d-be76-30fa894f4130-openshift-service-ca\") pod \"e3d12beb-cdf8-422d-be76-30fa894f4130\" (UID: \"e3d12beb-cdf8-422d-be76-30fa894f4130\") "
Sep 16 14:23:38.274784 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.273801    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d12beb-cdf8-422d-be76-30fa894f4130-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e3d12beb-cdf8-422d-be76-30fa894f4130" (UID: "e3d12beb-cdf8-422d-be76-30fa894f4130"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:23:38.279167 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.277259    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e3d12beb-cdf8-422d-be76-30fa894f4130" (UID: "e3d12beb-cdf8-422d-be76-30fa894f4130"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:23:38.282068 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.282026    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d12beb-cdf8-422d-be76-30fa894f4130-kube-api-access-ffdpg" (OuterVolumeSpecName: "kube-api-access-ffdpg") pod "e3d12beb-cdf8-422d-be76-30fa894f4130" (UID: "e3d12beb-cdf8-422d-be76-30fa894f4130"). InnerVolumeSpecName "kube-api-access-ffdpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:38.282324 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.282294    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e3d12beb-cdf8-422d-be76-30fa894f4130" (UID: "e3d12beb-cdf8-422d-be76-30fa894f4130"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:23:38.293897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.293853    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"]
Sep 16 14:23:38.296669 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.294079    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw" podUID="aa85b139-6112-49b2-af94-132072c16853" containerName="istio-proxy" containerID="cri-o://30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e" gracePeriod=30
Sep 16 14:23:38.374100 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.374065    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:38.374100 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.374094    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d12beb-cdf8-422d-be76-30fa894f4130-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:38.374289 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.374107    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3d12beb-cdf8-422d-be76-30fa894f4130-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:38.374289 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.374120    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffdpg\" (UniqueName: \"kubernetes.io/projected/e3d12beb-cdf8-422d-be76-30fa894f4130-kube-api-access-ffdpg\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:38.654739 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.654693    2579 generic.go:356] "Generic (PLEG): container finished" podID="2349307d-ea97-4a15-b42a-6c67b8c3f9f7" containerID="c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0" exitCode=0
Sep 16 14:23:38.655230 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.654859    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68" event={"ID":"2349307d-ea97-4a15-b42a-6c67b8c3f9f7","Type":"ContainerDied","Data":"c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0"}
Sep 16 14:23:38.655230 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.654913    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68" event={"ID":"2349307d-ea97-4a15-b42a-6c67b8c3f9f7","Type":"ContainerDied","Data":"aa5dd2ec82524b1635118997c887d56ce9c08cdbc911282b11ecc7e9f0e28fa3"}
Sep 16 14:23:38.655230 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.654943    2579 scope.go:117] "RemoveContainer" containerID="c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0"
Sep 16 14:23:38.655230 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.655115    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"
Sep 16 14:23:38.658296 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.658266    2579 generic.go:356] "Generic (PLEG): container finished" podID="e3d12beb-cdf8-422d-be76-30fa894f4130" containerID="6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6" exitCode=0
Sep 16 14:23:38.658389 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.658308    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"
Sep 16 14:23:38.658446 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.658308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd" event={"ID":"e3d12beb-cdf8-422d-be76-30fa894f4130","Type":"ContainerDied","Data":"6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6"}
Sep 16 14:23:38.658505 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.658456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd" event={"ID":"e3d12beb-cdf8-422d-be76-30fa894f4130","Type":"ContainerDied","Data":"85e60c2f330d3245513c1eb2b2b570f27a9c55455fe5d443acf7c7e38ff96ece"}
Sep 16 14:23:38.677789 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.677769    2579 scope.go:117] "RemoveContainer" containerID="c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0"
Sep 16 14:23:38.678150 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:38.678124    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0\": container with ID starting with c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0 not found: ID does not exist" containerID="c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0"
Sep 16 14:23:38.678249 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.678158    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0"} err="failed to get container status \"c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0\": rpc error: code = NotFound desc = could not find container \"c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0\": container with ID starting with c27fe22115c1de430ad5036cd59f260af94eb5558c5ee97c99261d61635114e0 not found: ID does not exist"
Sep 16 14:23:38.678249 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.678183    2579 scope.go:117] "RemoveContainer" containerID="6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6"
Sep 16 14:23:38.686623 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.686606    2579 scope.go:117] "RemoveContainer" containerID="6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6"
Sep 16 14:23:38.686910 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:38.686890    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6\": container with ID starting with 6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6 not found: ID does not exist" containerID="6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6"
Sep 16 14:23:38.686990 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.686917    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6"} err="failed to get container status \"6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6\": rpc error: code = NotFound desc = could not find container \"6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6\": container with ID starting with 6e852a81fd7867849100e23bb6a2cf06ac32ccd7c1169c8620aa88951a56b6e6 not found: ID does not exist"
Sep 16 14:23:38.694452 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.694427    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"]
Sep 16 14:23:38.706199 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.706177    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5e410b2-6fcc44977-6rb68"]
Sep 16 14:23:38.728138 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.728114    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"]
Sep 16 14:23:38.755583 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:38.755557    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-46e82d-559f74c48c-jqsmd"]
Sep 16 14:23:39.119539 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.119355    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2349307d-ea97-4a15-b42a-6c67b8c3f9f7" path="/var/lib/kubelet/pods/2349307d-ea97-4a15-b42a-6c67b8c3f9f7/volumes"
Sep 16 14:23:39.120004 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.119979    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3d12beb-cdf8-422d-be76-30fa894f4130" path="/var/lib/kubelet/pods/e3d12beb-cdf8-422d-be76-30fa894f4130/volumes"
Sep 16 14:23:39.174357 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174321    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"]
Sep 16 14:23:39.174697 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174685    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb49c0b4-6990-4253-bda6-79526a569cfc" containerName="maas-api"
Sep 16 14:23:39.174752 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174698    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb49c0b4-6990-4253-bda6-79526a569cfc" containerName="maas-api"
Sep 16 14:23:39.174752 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174714    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d12beb-cdf8-422d-be76-30fa894f4130" containerName="maas-api"
Sep 16 14:23:39.174752 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174720    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d12beb-cdf8-422d-be76-30fa894f4130" containerName="maas-api"
Sep 16 14:23:39.174752 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174725    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff83f387-ef10-4819-9d10-4ea5d38c84fe" containerName="main"
Sep 16 14:23:39.174752 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174730    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff83f387-ef10-4819-9d10-4ea5d38c84fe" containerName="main"
Sep 16 14:23:39.174752 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174737    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2349307d-ea97-4a15-b42a-6c67b8c3f9f7" containerName="maas-api"
Sep 16 14:23:39.174752 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174743    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2349307d-ea97-4a15-b42a-6c67b8c3f9f7" containerName="maas-api"
Sep 16 14:23:39.174972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174820    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2349307d-ea97-4a15-b42a-6c67b8c3f9f7" containerName="maas-api"
Sep 16 14:23:39.174972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174828    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d12beb-cdf8-422d-be76-30fa894f4130" containerName="maas-api"
Sep 16 14:23:39.174972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174835    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb49c0b4-6990-4253-bda6-79526a569cfc" containerName="maas-api"
Sep 16 14:23:39.174972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174840    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff83f387-ef10-4819-9d10-4ea5d38c84fe" containerName="main"
Sep 16 14:23:39.174972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.174845    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="27449689-86d6-4e70-89cb-ae35f12fa1fa" containerName="istio-proxy"
Sep 16 14:23:39.179375 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.179353    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.182574 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.182542    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-384cb8ac-openshift-default-dockercfg-v6dnf\""
Sep 16 14:23:39.200282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.200250    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"]
Sep 16 14:23:39.281568 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.281512    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f640aca2-8cec-4748-a71c-531021c28b83-istiod-ca-cert\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.281568 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.281560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f640aca2-8cec-4748-a71c-531021c28b83-istio-podinfo\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.281777 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.281669    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-istio-token\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.281777 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.281722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-socket\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.281856 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.281791    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-certs\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.281856 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.281826    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8grqm\" (UniqueName: \"kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-kube-api-access-8grqm\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.281856 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.281846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-data\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.281973 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.281912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-credential-socket\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.281973 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.281942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-envoy\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.382630 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.382528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-istio-token\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.382630 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.382595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-socket\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.382882 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.382654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-certs\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.382882 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.382690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8grqm\" (UniqueName: \"kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-kube-api-access-8grqm\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.382882 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.382715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-data\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.383033 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.382905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-credential-socket\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.383033 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.382953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-envoy\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.383033 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.383000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f640aca2-8cec-4748-a71c-531021c28b83-istiod-ca-cert\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.383033 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.383027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f640aca2-8cec-4748-a71c-531021c28b83-istio-podinfo\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.383222 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.383047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-data\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.383222 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.383055    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-socket\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.383222 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.383106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-certs\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.383361 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.383237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-credential-socket\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.383831 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.383803    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f640aca2-8cec-4748-a71c-531021c28b83-istiod-ca-cert\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.385235 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.385211    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-envoy\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.385492 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.385472    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f640aca2-8cec-4748-a71c-531021c28b83-istio-podinfo\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.392637 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.392605    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-istio-token\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.393025 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.393003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8grqm\" (UniqueName: \"kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-kube-api-access-8grqm\") pod \"e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") " pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.491832 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.491792    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:39.809450 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.809423    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"]
Sep 16 14:23:39.816762 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.816724    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:39.816867 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.816837    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:39.816928 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:39.816875    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:40.672646 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:40.672604    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584" event={"ID":"f640aca2-8cec-4748-a71c-531021c28b83","Type":"ContainerStarted","Data":"c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7"}
Sep 16 14:23:40.672849 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:40.672677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584" event={"ID":"f640aca2-8cec-4748-a71c-531021c28b83","Type":"ContainerStarted","Data":"cc717aa3cafdd018b36e66af517dde15f6bafcfd784ed45d386a7a6d859a5719"}
Sep 16 14:23:40.735467 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:40.735413    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584" podStartSLOduration=1.7353970859999999 podStartE2EDuration="1.735397086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:23:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:23:40.730401915 +0000 UTC m=+1160.029812196" watchObservedRunningTime="2026-09-16 14:23:40.735397086 +0000 UTC m=+1160.034807353"
Sep 16 14:23:41.492013 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:41.491979    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:41.497524 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:41.497500    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:41.678038 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:41.678005    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:41.679022 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:41.679003    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:23:41.887826 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:41.887802    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:42.007725 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.007682    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-certs\") pod \"aa85b139-6112-49b2-af94-132072c16853\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") "
Sep 16 14:23:42.007923 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.007769    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-socket\") pod \"aa85b139-6112-49b2-af94-132072c16853\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") "
Sep 16 14:23:42.007923 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.007791    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-data\") pod \"aa85b139-6112-49b2-af94-132072c16853\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") "
Sep 16 14:23:42.007923 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.007810    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa85b139-6112-49b2-af94-132072c16853-istiod-ca-cert\") pod \"aa85b139-6112-49b2-af94-132072c16853\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") "
Sep 16 14:23:42.007923 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.007838    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-credential-socket\") pod \"aa85b139-6112-49b2-af94-132072c16853\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") "
Sep 16 14:23:42.007923 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.007861    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-envoy\") pod \"aa85b139-6112-49b2-af94-132072c16853\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") "
Sep 16 14:23:42.007923 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.007909    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-istio-token\") pod \"aa85b139-6112-49b2-af94-132072c16853\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") "
Sep 16 14:23:42.008249 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.007992    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7k9x\" (UniqueName: \"kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-kube-api-access-n7k9x\") pod \"aa85b139-6112-49b2-af94-132072c16853\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") "
Sep 16 14:23:42.008249 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.008027    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa85b139-6112-49b2-af94-132072c16853-istio-podinfo\") pod \"aa85b139-6112-49b2-af94-132072c16853\" (UID: \"aa85b139-6112-49b2-af94-132072c16853\") "
Sep 16 14:23:42.008249 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.008055    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa85b139-6112-49b2-af94-132072c16853" (UID: "aa85b139-6112-49b2-af94-132072c16853"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:42.008249 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.008164    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa85b139-6112-49b2-af94-132072c16853" (UID: "aa85b139-6112-49b2-af94-132072c16853"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:42.008249 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.008206    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa85b139-6112-49b2-af94-132072c16853" (UID: "aa85b139-6112-49b2-af94-132072c16853"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:42.008249 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.008223    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa85b139-6112-49b2-af94-132072c16853" (UID: "aa85b139-6112-49b2-af94-132072c16853"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:42.008604 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.008299    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa85b139-6112-49b2-af94-132072c16853-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa85b139-6112-49b2-af94-132072c16853" (UID: "aa85b139-6112-49b2-af94-132072c16853"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:23:42.008604 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.008376    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:42.008604 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.008396    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-data\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:42.008604 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.008410    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-credential-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:42.008604 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.008419    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-workload-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:42.010240 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.010211    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa85b139-6112-49b2-af94-132072c16853" (UID: "aa85b139-6112-49b2-af94-132072c16853"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:42.010369 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.010323    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa85b139-6112-49b2-af94-132072c16853" (UID: "aa85b139-6112-49b2-af94-132072c16853"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:42.010639 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.010617    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-kube-api-access-n7k9x" (OuterVolumeSpecName: "kube-api-access-n7k9x") pod "aa85b139-6112-49b2-af94-132072c16853" (UID: "aa85b139-6112-49b2-af94-132072c16853"). InnerVolumeSpecName "kube-api-access-n7k9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:42.010714 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.010640    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa85b139-6112-49b2-af94-132072c16853-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa85b139-6112-49b2-af94-132072c16853" (UID: "aa85b139-6112-49b2-af94-132072c16853"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:23:42.109314 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.109230    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-istio-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:42.109314 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.109260    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7k9x\" (UniqueName: \"kubernetes.io/projected/aa85b139-6112-49b2-af94-132072c16853-kube-api-access-n7k9x\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:42.109314 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.109271    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa85b139-6112-49b2-af94-132072c16853-istio-podinfo\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:42.109314 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.109282    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa85b139-6112-49b2-af94-132072c16853-istiod-ca-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:42.109314 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.109290    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa85b139-6112-49b2-af94-132072c16853-istio-envoy\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:42.684853 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.684817    2579 generic.go:356] "Generic (PLEG): container finished" podID="aa85b139-6112-49b2-af94-132072c16853" containerID="30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e" exitCode=0
Sep 16 14:23:42.685322 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.684874    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"
Sep 16 14:23:42.685322 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.684908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw" event={"ID":"aa85b139-6112-49b2-af94-132072c16853","Type":"ContainerDied","Data":"30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e"}
Sep 16 14:23:42.685322 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.684970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw" event={"ID":"aa85b139-6112-49b2-af94-132072c16853","Type":"ContainerDied","Data":"b50979810a1cf37b4d909531fce126c9060110653ad2d5911a66c8fa4f2c3e3f"}
Sep 16 14:23:42.685322 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.684999    2579 scope.go:117] "RemoveContainer" containerID="30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e"
Sep 16 14:23:42.694306 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.694281    2579 scope.go:117] "RemoveContainer" containerID="30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e"
Sep 16 14:23:42.694608 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:42.694578    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e\": container with ID starting with 30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e not found: ID does not exist" containerID="30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e"
Sep 16 14:23:42.694667 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.694621    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e"} err="failed to get container status \"30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e\": rpc error: code = NotFound desc = could not find container \"30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e\": container with ID starting with 30f3873393c4c5d963237de1e9eaf1ce8b7a6e8cf032ab1207068646c05d914e not found: ID does not exist"
Sep 16 14:23:42.729495 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.729467    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"]
Sep 16 14:23:42.754904 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:42.754865    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e5e410b2-gw-openshift-default-595bb74cc6-x8wnw"]
Sep 16 14:23:43.117262 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:43.117182    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa85b139-6112-49b2-af94-132072c16853" path="/var/lib/kubelet/pods/aa85b139-6112-49b2-af94-132072c16853/volumes"
Sep 16 14:23:46.550593 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.550488    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"]
Sep 16 14:23:46.550957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.550899    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa85b139-6112-49b2-af94-132072c16853" containerName="istio-proxy"
Sep 16 14:23:46.550957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.550913    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa85b139-6112-49b2-af94-132072c16853" containerName="istio-proxy"
Sep 16 14:23:46.551026 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.550986    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa85b139-6112-49b2-af94-132072c16853" containerName="istio-proxy"
Sep 16 14:23:46.553963 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.553946    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.561602 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.561572    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-384cb8ac-serving-cert\""
Sep 16 14:23:46.561773 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.561656    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b7mcl\""
Sep 16 14:23:46.562796 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.562772    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 14:23:46.585402 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.585370    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"]
Sep 16 14:23:46.653972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.653941    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-metrics-certs\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.654114 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.653984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c37b5176-2329-473e-943e-bae68940c909-openshift-service-ca\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.654114 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.654001    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cflr9\" (UniqueName: \"kubernetes.io/projected/c37b5176-2329-473e-943e-bae68940c909-kube-api-access-cflr9\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.654219 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.654116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-maas-api-tls\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.755509 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.755477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-maas-api-tls\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.755695 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.755521    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-metrics-certs\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.755695 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.755565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c37b5176-2329-473e-943e-bae68940c909-openshift-service-ca\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.755695 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.755582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cflr9\" (UniqueName: \"kubernetes.io/projected/c37b5176-2329-473e-943e-bae68940c909-kube-api-access-cflr9\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.756169 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.756144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c37b5176-2329-473e-943e-bae68940c909-openshift-service-ca\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.758049 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.758028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-metrics-certs\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.758156 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.758065    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-maas-api-tls\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.770308 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.770289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cflr9\" (UniqueName: \"kubernetes.io/projected/c37b5176-2329-473e-943e-bae68940c909-kube-api-access-cflr9\") pod \"maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:46.866503 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:46.866441    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:47.206179 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:47.206148    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"]
Sep 16 14:23:47.209709 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:23:47.209680    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37b5176_2329_473e_943e_bae68940c909.slice/crio-21478bb5d24b5e7336ae715c44f35a8553d8e1bc81adbc2277660910d8eeba24 WatchSource:0}: Error finding container 21478bb5d24b5e7336ae715c44f35a8553d8e1bc81adbc2277660910d8eeba24: Status 404 returned error can't find the container with id 21478bb5d24b5e7336ae715c44f35a8553d8e1bc81adbc2277660910d8eeba24
Sep 16 14:23:47.716352 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:47.716324    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc" event={"ID":"c37b5176-2329-473e-943e-bae68940c909","Type":"ContainerStarted","Data":"21478bb5d24b5e7336ae715c44f35a8553d8e1bc81adbc2277660910d8eeba24"}
Sep 16 14:23:48.723541 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:48.723494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc" event={"ID":"c37b5176-2329-473e-943e-bae68940c909","Type":"ContainerStarted","Data":"a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260"}
Sep 16 14:23:48.723983 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:48.723606    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:48.771108 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:48.771056    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc" podStartSLOduration=2.278781761 podStartE2EDuration="2.771039615s" totalImagesPullingTime="492.257854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:23:48.767158366 +0000 UTC m=+1168.066568632" watchObservedRunningTime="2026-09-16 14:23:48.771039615 +0000 UTC m=+1168.070449881"
Sep 16 14:23:48.886369 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:48.886340    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"]
Sep 16 14:23:48.886528 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:48.886510    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy" containerID="cri-o://c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18" gracePeriod=30
Sep 16 14:23:49.777888 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.777855    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"]
Sep 16 14:23:49.780372 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.780351    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.783495 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.783474    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-50b57c-openshift-default-dockercfg-vzvq2\""
Sep 16 14:23:49.800591 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.800566    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"]
Sep 16 14:23:49.887665 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.887617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/879c8928-b952-42a0-a53c-d9ad904573c6-istiod-ca-cert\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.887665 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.887663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/879c8928-b952-42a0-a53c-d9ad904573c6-istio-podinfo\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.888030 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.887720    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-istio-token\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.888030 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.887808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bdvn\" (UniqueName: \"kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-kube-api-access-7bdvn\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.888030 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.887943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-data\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.888197 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.888099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-certs\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.888197 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.888134    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-socket\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.888197 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.888180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-credential-socket\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.888358 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.888197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-envoy\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.989762 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.989728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bdvn\" (UniqueName: \"kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-kube-api-access-7bdvn\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.989957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.989787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-data\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.989957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.989822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-certs\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.989957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.989845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-socket\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.989957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.989869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-credential-socket\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.989957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.989888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-envoy\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.989957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.989935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/879c8928-b952-42a0-a53c-d9ad904573c6-istiod-ca-cert\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.990350 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.989961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/879c8928-b952-42a0-a53c-d9ad904573c6-istio-podinfo\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.990350 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.989983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-istio-token\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.990350 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.990275    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-socket\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.990350 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.990322    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-credential-socket\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.990570 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.990376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-certs\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.990620 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.990537    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-data\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.990727 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.990706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/879c8928-b952-42a0-a53c-d9ad904573c6-istiod-ca-cert\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.992168 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.992145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-envoy\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:49.992446 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:49.992430    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/879c8928-b952-42a0-a53c-d9ad904573c6-istio-podinfo\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:50.003450 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:50.003417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-istio-token\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:50.003595 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:50.003566    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bdvn\" (UniqueName: \"kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-kube-api-access-7bdvn\") pod \"e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") " pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:50.091349 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:50.091262    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:50.380511 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:50.380486    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"]
Sep 16 14:23:50.381736 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:23:50.381713    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879c8928_b952_42a0_a53c_d9ad904573c6.slice/crio-e2ea2c7a81f7143d0dc6ffceb8f7788b81347e382976ebf695314cbceb1ea7b5 WatchSource:0}: Error finding container e2ea2c7a81f7143d0dc6ffceb8f7788b81347e382976ebf695314cbceb1ea7b5: Status 404 returned error can't find the container with id e2ea2c7a81f7143d0dc6ffceb8f7788b81347e382976ebf695314cbceb1ea7b5
Sep 16 14:23:50.383979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:50.383947    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:50.384096 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:50.384019    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:50.384096 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:50.384060    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:50.736423 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:50.736388    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" event={"ID":"879c8928-b952-42a0-a53c-d9ad904573c6","Type":"ContainerStarted","Data":"7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f"}
Sep 16 14:23:50.736599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:50.736453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" event={"ID":"879c8928-b952-42a0-a53c-d9ad904573c6","Type":"ContainerStarted","Data":"e2ea2c7a81f7143d0dc6ffceb8f7788b81347e382976ebf695314cbceb1ea7b5"}
Sep 16 14:23:50.760721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:50.760670    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" podStartSLOduration=1.760650271 podStartE2EDuration="1.760650271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:23:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:23:50.759240444 +0000 UTC m=+1170.058650711" watchObservedRunningTime="2026-09-16 14:23:50.760650271 +0000 UTC m=+1170.060060539"
Sep 16 14:23:51.092040 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:51.091952    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:51.097070 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:51.097048    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:51.742131 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:51.742100    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:51.743058 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:51.743041    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:23:54.143282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.143261    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:23:54.330346 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330267    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-certs\") pod \"ee8a75db-2de3-46ed-8109-cf105d6fd962\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") "
Sep 16 14:23:54.330346 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330299    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-socket\") pod \"ee8a75db-2de3-46ed-8109-cf105d6fd962\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") "
Sep 16 14:23:54.330599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330347    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-envoy\") pod \"ee8a75db-2de3-46ed-8109-cf105d6fd962\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") "
Sep 16 14:23:54.330599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330394    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-podinfo\") pod \"ee8a75db-2de3-46ed-8109-cf105d6fd962\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") "
Sep 16 14:23:54.330599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330424    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-token\") pod \"ee8a75db-2de3-46ed-8109-cf105d6fd962\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") "
Sep 16 14:23:54.330599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330458    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee8a75db-2de3-46ed-8109-cf105d6fd962-istiod-ca-cert\") pod \"ee8a75db-2de3-46ed-8109-cf105d6fd962\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") "
Sep 16 14:23:54.330599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330490    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-data\") pod \"ee8a75db-2de3-46ed-8109-cf105d6fd962\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") "
Sep 16 14:23:54.330599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330531    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-credential-socket\") pod \"ee8a75db-2de3-46ed-8109-cf105d6fd962\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") "
Sep 16 14:23:54.330599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330530    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee8a75db-2de3-46ed-8109-cf105d6fd962" (UID: "ee8a75db-2de3-46ed-8109-cf105d6fd962"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:54.330979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330612    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7nwd\" (UniqueName: \"kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-kube-api-access-l7nwd\") pod \"ee8a75db-2de3-46ed-8109-cf105d6fd962\" (UID: \"ee8a75db-2de3-46ed-8109-cf105d6fd962\") "
Sep 16 14:23:54.330979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330695    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee8a75db-2de3-46ed-8109-cf105d6fd962" (UID: "ee8a75db-2de3-46ed-8109-cf105d6fd962"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:54.330979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330824    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee8a75db-2de3-46ed-8109-cf105d6fd962" (UID: "ee8a75db-2de3-46ed-8109-cf105d6fd962"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:54.330979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330835    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee8a75db-2de3-46ed-8109-cf105d6fd962" (UID: "ee8a75db-2de3-46ed-8109-cf105d6fd962"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:54.330979 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.330936    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee8a75db-2de3-46ed-8109-cf105d6fd962-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee8a75db-2de3-46ed-8109-cf105d6fd962" (UID: "ee8a75db-2de3-46ed-8109-cf105d6fd962"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:23:54.331239 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.331008    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-credential-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:54.331239 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.331028    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:54.331239 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.331044    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-workload-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:54.331239 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.331058    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee8a75db-2de3-46ed-8109-cf105d6fd962-istiod-ca-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:54.331239 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.331071    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-data\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:54.332672 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.332645    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee8a75db-2de3-46ed-8109-cf105d6fd962" (UID: "ee8a75db-2de3-46ed-8109-cf105d6fd962"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:23:54.332776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.332678    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee8a75db-2de3-46ed-8109-cf105d6fd962" (UID: "ee8a75db-2de3-46ed-8109-cf105d6fd962"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:23:54.332776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.332758    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee8a75db-2de3-46ed-8109-cf105d6fd962" (UID: "ee8a75db-2de3-46ed-8109-cf105d6fd962"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:54.332848 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.332830    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-kube-api-access-l7nwd" (OuterVolumeSpecName: "kube-api-access-l7nwd") pod "ee8a75db-2de3-46ed-8109-cf105d6fd962" (UID: "ee8a75db-2de3-46ed-8109-cf105d6fd962"). InnerVolumeSpecName "kube-api-access-l7nwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:54.431603 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.431536    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7nwd\" (UniqueName: \"kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-kube-api-access-l7nwd\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:54.431603 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.431599    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-envoy\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:54.431603 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.431610    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-podinfo\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:54.431603 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.431618    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee8a75db-2de3-46ed-8109-cf105d6fd962-istio-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:23:54.734580 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.734535    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:23:54.759734 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.759701    2579 generic.go:356] "Generic (PLEG): container finished" podID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerID="c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18" exitCode=0
Sep 16 14:23:54.759893 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.759748    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"
Sep 16 14:23:54.759893 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.759765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" event={"ID":"ee8a75db-2de3-46ed-8109-cf105d6fd962","Type":"ContainerDied","Data":"c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18"}
Sep 16 14:23:54.759893 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.759815    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669" event={"ID":"ee8a75db-2de3-46ed-8109-cf105d6fd962","Type":"ContainerDied","Data":"2c6ec8889ceabb2ac03c5bde01e002b1844655d154f2ccb15159c68ebb7b2de8"}
Sep 16 14:23:54.759893 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.759847    2579 scope.go:117] "RemoveContainer" containerID="c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18"
Sep 16 14:23:54.769877 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.769855    2579 scope.go:117] "RemoveContainer" containerID="cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802"
Sep 16 14:23:54.778444 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.778426    2579 scope.go:117] "RemoveContainer" containerID="c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18"
Sep 16 14:23:54.778731 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:54.778712    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18\": container with ID starting with c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18 not found: ID does not exist" containerID="c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18"
Sep 16 14:23:54.778777 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.778740    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18"} err="failed to get container status \"c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18\": rpc error: code = NotFound desc = could not find container \"c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18\": container with ID starting with c42cd8d67686ade3c64c29391103f6f1bac471ef5b52653de14b809b8982ed18 not found: ID does not exist"
Sep 16 14:23:54.778777 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.778758    2579 scope.go:117] "RemoveContainer" containerID="cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802"
Sep 16 14:23:54.779023 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:54.779003    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802\": container with ID starting with cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802 not found: ID does not exist" containerID="cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802"
Sep 16 14:23:54.779059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.779030    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802"} err="failed to get container status \"cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802\": rpc error: code = NotFound desc = could not find container \"cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802\": container with ID starting with cbdd9e15253e58868cad3cff1f481b8f5982b9b8bdc78ff5359da4249a1d3802 not found: ID does not exist"
Sep 16 14:23:54.801614 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.801579    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"]
Sep 16 14:23:54.813004 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:54.812979    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-46e82d-openshift-default-586988f4b6-cq669"]
Sep 16 14:23:55.117032 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:55.116953    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" path="/var/lib/kubelet/pods/ee8a75db-2de3-46ed-8109-cf105d6fd962/volumes"
Sep 16 14:23:56.860119 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:56.860087    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"]
Sep 16 14:23:56.860578 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:56.860560    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy"
Sep 16 14:23:56.860636 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:56.860581    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy"
Sep 16 14:23:56.860636 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:56.860599    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy"
Sep 16 14:23:56.860636 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:56.860605    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy"
Sep 16 14:23:56.860730 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:56.860671    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy"
Sep 16 14:23:56.863764 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:56.863747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:56.867280 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:56.867252    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-50b57c-serving-cert\""
Sep 16 14:23:56.893111 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:56.893083    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"]
Sep 16 14:23:57.056807 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.056773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx5dk\" (UniqueName: \"kubernetes.io/projected/9944dff5-896e-4688-ada2-0a22e2ea5602-kube-api-access-rx5dk\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.056953 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.056832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.056953 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.056882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9944dff5-896e-4688-ada2-0a22e2ea5602-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.056953 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.056936    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.157319 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.157294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.157491 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.157372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx5dk\" (UniqueName: \"kubernetes.io/projected/9944dff5-896e-4688-ada2-0a22e2ea5602-kube-api-access-rx5dk\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.157491 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.157433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.157491 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.157469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9944dff5-896e-4688-ada2-0a22e2ea5602-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.157703 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:57.157584    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-serving-cert: secret "maas-api-e2e-shared-a-w2-50b57c-serving-cert" not found
Sep 16 14:23:57.157703 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:23:57.157666    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-maas-api-tls podName:9944dff5-896e-4688-ada2-0a22e2ea5602 nodeName:}" failed. No retries permitted until 2026-09-16 14:23:57.657644352 +0000 UTC m=+1176.957054610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-maas-api-tls") pod "maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz" (UID: "9944dff5-896e-4688-ada2-0a22e2ea5602") : secret "maas-api-e2e-shared-a-w2-50b57c-serving-cert" not found
Sep 16 14:23:57.158161 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.158143    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9944dff5-896e-4688-ada2-0a22e2ea5602-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.159749 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.159732    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.170029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.170003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx5dk\" (UniqueName: \"kubernetes.io/projected/9944dff5-896e-4688-ada2-0a22e2ea5602-kube-api-access-rx5dk\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.662084 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.662024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.665331 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.665296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:57.774155 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:57.774129    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:58.090162 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:58.090119    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"]
Sep 16 14:23:58.092576 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:23:58.092530    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9944dff5_896e_4688_ada2_0a22e2ea5602.slice/crio-6c57084ec23d6f495974a6eabe8d7b9fa150c5dbc4ec7621523dca7405d3370a WatchSource:0}: Error finding container 6c57084ec23d6f495974a6eabe8d7b9fa150c5dbc4ec7621523dca7405d3370a: Status 404 returned error can't find the container with id 6c57084ec23d6f495974a6eabe8d7b9fa150c5dbc4ec7621523dca7405d3370a
Sep 16 14:23:58.783537 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:58.783455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz" event={"ID":"9944dff5-896e-4688-ada2-0a22e2ea5602","Type":"ContainerStarted","Data":"9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599"}
Sep 16 14:23:58.783537 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:58.783511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz" event={"ID":"9944dff5-896e-4688-ada2-0a22e2ea5602","Type":"ContainerStarted","Data":"6c57084ec23d6f495974a6eabe8d7b9fa150c5dbc4ec7621523dca7405d3370a"}
Sep 16 14:23:58.783537 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:58.783533    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:23:58.830989 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:23:58.830936    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz" podStartSLOduration=2.444086578 podStartE2EDuration="2.830916414s" totalImagesPullingTime="386.829836ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:23:58.83088059 +0000 UTC m=+1178.130290870" watchObservedRunningTime="2026-09-16 14:23:58.830916414 +0000 UTC m=+1178.130326693"
Sep 16 14:24:04.801835 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:04.801798    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:24:08.927200 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:08.927169    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"]
Sep 16 14:24:08.927707 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:08.927442    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc" podUID="c37b5176-2329-473e-943e-bae68940c909" containerName="maas-api" containerID="cri-o://a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260" gracePeriod=30
Sep 16 14:24:09.190081 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.190009    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:24:09.265462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.265427    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c37b5176-2329-473e-943e-bae68940c909-openshift-service-ca\") pod \"c37b5176-2329-473e-943e-bae68940c909\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") "
Sep 16 14:24:09.265659 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.265488    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cflr9\" (UniqueName: \"kubernetes.io/projected/c37b5176-2329-473e-943e-bae68940c909-kube-api-access-cflr9\") pod \"c37b5176-2329-473e-943e-bae68940c909\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") "
Sep 16 14:24:09.265659 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.265513    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-maas-api-tls\") pod \"c37b5176-2329-473e-943e-bae68940c909\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") "
Sep 16 14:24:09.265659 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.265596    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-metrics-certs\") pod \"c37b5176-2329-473e-943e-bae68940c909\" (UID: \"c37b5176-2329-473e-943e-bae68940c909\") "
Sep 16 14:24:09.265931 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.265881    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c37b5176-2329-473e-943e-bae68940c909-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c37b5176-2329-473e-943e-bae68940c909" (UID: "c37b5176-2329-473e-943e-bae68940c909"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:24:09.267503 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.267478    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c37b5176-2329-473e-943e-bae68940c909" (UID: "c37b5176-2329-473e-943e-bae68940c909"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:24:09.267762 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.267736    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c37b5176-2329-473e-943e-bae68940c909" (UID: "c37b5176-2329-473e-943e-bae68940c909"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:24:09.268051 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.268025    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c37b5176-2329-473e-943e-bae68940c909-kube-api-access-cflr9" (OuterVolumeSpecName: "kube-api-access-cflr9") pod "c37b5176-2329-473e-943e-bae68940c909" (UID: "c37b5176-2329-473e-943e-bae68940c909"). InnerVolumeSpecName "kube-api-access-cflr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:24:09.367703 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.367671    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c37b5176-2329-473e-943e-bae68940c909-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:09.367703 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.367700    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cflr9\" (UniqueName: \"kubernetes.io/projected/c37b5176-2329-473e-943e-bae68940c909-kube-api-access-cflr9\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:09.367703 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.367710    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:09.368013 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.367718    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b5176-2329-473e-943e-bae68940c909-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:09.846327 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.846297    2579 generic.go:356] "Generic (PLEG): container finished" podID="c37b5176-2329-473e-943e-bae68940c909" containerID="a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260" exitCode=0
Sep 16 14:24:09.846499 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.846340    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"
Sep 16 14:24:09.846499 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.846336    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc" event={"ID":"c37b5176-2329-473e-943e-bae68940c909","Type":"ContainerDied","Data":"a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260"}
Sep 16 14:24:09.846499 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.846417    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc" event={"ID":"c37b5176-2329-473e-943e-bae68940c909","Type":"ContainerDied","Data":"21478bb5d24b5e7336ae715c44f35a8553d8e1bc81adbc2277660910d8eeba24"}
Sep 16 14:24:09.846499 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.846456    2579 scope.go:117] "RemoveContainer" containerID="a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260"
Sep 16 14:24:09.856541 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.856518    2579 scope.go:117] "RemoveContainer" containerID="a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260"
Sep 16 14:24:09.856869 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:24:09.856839    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260\": container with ID starting with a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260 not found: ID does not exist" containerID="a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260"
Sep 16 14:24:09.856921 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.856882    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260"} err="failed to get container status \"a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260\": rpc error: code = NotFound desc = could not find container \"a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260\": container with ID starting with a51879bc38878ef4d135f378213ae80d62be63b3a1fe5a3c37308da865949260 not found: ID does not exist"
Sep 16 14:24:09.879059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.879035    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"]
Sep 16 14:24:09.886226 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:09.886205    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-384cb8ac-85478459b6-t5bpc"]
Sep 16 14:24:10.573116 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:10.573085    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"]
Sep 16 14:24:10.573461 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:10.573356    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584" podUID="f640aca2-8cec-4748-a71c-531021c28b83" containerName="istio-proxy" containerID="cri-o://c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7" gracePeriod=30
Sep 16 14:24:11.118655 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.118621    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c37b5176-2329-473e-943e-bae68940c909" path="/var/lib/kubelet/pods/c37b5176-2329-473e-943e-bae68940c909/volumes"
Sep 16 14:24:11.225000 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.224941    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:24:11.284325 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284298    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f640aca2-8cec-4748-a71c-531021c28b83-istiod-ca-cert\") pod \"f640aca2-8cec-4748-a71c-531021c28b83\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") "
Sep 16 14:24:11.284512 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284347    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-socket\") pod \"f640aca2-8cec-4748-a71c-531021c28b83\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") "
Sep 16 14:24:11.284512 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284385    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-data\") pod \"f640aca2-8cec-4748-a71c-531021c28b83\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") "
Sep 16 14:24:11.284512 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284405    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8grqm\" (UniqueName: \"kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-kube-api-access-8grqm\") pod \"f640aca2-8cec-4748-a71c-531021c28b83\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") "
Sep 16 14:24:11.284512 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284438    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-credential-socket\") pod \"f640aca2-8cec-4748-a71c-531021c28b83\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") "
Sep 16 14:24:11.284512 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284483    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-envoy\") pod \"f640aca2-8cec-4748-a71c-531021c28b83\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") "
Sep 16 14:24:11.284814 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284518    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-certs\") pod \"f640aca2-8cec-4748-a71c-531021c28b83\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") "
Sep 16 14:24:11.284814 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284590    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-istio-token\") pod \"f640aca2-8cec-4748-a71c-531021c28b83\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") "
Sep 16 14:24:11.284814 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284617    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f640aca2-8cec-4748-a71c-531021c28b83-istio-podinfo\") pod \"f640aca2-8cec-4748-a71c-531021c28b83\" (UID: \"f640aca2-8cec-4748-a71c-531021c28b83\") "
Sep 16 14:24:11.284946 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284739    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f640aca2-8cec-4748-a71c-531021c28b83-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f640aca2-8cec-4748-a71c-531021c28b83" (UID: "f640aca2-8cec-4748-a71c-531021c28b83"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:24:11.284946 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284823    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f640aca2-8cec-4748-a71c-531021c28b83" (UID: "f640aca2-8cec-4748-a71c-531021c28b83"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:24:11.284946 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284833    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f640aca2-8cec-4748-a71c-531021c28b83" (UID: "f640aca2-8cec-4748-a71c-531021c28b83"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:24:11.285106 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284953    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:11.285106 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284971    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f640aca2-8cec-4748-a71c-531021c28b83-istiod-ca-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:11.285106 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.284985    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-credential-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:11.285258 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.285102    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-data" (OuterVolumeSpecName: "istio-data") pod "f640aca2-8cec-4748-a71c-531021c28b83" (UID: "f640aca2-8cec-4748-a71c-531021c28b83"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:24:11.285258 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.285118    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f640aca2-8cec-4748-a71c-531021c28b83" (UID: "f640aca2-8cec-4748-a71c-531021c28b83"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:24:11.287276 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.287205    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f640aca2-8cec-4748-a71c-531021c28b83-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f640aca2-8cec-4748-a71c-531021c28b83" (UID: "f640aca2-8cec-4748-a71c-531021c28b83"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:24:11.287394 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.287360    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f640aca2-8cec-4748-a71c-531021c28b83" (UID: "f640aca2-8cec-4748-a71c-531021c28b83"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:24:11.287673 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.287621    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-istio-token" (OuterVolumeSpecName: "istio-token") pod "f640aca2-8cec-4748-a71c-531021c28b83" (UID: "f640aca2-8cec-4748-a71c-531021c28b83"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:24:11.288638 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.288616    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-kube-api-access-8grqm" (OuterVolumeSpecName: "kube-api-access-8grqm") pod "f640aca2-8cec-4748-a71c-531021c28b83" (UID: "f640aca2-8cec-4748-a71c-531021c28b83"). InnerVolumeSpecName "kube-api-access-8grqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:24:11.385809 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.385782    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-envoy\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:11.385809 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.385803    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-istio-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:11.385809 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.385811    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f640aca2-8cec-4748-a71c-531021c28b83-istio-podinfo\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:11.386017 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.385821    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-workload-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:11.386017 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.385829    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f640aca2-8cec-4748-a71c-531021c28b83-istio-data\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:11.386017 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.385838    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8grqm\" (UniqueName: \"kubernetes.io/projected/f640aca2-8cec-4748-a71c-531021c28b83-kube-api-access-8grqm\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:11.550176 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.550097    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"]
Sep 16 14:24:11.550496 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.550482    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f640aca2-8cec-4748-a71c-531021c28b83" containerName="istio-proxy"
Sep 16 14:24:11.550540 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.550499    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f640aca2-8cec-4748-a71c-531021c28b83" containerName="istio-proxy"
Sep 16 14:24:11.550540 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.550510    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c37b5176-2329-473e-943e-bae68940c909" containerName="maas-api"
Sep 16 14:24:11.550540 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.550516    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c37b5176-2329-473e-943e-bae68940c909" containerName="maas-api"
Sep 16 14:24:11.550665 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.550604    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee8a75db-2de3-46ed-8109-cf105d6fd962" containerName="istio-proxy"
Sep 16 14:24:11.550665 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.550616    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c37b5176-2329-473e-943e-bae68940c909" containerName="maas-api"
Sep 16 14:24:11.550665 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.550622    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f640aca2-8cec-4748-a71c-531021c28b83" containerName="istio-proxy"
Sep 16 14:24:11.552734 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.552719    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.555607 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:24:11.555578    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" is forbidden: User \"system:node:ip-10-0-139-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-140.ec2.internal' and this object" podUID="bb173148-18e7-4b9f-9aae-592f479a0b70" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.555736 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:24:11.555606    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-derive-1f95faaa-openshift-default-dockercfg-z4c9s\" is forbidden: User \"system:node:ip-10-0-139-140.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-140.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"e2e-derive-1f95faaa-openshift-default-dockercfg-z4c9s\"" type="*v1.Secret"
Sep 16 14:24:11.588422 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.588397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-credential-socket\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.588422 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.588424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-envoy\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.588758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.588449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-socket\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.588758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.588504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-podinfo\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.588758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.588601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb173148-18e7-4b9f-9aae-592f479a0b70-istiod-ca-cert\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.588758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.588657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-certs\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.588758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.588679    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-token\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.588758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.588706    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-data\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.588758 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.588721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq7dk\" (UniqueName: \"kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-kube-api-access-rq7dk\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.594331 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.594304    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"]
Sep 16 14:24:11.689428 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.689399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-podinfo\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.689610 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.689436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb173148-18e7-4b9f-9aae-592f479a0b70-istiod-ca-cert\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.689658 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.689629    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-certs\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.689695 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.689669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-token\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.689776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.689709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-data\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.689776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.689736    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq7dk\" (UniqueName: \"kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-kube-api-access-rq7dk\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.689947 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.689903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-credential-socket\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.690088 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.689962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-envoy\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.690088 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.689982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-certs\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.690088 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.690027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-socket\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.690088 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.690055    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-data\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.690258 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.690138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb173148-18e7-4b9f-9aae-592f479a0b70-istiod-ca-cert\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.690258 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.690198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-credential-socket\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.690427 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.690407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-socket\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.692009 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.691982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-podinfo\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.692009 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.692004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-envoy\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.704494 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.704475    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-token\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.705344 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.705325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq7dk\" (UniqueName: \"kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-kube-api-access-rq7dk\") pod \"e2e-derive-1f95faaa-openshift-default-5d59c6-k699z\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") " pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:11.858880 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.858783    2579 generic.go:356] "Generic (PLEG): container finished" podID="f640aca2-8cec-4748-a71c-531021c28b83" containerID="c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7" exitCode=0
Sep 16 14:24:11.858880 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.858856    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"
Sep 16 14:24:11.859078 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.858871    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584" event={"ID":"f640aca2-8cec-4748-a71c-531021c28b83","Type":"ContainerDied","Data":"c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7"}
Sep 16 14:24:11.859078 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.858934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584" event={"ID":"f640aca2-8cec-4748-a71c-531021c28b83","Type":"ContainerDied","Data":"cc717aa3cafdd018b36e66af517dde15f6bafcfd784ed45d386a7a6d859a5719"}
Sep 16 14:24:11.859078 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.858964    2579 scope.go:117] "RemoveContainer" containerID="c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7"
Sep 16 14:24:11.878804 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.878779    2579 scope.go:117] "RemoveContainer" containerID="c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7"
Sep 16 14:24:11.879069 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:24:11.879043    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7\": container with ID starting with c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7 not found: ID does not exist" containerID="c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7"
Sep 16 14:24:11.879156 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.879074    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7"} err="failed to get container status \"c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7\": rpc error: code = NotFound desc = could not find container \"c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7\": container with ID starting with c950df427c1e2b7947415187536017e3b8c2642912169287c3df650b8331ebc7 not found: ID does not exist"
Sep 16 14:24:11.988162 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:11.988131    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"]
Sep 16 14:24:12.025134 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:12.025103    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-384cb8ac-openshift-default-6b5cd9496d-dr584"]
Sep 16 14:24:12.570426 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:12.570398    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1f95faaa-openshift-default-dockercfg-z4c9s\""
Sep 16 14:24:12.576507 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:12.576491    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:12.878275 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:12.877963    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"]
Sep 16 14:24:12.880988 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:24:12.880962    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb173148_18e7_4b9f_9aae_592f479a0b70.slice/crio-f899fe25ffa48f000929d361246324fb49734281abab7697f869a74d3558f30d WatchSource:0}: Error finding container f899fe25ffa48f000929d361246324fb49734281abab7697f869a74d3558f30d: Status 404 returned error can't find the container with id f899fe25ffa48f000929d361246324fb49734281abab7697f869a74d3558f30d
Sep 16 14:24:12.883444 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:12.883418    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:12.883509 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:12.883478    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:12.883509 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:12.883506    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:13.118428 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:13.118392    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f640aca2-8cec-4748-a71c-531021c28b83" path="/var/lib/kubelet/pods/f640aca2-8cec-4748-a71c-531021c28b83/volumes"
Sep 16 14:24:13.872247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:13.872211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z" event={"ID":"bb173148-18e7-4b9f-9aae-592f479a0b70","Type":"ContainerStarted","Data":"848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16"}
Sep 16 14:24:13.872415 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:13.872264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z" event={"ID":"bb173148-18e7-4b9f-9aae-592f479a0b70","Type":"ContainerStarted","Data":"f899fe25ffa48f000929d361246324fb49734281abab7697f869a74d3558f30d"}
Sep 16 14:24:13.906726 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:13.906681    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z" podStartSLOduration=2.906665599 podStartE2EDuration="2.906665599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:24:13.905662522 +0000 UTC m=+1193.205072788" watchObservedRunningTime="2026-09-16 14:24:13.906665599 +0000 UTC m=+1193.206075867"
Sep 16 14:24:14.577721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:14.577692    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:14.582970 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:14.582942    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:14.878014 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:14.877938    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:14.878912 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:14.878889    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:16.968111 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:16.968076    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"]
Sep 16 14:24:16.971134 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:16.971112    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:16.973714 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:16.973692    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-1f95faaa-serving-cert\""
Sep 16 14:24:16.985575 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:16.985528    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"]
Sep 16 14:24:17.041416 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.041387    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-openshift-service-ca\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.041583 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.041435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-maas-api-tls\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.041583 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.041466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-metrics-certs\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.041583 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.041506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmwbf\" (UniqueName: \"kubernetes.io/projected/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-kube-api-access-hmwbf\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.142708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.142676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-metrics-certs\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.142897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.142717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmwbf\" (UniqueName: \"kubernetes.io/projected/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-kube-api-access-hmwbf\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.142897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.142785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-openshift-service-ca\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.142897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.142834    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-maas-api-tls\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.143490 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.143465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-openshift-service-ca\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.145093 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.145070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-metrics-certs\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.145172 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.145147    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-maas-api-tls\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.165657 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.165635    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmwbf\" (UniqueName: \"kubernetes.io/projected/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-kube-api-access-hmwbf\") pod \"maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.281862 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.281779    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:17.568356 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.568309    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"]
Sep 16 14:24:17.570602 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:24:17.570575    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab6f635_1883_467f_bb74_6fe5d34fbbf6.slice/crio-d8dae546506a5c757b1c5fdb2e007773f2ce9743050f69cd8d486cd76b5871a9 WatchSource:0}: Error finding container d8dae546506a5c757b1c5fdb2e007773f2ce9743050f69cd8d486cd76b5871a9: Status 404 returned error can't find the container with id d8dae546506a5c757b1c5fdb2e007773f2ce9743050f69cd8d486cd76b5871a9
Sep 16 14:24:17.900920 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:17.900887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9" event={"ID":"3ab6f635-1883-467f-bb74-6fe5d34fbbf6","Type":"ContainerStarted","Data":"d8dae546506a5c757b1c5fdb2e007773f2ce9743050f69cd8d486cd76b5871a9"}
Sep 16 14:24:18.498295 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.498260    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"]
Sep 16 14:24:18.500826 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.500802    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.503571 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.503521    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-f72402-openshift-default-dockercfg-r7pts\""
Sep 16 14:24:18.526851 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.526824    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"]
Sep 16 14:24:18.555726 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.555686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-istio-token\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.555885 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.555750    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cce425cb-a378-4346-8bab-21f8382bfb41-istio-podinfo\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.555885 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.555780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-envoy\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.555885 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.555850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-certs\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.556024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.555873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-socket\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.556024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.555928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cce425cb-a378-4346-8bab-21f8382bfb41-istiod-ca-cert\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.556024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.555977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-credential-socket\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.556024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.555998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-data\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.556024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.556015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlw4b\" (UniqueName: \"kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-kube-api-access-qlw4b\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.657283 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cce425cb-a378-4346-8bab-21f8382bfb41-istio-podinfo\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.657283 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-envoy\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.657519 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-certs\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.657519 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-socket\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.657519 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cce425cb-a378-4346-8bab-21f8382bfb41-istiod-ca-cert\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.657519 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-credential-socket\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.657519 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-data\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.657814 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657530    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlw4b\" (UniqueName: \"kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-kube-api-access-qlw4b\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.657814 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-istio-token\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.657919 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-credential-socket\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.657919 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657896    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-socket\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.658011 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.657956    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-data\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.658076 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.658050    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-certs\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.658328 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.658303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cce425cb-a378-4346-8bab-21f8382bfb41-istiod-ca-cert\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.659644 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.659622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-envoy\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.660172 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.660152    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cce425cb-a378-4346-8bab-21f8382bfb41-istio-podinfo\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.696289 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.695947    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-istio-token\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.696772 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.696751    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlw4b\" (UniqueName: \"kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-kube-api-access-qlw4b\") pod \"e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") " pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.813489 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.813401    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:18.908616 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.908586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9" event={"ID":"3ab6f635-1883-467f-bb74-6fe5d34fbbf6","Type":"ContainerStarted","Data":"880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26"}
Sep 16 14:24:18.908747 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.908642    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:18.981884 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:18.981838    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9" podStartSLOduration=2.5929234020000003 podStartE2EDuration="2.981823719s" totalImagesPullingTime="388.900317ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:24:18.980080923 +0000 UTC m=+1198.279491191" watchObservedRunningTime="2026-09-16 14:24:18.981823719 +0000 UTC m=+1198.281233986"
Sep 16 14:24:19.110453 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:19.110427    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"]
Sep 16 14:24:19.111909 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:24:19.111885    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce425cb_a378_4346_8bab_21f8382bfb41.slice/crio-e9f27f9185541ac90889986256b8f5aea913cceb3fe50dbd1517943daa2698ae WatchSource:0}: Error finding container e9f27f9185541ac90889986256b8f5aea913cceb3fe50dbd1517943daa2698ae: Status 404 returned error can't find the container with id e9f27f9185541ac90889986256b8f5aea913cceb3fe50dbd1517943daa2698ae
Sep 16 14:24:19.117749 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:19.117717    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:19.117869 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:19.117792    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:19.117869 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:19.117837    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:19.915170 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:19.915131    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" event={"ID":"cce425cb-a378-4346-8bab-21f8382bfb41","Type":"ContainerStarted","Data":"bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b"}
Sep 16 14:24:19.915594 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:19.915196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" event={"ID":"cce425cb-a378-4346-8bab-21f8382bfb41","Type":"ContainerStarted","Data":"e9f27f9185541ac90889986256b8f5aea913cceb3fe50dbd1517943daa2698ae"}
Sep 16 14:24:19.979647 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:19.979602    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" podStartSLOduration=1.9795883010000002 podStartE2EDuration="1.979588301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:24:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:24:19.978122608 +0000 UTC m=+1199.277532876" watchObservedRunningTime="2026-09-16 14:24:19.979588301 +0000 UTC m=+1199.278998565"
Sep 16 14:24:20.814221 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:20.814187    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:20.819483 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:20.819459    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:20.920953 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:20.920921    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:20.921821 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:20.921798    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:21.124379 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:21.124293    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:24:21.126792 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:21.126766    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:24:24.920756 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:24.920726    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:26.163944 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.163909    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"]
Sep 16 14:24:26.174436 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.174412    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.179470 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.179445    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-f72402-serving-cert\""
Sep 16 14:24:26.194014 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.193980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"]
Sep 16 14:24:26.344921 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.344885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bl2n\" (UniqueName: \"kubernetes.io/projected/08009254-30a1-4fdb-b492-d7e305e0db6d-kube-api-access-4bl2n\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.345106 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.344942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.345106 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.345015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.345106 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.345033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08009254-30a1-4fdb-b492-d7e305e0db6d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.446508 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.446419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.446508 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.446461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08009254-30a1-4fdb-b492-d7e305e0db6d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.446747 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.446516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bl2n\" (UniqueName: \"kubernetes.io/projected/08009254-30a1-4fdb-b492-d7e305e0db6d-kube-api-access-4bl2n\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.446747 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.446594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.446747 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:24:26.446607    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-serving-cert: secret "maas-api-e2e-shared-b-w2-f72402-serving-cert" not found
Sep 16 14:24:26.446747 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:24:26.446687    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-maas-api-tls podName:08009254-30a1-4fdb-b492-d7e305e0db6d nodeName:}" failed. No retries permitted until 2026-09-16 14:24:26.946666274 +0000 UTC m=+1206.246076536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-maas-api-tls") pod "maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn" (UID: "08009254-30a1-4fdb-b492-d7e305e0db6d") : secret "maas-api-e2e-shared-b-w2-f72402-serving-cert" not found
Sep 16 14:24:26.447173 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.447153    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08009254-30a1-4fdb-b492-d7e305e0db6d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.449160 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.449134    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.468181 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.468153    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bl2n\" (UniqueName: \"kubernetes.io/projected/08009254-30a1-4fdb-b492-d7e305e0db6d-kube-api-access-4bl2n\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.951453 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.951415    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:26.954029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:26.953995    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:27.084714 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:27.084666    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:27.399360 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:24:27.399313    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08009254_30a1_4fdb_b492_d7e305e0db6d.slice/crio-5421bb85446e25bdbb31a6a27e6230df0366f199c948eac3b6ea88cd7f3d5c2b WatchSource:0}: Error finding container 5421bb85446e25bdbb31a6a27e6230df0366f199c948eac3b6ea88cd7f3d5c2b: Status 404 returned error can't find the container with id 5421bb85446e25bdbb31a6a27e6230df0366f199c948eac3b6ea88cd7f3d5c2b
Sep 16 14:24:27.400162 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:27.400136    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"]
Sep 16 14:24:27.963637 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:27.963518    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn" event={"ID":"08009254-30a1-4fdb-b492-d7e305e0db6d","Type":"ContainerStarted","Data":"1c9251cde6ed8ce16060c71511d63e9fb7ae5d06aeff4e5fc07a3f137414152e"}
Sep 16 14:24:27.963791 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:27.963707    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:27.963791 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:27.963744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn" event={"ID":"08009254-30a1-4fdb-b492-d7e305e0db6d","Type":"ContainerStarted","Data":"5421bb85446e25bdbb31a6a27e6230df0366f199c948eac3b6ea88cd7f3d5c2b"}
Sep 16 14:24:28.015339 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:28.015277    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn" podStartSLOduration=1.705115887 podStartE2EDuration="2.015257144s" totalImagesPullingTime="310.141257ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:24:28.014234707 +0000 UTC m=+1207.313644978" watchObservedRunningTime="2026-09-16 14:24:28.015257144 +0000 UTC m=+1207.314667412"
Sep 16 14:24:30.981357 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:30.981323    2579 generic.go:356] "Generic (PLEG): container finished" podID="879c8928-b952-42a0-a53c-d9ad904573c6" containerID="7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f" exitCode=0
Sep 16 14:24:30.981801 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:30.981365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" event={"ID":"879c8928-b952-42a0-a53c-d9ad904573c6","Type":"ContainerDied","Data":"7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f"}
Sep 16 14:24:30.981801 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:30.981777    2579 scope.go:117] "RemoveContainer" containerID="7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f"
Sep 16 14:24:30.982978 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:30.982948    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:30.983042 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:30.983016    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:30.983083 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:30.983046    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:31.992573 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:31.989446    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" event={"ID":"879c8928-b952-42a0-a53c-d9ad904573c6","Type":"ContainerStarted","Data":"e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8"}
Sep 16 14:24:32.092060 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:32.092026    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:24:32.095683 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:32.095652    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:24:32.095835 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:32.095709    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" podUID="879c8928-b952-42a0-a53c-d9ad904573c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 16 14:24:33.092155 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:33.092110    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:24:33.092669 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:33.092195    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" podUID="879c8928-b952-42a0-a53c-d9ad904573c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 16 14:24:33.974524 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:33.974496    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:24:34.092969 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:34.092932    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:24:34.095167 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:34.093538    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" podUID="879c8928-b952-42a0-a53c-d9ad904573c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 16 14:24:35.091875 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:35.091835    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:24:35.092192 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:35.092158    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" podUID="879c8928-b952-42a0-a53c-d9ad904573c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 16 14:24:36.091960 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:36.091913    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:24:36.092459 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:36.091987    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" podUID="879c8928-b952-42a0-a53c-d9ad904573c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 16 14:24:36.742214 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:36.742178    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:24:37.096249 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:37.096180    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:24:37.097229 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:37.097212    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:24:40.249179 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.248501    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"]
Sep 16 14:24:40.249721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.249343    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9" podUID="3ab6f635-1883-467f-bb74-6fe5d34fbbf6" containerName="maas-api" containerID="cri-o://880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26" gracePeriod=30
Sep 16 14:24:40.663152 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.663128    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:40.715680 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.715610    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-maas-api-tls\") pod \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") "
Sep 16 14:24:40.715865 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.715689    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-metrics-certs\") pod \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") "
Sep 16 14:24:40.715865 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.715741    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmwbf\" (UniqueName: \"kubernetes.io/projected/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-kube-api-access-hmwbf\") pod \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") "
Sep 16 14:24:40.715865 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.715797    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-openshift-service-ca\") pod \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\" (UID: \"3ab6f635-1883-467f-bb74-6fe5d34fbbf6\") "
Sep 16 14:24:40.716482 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.716449    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3ab6f635-1883-467f-bb74-6fe5d34fbbf6" (UID: "3ab6f635-1883-467f-bb74-6fe5d34fbbf6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:24:40.719990 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.719967    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3ab6f635-1883-467f-bb74-6fe5d34fbbf6" (UID: "3ab6f635-1883-467f-bb74-6fe5d34fbbf6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:24:40.729030 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.728979    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3ab6f635-1883-467f-bb74-6fe5d34fbbf6" (UID: "3ab6f635-1883-467f-bb74-6fe5d34fbbf6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:24:40.734052 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.734024    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-kube-api-access-hmwbf" (OuterVolumeSpecName: "kube-api-access-hmwbf") pod "3ab6f635-1883-467f-bb74-6fe5d34fbbf6" (UID: "3ab6f635-1883-467f-bb74-6fe5d34fbbf6"). InnerVolumeSpecName "kube-api-access-hmwbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:24:40.817050 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.817008    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:40.817276 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.817261    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:40.817381 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.817368    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmwbf\" (UniqueName: \"kubernetes.io/projected/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-kube-api-access-hmwbf\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:40.817471 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:40.817459    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ab6f635-1883-467f-bb74-6fe5d34fbbf6-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:41.059029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:41.058996    2579 generic.go:356] "Generic (PLEG): container finished" podID="3ab6f635-1883-467f-bb74-6fe5d34fbbf6" containerID="880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26" exitCode=0
Sep 16 14:24:41.059214 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:41.059064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9" event={"ID":"3ab6f635-1883-467f-bb74-6fe5d34fbbf6","Type":"ContainerDied","Data":"880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26"}
Sep 16 14:24:41.059214 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:41.059139    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9" event={"ID":"3ab6f635-1883-467f-bb74-6fe5d34fbbf6","Type":"ContainerDied","Data":"d8dae546506a5c757b1c5fdb2e007773f2ce9743050f69cd8d486cd76b5871a9"}
Sep 16 14:24:41.059214 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:41.059162    2579 scope.go:117] "RemoveContainer" containerID="880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26"
Sep 16 14:24:41.059322 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:41.059302    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"
Sep 16 14:24:41.069347 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:41.069236    2579 scope.go:117] "RemoveContainer" containerID="880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26"
Sep 16 14:24:41.069629 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:24:41.069569    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26\": container with ID starting with 880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26 not found: ID does not exist" containerID="880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26"
Sep 16 14:24:41.069629 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:41.069609    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26"} err="failed to get container status \"880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26\": rpc error: code = NotFound desc = could not find container \"880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26\": container with ID starting with 880dd6b5f7e7817e6ee9aa214d99485ba1f943e0f5e844e32dd94e7c5f96ed26 not found: ID does not exist"
Sep 16 14:24:41.155066 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:41.155029    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"]
Sep 16 14:24:41.168067 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:41.168036    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1f95faaa-8694bc469f-ss2x9"]
Sep 16 14:24:41.178090 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:41.178062    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"]
Sep 16 14:24:41.178263 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:41.178243    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z" podUID="bb173148-18e7-4b9f-9aae-592f479a0b70" containerName="istio-proxy" containerID="cri-o://848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16" gracePeriod=30
Sep 16 14:24:43.121951 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:43.121913    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ab6f635-1883-467f-bb74-6fe5d34fbbf6" path="/var/lib/kubelet/pods/3ab6f635-1883-467f-bb74-6fe5d34fbbf6/volumes"
Sep 16 14:24:45.919724 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:45.919672    2579 patch_prober.go:28] interesting pod/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 14:24:45.920329 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:45.919741    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z" podUID="bb173148-18e7-4b9f-9aae-592f479a0b70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 14:24:47.095763 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.095691    2579 generic.go:356] "Generic (PLEG): container finished" podID="cce425cb-a378-4346-8bab-21f8382bfb41" containerID="bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b" exitCode=0
Sep 16 14:24:47.096144 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.095759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" event={"ID":"cce425cb-a378-4346-8bab-21f8382bfb41","Type":"ContainerDied","Data":"bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b"}
Sep 16 14:24:47.096187 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.096151    2579 scope.go:117] "RemoveContainer" containerID="bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b"
Sep 16 14:24:47.097303 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.097277    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:47.097371 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.097340    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:47.097408 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.097370    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:24:47.533466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.533446    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:47.690890 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.690862    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-token\") pod \"bb173148-18e7-4b9f-9aae-592f479a0b70\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") "
Sep 16 14:24:47.691055 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.690902    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-data\") pod \"bb173148-18e7-4b9f-9aae-592f479a0b70\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") "
Sep 16 14:24:47.691055 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.690924    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb173148-18e7-4b9f-9aae-592f479a0b70-istiod-ca-cert\") pod \"bb173148-18e7-4b9f-9aae-592f479a0b70\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") "
Sep 16 14:24:47.691055 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.690955    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-envoy\") pod \"bb173148-18e7-4b9f-9aae-592f479a0b70\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") "
Sep 16 14:24:47.691055 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691002    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-certs\") pod \"bb173148-18e7-4b9f-9aae-592f479a0b70\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") "
Sep 16 14:24:47.691055 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691021    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-podinfo\") pod \"bb173148-18e7-4b9f-9aae-592f479a0b70\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") "
Sep 16 14:24:47.691055 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691050    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq7dk\" (UniqueName: \"kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-kube-api-access-rq7dk\") pod \"bb173148-18e7-4b9f-9aae-592f479a0b70\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") "
Sep 16 14:24:47.691370 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691077    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-credential-socket\") pod \"bb173148-18e7-4b9f-9aae-592f479a0b70\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") "
Sep 16 14:24:47.691370 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691108    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-socket\") pod \"bb173148-18e7-4b9f-9aae-592f479a0b70\" (UID: \"bb173148-18e7-4b9f-9aae-592f479a0b70\") "
Sep 16 14:24:47.691370 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691232    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-data" (OuterVolumeSpecName: "istio-data") pod "bb173148-18e7-4b9f-9aae-592f479a0b70" (UID: "bb173148-18e7-4b9f-9aae-592f479a0b70"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:24:47.691520 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691362    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bb173148-18e7-4b9f-9aae-592f479a0b70" (UID: "bb173148-18e7-4b9f-9aae-592f479a0b70"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:24:47.691520 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691369    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb173148-18e7-4b9f-9aae-592f479a0b70-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bb173148-18e7-4b9f-9aae-592f479a0b70" (UID: "bb173148-18e7-4b9f-9aae-592f479a0b70"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:24:47.691643 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691537    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:47.691643 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691509    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bb173148-18e7-4b9f-9aae-592f479a0b70" (UID: "bb173148-18e7-4b9f-9aae-592f479a0b70"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:24:47.691643 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691577    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-data\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:47.691643 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691592    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bb173148-18e7-4b9f-9aae-592f479a0b70" (UID: "bb173148-18e7-4b9f-9aae-592f479a0b70"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:24:47.691643 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.691612    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb173148-18e7-4b9f-9aae-592f479a0b70-istiod-ca-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:47.693212 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.693189    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-kube-api-access-rq7dk" (OuterVolumeSpecName: "kube-api-access-rq7dk") pod "bb173148-18e7-4b9f-9aae-592f479a0b70" (UID: "bb173148-18e7-4b9f-9aae-592f479a0b70"). InnerVolumeSpecName "kube-api-access-rq7dk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:24:47.693299 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.693210    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bb173148-18e7-4b9f-9aae-592f479a0b70" (UID: "bb173148-18e7-4b9f-9aae-592f479a0b70"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:24:47.693421 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.693405    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb173148-18e7-4b9f-9aae-592f479a0b70" (UID: "bb173148-18e7-4b9f-9aae-592f479a0b70"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:24:47.693586 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.693541    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bb173148-18e7-4b9f-9aae-592f479a0b70" (UID: "bb173148-18e7-4b9f-9aae-592f479a0b70"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:24:47.792222 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.792190    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:47.792222 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.792216    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-envoy\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:47.792222 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.792225    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb173148-18e7-4b9f-9aae-592f479a0b70-istio-podinfo\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:47.792458 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.792234    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq7dk\" (UniqueName: \"kubernetes.io/projected/bb173148-18e7-4b9f-9aae-592f479a0b70-kube-api-access-rq7dk\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:47.792458 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.792244    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-credential-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:47.792458 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:47.792252    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb173148-18e7-4b9f-9aae-592f479a0b70-workload-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:24:48.102438 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.102350    2579 generic.go:356] "Generic (PLEG): container finished" podID="bb173148-18e7-4b9f-9aae-592f479a0b70" containerID="848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16" exitCode=0
Sep 16 14:24:48.102438 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.102391    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"
Sep 16 14:24:48.102438 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.102422    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z" event={"ID":"bb173148-18e7-4b9f-9aae-592f479a0b70","Type":"ContainerDied","Data":"848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16"}
Sep 16 14:24:48.103029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.102474    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z" event={"ID":"bb173148-18e7-4b9f-9aae-592f479a0b70","Type":"ContainerDied","Data":"f899fe25ffa48f000929d361246324fb49734281abab7697f869a74d3558f30d"}
Sep 16 14:24:48.103029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.102506    2579 scope.go:117] "RemoveContainer" containerID="848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16"
Sep 16 14:24:48.104748 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.104719    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" event={"ID":"cce425cb-a378-4346-8bab-21f8382bfb41","Type":"ContainerStarted","Data":"75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349"}
Sep 16 14:24:48.112737 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.112718    2579 scope.go:117] "RemoveContainer" containerID="848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16"
Sep 16 14:24:48.112982 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:24:48.112965    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16\": container with ID starting with 848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16 not found: ID does not exist" containerID="848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16"
Sep 16 14:24:48.113028 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.112990    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16"} err="failed to get container status \"848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16\": rpc error: code = NotFound desc = could not find container \"848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16\": container with ID starting with 848cc716ef65368a23446b5c62b95d83ca01251cc622881c1242017c2582af16 not found: ID does not exist"
Sep 16 14:24:48.199232 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.199202    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"]
Sep 16 14:24:48.206140 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.206112    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1f95faaa-openshift-default-5d59c6-k699z"]
Sep 16 14:24:48.814229 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.814188    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:48.815389 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.815363    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 16 14:24:48.815556 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:48.815424    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 16 14:24:49.118270 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:49.118187    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb173148-18e7-4b9f-9aae-592f479a0b70" path="/var/lib/kubelet/pods/bb173148-18e7-4b9f-9aae-592f479a0b70/volumes"
Sep 16 14:24:49.814083 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:49.814048    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 16 14:24:49.814254 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:49.814106    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 16 14:24:50.814343 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:50.814309    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 16 14:24:50.814776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:50.814363    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 16 14:24:50.921414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:50.921377    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:51.814797 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:51.814760    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 16 14:24:51.815321 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:51.814832    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 16 14:24:52.814113 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:52.814075    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 16 14:24:52.814303 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:52.814134    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 16 14:24:53.813998 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:53.813958    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 16 14:24:53.814408 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:53.814033    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 16 14:24:54.817380 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:54.817350    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:54.818306 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:54.818287    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:24:59.301859 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.301829    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"]
Sep 16 14:24:59.302206 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.302186    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ab6f635-1883-467f-bb74-6fe5d34fbbf6" containerName="maas-api"
Sep 16 14:24:59.302206 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.302197    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ab6f635-1883-467f-bb74-6fe5d34fbbf6" containerName="maas-api"
Sep 16 14:24:59.302291 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.302212    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb173148-18e7-4b9f-9aae-592f479a0b70" containerName="istio-proxy"
Sep 16 14:24:59.302291 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.302219    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb173148-18e7-4b9f-9aae-592f479a0b70" containerName="istio-proxy"
Sep 16 14:24:59.302291 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.302278    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb173148-18e7-4b9f-9aae-592f479a0b70" containerName="istio-proxy"
Sep 16 14:24:59.302291 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.302288    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ab6f635-1883-467f-bb74-6fe5d34fbbf6" containerName="maas-api"
Sep 16 14:24:59.304463 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.304444    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.315273 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.315254    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-50b57c\"/\"kube-root-ca.crt\""
Sep 16 14:24:59.316601 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.316582    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-50b57c\"/\"auth-test-model-50b57c-kserve-self-signed-certs\""
Sep 16 14:24:59.316709 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.316626    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-50b57c\"/\"default-dockercfg-sjkdw\""
Sep 16 14:24:59.316709 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.316660    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-50b57c\"/\"openshift-service-ca.crt\""
Sep 16 14:24:59.339942 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.339913    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"]
Sep 16 14:24:59.408669 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.408648    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-dshm\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.408749 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.408684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-model-cache\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.408792 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.408765    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tmp-dir\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.408824 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.408806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-home\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.408857 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.408847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tls-certs\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.408925 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.408911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjb9q\" (UniqueName: \"kubernetes.io/projected/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-kube-api-access-kjb9q\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.509927 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.509888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tls-certs\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.510122 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.509950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjb9q\" (UniqueName: \"kubernetes.io/projected/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-kube-api-access-kjb9q\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.510122 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.509982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-dshm\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.510122 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.510001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-model-cache\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.510122 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.510031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tmp-dir\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.510122 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.510060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-home\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.510483 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.510461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-model-cache\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.510628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.510513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-home\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.510628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.510569    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tmp-dir\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.512401 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.512374    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-dshm\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.512572 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.512538    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tls-certs\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.522923 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.522896    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjb9q\" (UniqueName: \"kubernetes.io/projected/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-kube-api-access-kjb9q\") pod \"auth-test-model-50b57c-kserve-c4cbcb99f-w86dr\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") " pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.614260 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.614162    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:24:59.924131 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:24:59.924073    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"]
Sep 16 14:24:59.926266 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:24:59.926240    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6eb02bd0_41f4_44b9_99ec_6d5bbc538734.slice/crio-a928e977d320da50dbef45c455815fc3ecc598a4e775bd23e02fd412e35b42d6 WatchSource:0}: Error finding container a928e977d320da50dbef45c455815fc3ecc598a4e775bd23e02fd412e35b42d6: Status 404 returned error can't find the container with id a928e977d320da50dbef45c455815fc3ecc598a4e775bd23e02fd412e35b42d6
Sep 16 14:25:00.172424 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:25:00.172376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr" event={"ID":"6eb02bd0-41f4-44b9-99ec-6d5bbc538734","Type":"ContainerStarted","Data":"7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2"}
Sep 16 14:25:00.172424 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:25:00.172416    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr" event={"ID":"6eb02bd0-41f4-44b9-99ec-6d5bbc538734","Type":"ContainerStarted","Data":"a928e977d320da50dbef45c455815fc3ecc598a4e775bd23e02fd412e35b42d6"}
Sep 16 14:25:00.209704 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:25:00.209600    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr" podStartSLOduration=1.209584303 podStartE2EDuration="1.209584303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:25:00.208141338 +0000 UTC m=+1239.507551604" watchObservedRunningTime="2026-09-16 14:25:00.209584303 +0000 UTC m=+1239.508994569"
Sep 16 14:25:09.615020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:25:09.614980    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:25:09.615428 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:25:09.615038    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:25:09.627483 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:25:09.627451    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:25:10.235804 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:25:10.235778    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:28:32.667183 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:32.667101    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"]
Sep 16 14:28:47.686475 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:47.686422    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr" podUID="6eb02bd0-41f4-44b9-99ec-6d5bbc538734" containerName="main" containerID="cri-o://7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2" gracePeriod=45
Sep 16 14:28:47.931304 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:47.931280    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:28:48.049804 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.049702    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tmp-dir\") pod \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") "
Sep 16 14:28:48.049804 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.049750    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-dshm\") pod \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") "
Sep 16 14:28:48.049804 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.049783    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjb9q\" (UniqueName: \"kubernetes.io/projected/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-kube-api-access-kjb9q\") pod \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") "
Sep 16 14:28:48.050104 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.049813    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tls-certs\") pod \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") "
Sep 16 14:28:48.050104 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.049834    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-home\") pod \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") "
Sep 16 14:28:48.050104 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.049902    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-model-cache\") pod \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\" (UID: \"6eb02bd0-41f4-44b9-99ec-6d5bbc538734\") "
Sep 16 14:28:48.050104 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.050041    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6eb02bd0-41f4-44b9-99ec-6d5bbc538734" (UID: "6eb02bd0-41f4-44b9-99ec-6d5bbc538734"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:28:48.050281 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.050165    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tmp-dir\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:28:48.050281 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.050264    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-model-cache" (OuterVolumeSpecName: "model-cache") pod "6eb02bd0-41f4-44b9-99ec-6d5bbc538734" (UID: "6eb02bd0-41f4-44b9-99ec-6d5bbc538734"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:28:48.050373 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.050355    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-home" (OuterVolumeSpecName: "home") pod "6eb02bd0-41f4-44b9-99ec-6d5bbc538734" (UID: "6eb02bd0-41f4-44b9-99ec-6d5bbc538734"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:28:48.052152 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.052124    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-dshm" (OuterVolumeSpecName: "dshm") pod "6eb02bd0-41f4-44b9-99ec-6d5bbc538734" (UID: "6eb02bd0-41f4-44b9-99ec-6d5bbc538734"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:28:48.052152 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.052143    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-kube-api-access-kjb9q" (OuterVolumeSpecName: "kube-api-access-kjb9q") pod "6eb02bd0-41f4-44b9-99ec-6d5bbc538734" (UID: "6eb02bd0-41f4-44b9-99ec-6d5bbc538734"). InnerVolumeSpecName "kube-api-access-kjb9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:28:48.052302 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.052179    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6eb02bd0-41f4-44b9-99ec-6d5bbc538734" (UID: "6eb02bd0-41f4-44b9-99ec-6d5bbc538734"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:28:48.150952 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.150911    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-dshm\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:28:48.150952 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.150944    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjb9q\" (UniqueName: \"kubernetes.io/projected/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-kube-api-access-kjb9q\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:28:48.150952 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.150957    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-tls-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:28:48.151187 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.150968    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-home\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:28:48.151187 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.150979    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eb02bd0-41f4-44b9-99ec-6d5bbc538734-model-cache\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:28:48.328792 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.328703    2579 generic.go:356] "Generic (PLEG): container finished" podID="6eb02bd0-41f4-44b9-99ec-6d5bbc538734" containerID="7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2" exitCode=0
Sep 16 14:28:48.328792 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.328746    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"
Sep 16 14:28:48.328974 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.328782    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr" event={"ID":"6eb02bd0-41f4-44b9-99ec-6d5bbc538734","Type":"ContainerDied","Data":"7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2"}
Sep 16 14:28:48.328974 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.328828    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr" event={"ID":"6eb02bd0-41f4-44b9-99ec-6d5bbc538734","Type":"ContainerDied","Data":"a928e977d320da50dbef45c455815fc3ecc598a4e775bd23e02fd412e35b42d6"}
Sep 16 14:28:48.328974 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.328844    2579 scope.go:117] "RemoveContainer" containerID="7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2"
Sep 16 14:28:48.337619 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.337599    2579 scope.go:117] "RemoveContainer" containerID="7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2"
Sep 16 14:28:48.337911 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:28:48.337891    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2\": container with ID starting with 7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2 not found: ID does not exist" containerID="7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2"
Sep 16 14:28:48.337987 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.337918    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2"} err="failed to get container status \"7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2\": rpc error: code = NotFound desc = could not find container \"7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2\": container with ID starting with 7416794aa27847557c83aac8366addbf186a43d5c1bf5b190c4d18b65e1727e2 not found: ID does not exist"
Sep 16 14:28:48.361071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.361046    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"]
Sep 16 14:28:48.365574 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:48.365540    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50b57c/auth-test-model-50b57c-kserve-c4cbcb99f-w86dr"]
Sep 16 14:28:49.116996 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:28:49.116962    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eb02bd0-41f4-44b9-99ec-6d5bbc538734" path="/var/lib/kubelet/pods/6eb02bd0-41f4-44b9-99ec-6d5bbc538734/volumes"
Sep 16 14:29:00.114567 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.114512    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"]
Sep 16 14:29:00.115013 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.114996    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb02bd0-41f4-44b9-99ec-6d5bbc538734" containerName="main"
Sep 16 14:29:00.115061 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.115016    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb02bd0-41f4-44b9-99ec-6d5bbc538734" containerName="main"
Sep 16 14:29:00.115097 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.115086    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eb02bd0-41f4-44b9-99ec-6d5bbc538734" containerName="main"
Sep 16 14:29:00.118163 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.118145    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.122078 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.122056    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dffae957-openshift-default-dockercfg-t72qr\""
Sep 16 14:29:00.132368 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.132341    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"]
Sep 16 14:29:00.166771 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.166735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-socket\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.166921 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.166789    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-istio-token\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.166921 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.166810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqlgg\" (UniqueName: \"kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-kube-api-access-hqlgg\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.166921 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.166871    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-credential-socket\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.167100 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.166917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-certs\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.167100 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.166979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-data\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.167100 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.167047    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/977cc7d2-b931-4304-9994-74ade71fd50b-istiod-ca-cert\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.167100 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.167079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-envoy\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.167249 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.167133    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/977cc7d2-b931-4304-9994-74ade71fd50b-istio-podinfo\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.267630 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.267588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-istio-token\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.267630 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.267631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqlgg\" (UniqueName: \"kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-kube-api-access-hqlgg\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.267893 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.267663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-credential-socket\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.267893 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.267681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-certs\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.267893 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.267797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-data\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.267893 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.267873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/977cc7d2-b931-4304-9994-74ade71fd50b-istiod-ca-cert\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.268090 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.267919    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-envoy\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.268090 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.267948    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/977cc7d2-b931-4304-9994-74ade71fd50b-istio-podinfo\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.268203 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.268098    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-certs\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.268203 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.268095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-socket\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.268203 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.268133    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-credential-socket\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.268368 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.268195    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-data\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.268368 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.268357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-socket\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.268684 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.268658    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/977cc7d2-b931-4304-9994-74ade71fd50b-istiod-ca-cert\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.270192 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.270172    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-envoy\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.270500 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.270481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/977cc7d2-b931-4304-9994-74ade71fd50b-istio-podinfo\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.276078 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.276058    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-istio-token\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.276294 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.276278    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqlgg\" (UniqueName: \"kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-kube-api-access-hqlgg\") pod \"e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") " pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.428852 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.428822    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:00.712708 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.712682    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"]
Sep 16 14:29:00.714745 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:29:00.714714    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977cc7d2_b931_4304_9994_74ade71fd50b.slice/crio-80bc6036dfe9a430740d8b59e3dbc6dc5e001a04ae059bd10506dba31b8760fc WatchSource:0}: Error finding container 80bc6036dfe9a430740d8b59e3dbc6dc5e001a04ae059bd10506dba31b8760fc: Status 404 returned error can't find the container with id 80bc6036dfe9a430740d8b59e3dbc6dc5e001a04ae059bd10506dba31b8760fc
Sep 16 14:29:00.717042 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.717008    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:29:00.717127 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.717078    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:29:00.717127 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:00.717104    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:29:01.395213 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:01.395177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" event={"ID":"977cc7d2-b931-4304-9994-74ade71fd50b","Type":"ContainerStarted","Data":"dbb6d7eea2536cd58e2a21076437be92d699610db61d7103b7d041c7cac3ae5c"}
Sep 16 14:29:01.395678 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:01.395233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" event={"ID":"977cc7d2-b931-4304-9994-74ade71fd50b","Type":"ContainerStarted","Data":"80bc6036dfe9a430740d8b59e3dbc6dc5e001a04ae059bd10506dba31b8760fc"}
Sep 16 14:29:01.427203 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:01.427153    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" podStartSLOduration=1.427114068 podStartE2EDuration="1.427114068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:29:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:29:01.424265752 +0000 UTC m=+1480.723676019" watchObservedRunningTime="2026-09-16 14:29:01.427114068 +0000 UTC m=+1480.726524335"
Sep 16 14:29:01.434018 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:01.431199    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:01.438300 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:01.438278    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:02.400878 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:02.400851    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:02.401864 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:02.401843    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:06.822582 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:06.822536    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"]
Sep 16 14:29:06.826418 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:06.826395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:06.834617 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:06.830870    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-dffae957-serving-cert\""
Sep 16 14:29:06.844808 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:06.844784    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"]
Sep 16 14:29:06.928746 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:06.928714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsx76\" (UniqueName: \"kubernetes.io/projected/a2b6495c-19fa-439b-b040-e5f807cd0164-kube-api-access-dsx76\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:06.928898 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:06.928757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2b6495c-19fa-439b-b040-e5f807cd0164-openshift-service-ca\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:06.928898 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:06.928780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-maas-api-tls\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:06.928988 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:06.928910    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-metrics-certs\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:07.030105 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:07.030072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-metrics-certs\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:07.030297 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:07.030116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsx76\" (UniqueName: \"kubernetes.io/projected/a2b6495c-19fa-439b-b040-e5f807cd0164-kube-api-access-dsx76\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:07.030297 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:07.030149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2b6495c-19fa-439b-b040-e5f807cd0164-openshift-service-ca\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:07.030297 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:07.030182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-maas-api-tls\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:07.030424 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:29:07.030335    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-serving-cert: secret "maas-api-e2e-mt-dffae957-serving-cert" not found
Sep 16 14:29:07.030424 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:29:07.030409    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-maas-api-tls podName:a2b6495c-19fa-439b-b040-e5f807cd0164 nodeName:}" failed. No retries permitted until 2026-09-16 14:29:07.5303908 +0000 UTC m=+1486.829801045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-maas-api-tls") pod "maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2" (UID: "a2b6495c-19fa-439b-b040-e5f807cd0164") : secret "maas-api-e2e-mt-dffae957-serving-cert" not found
Sep 16 14:29:07.030925 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:07.030905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2b6495c-19fa-439b-b040-e5f807cd0164-openshift-service-ca\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:07.032569 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:07.032531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-metrics-certs\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:07.039652 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:07.039634    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsx76\" (UniqueName: \"kubernetes.io/projected/a2b6495c-19fa-439b-b040-e5f807cd0164-kube-api-access-dsx76\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:07.534951 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:07.534915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-maas-api-tls\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:07.538535 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:07.538506    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-maas-api-tls\") pod \"maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:07.743736 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:07.743702    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:08.025444 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:08.025416    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"]
Sep 16 14:29:08.027617 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:29:08.027588    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2b6495c_19fa_439b_b040_e5f807cd0164.slice/crio-aea081e56223155eab047bc49d387820141f828f6c59b9094551ed04c5abd5b7 WatchSource:0}: Error finding container aea081e56223155eab047bc49d387820141f828f6c59b9094551ed04c5abd5b7: Status 404 returned error can't find the container with id aea081e56223155eab047bc49d387820141f828f6c59b9094551ed04c5abd5b7
Sep 16 14:29:08.028926 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:08.028911    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:29:08.432171 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:08.432137    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2" event={"ID":"a2b6495c-19fa-439b-b040-e5f807cd0164","Type":"ContainerStarted","Data":"aea081e56223155eab047bc49d387820141f828f6c59b9094551ed04c5abd5b7"}
Sep 16 14:29:09.438703 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:09.438649    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2" event={"ID":"a2b6495c-19fa-439b-b040-e5f807cd0164","Type":"ContainerStarted","Data":"adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37"}
Sep 16 14:29:09.439148 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:09.438725    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:09.486729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:09.486683    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2" podStartSLOduration=2.8822180299999998 podStartE2EDuration="3.486665791s" totalImagesPullingTime="604.447761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:29:09.485024158 +0000 UTC m=+1488.784434424" watchObservedRunningTime="2026-09-16 14:29:09.486665791 +0000 UTC m=+1488.786076040"
Sep 16 14:29:15.448832 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:15.448803    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:29:21.158503 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:21.158473    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:29:21.162056 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:21.162032    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:29:22.531935 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:22.531849    2579 generic.go:356] "Generic (PLEG): container finished" podID="977cc7d2-b931-4304-9994-74ade71fd50b" containerID="dbb6d7eea2536cd58e2a21076437be92d699610db61d7103b7d041c7cac3ae5c" exitCode=0
Sep 16 14:29:22.531935 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:22.531922    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" event={"ID":"977cc7d2-b931-4304-9994-74ade71fd50b","Type":"ContainerDied","Data":"dbb6d7eea2536cd58e2a21076437be92d699610db61d7103b7d041c7cac3ae5c"}
Sep 16 14:29:22.532369 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:22.532334    2579 scope.go:117] "RemoveContainer" containerID="dbb6d7eea2536cd58e2a21076437be92d699610db61d7103b7d041c7cac3ae5c"
Sep 16 14:29:22.533441 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:22.533414    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:29:22.533540 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:22.533477    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:29:22.533540 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:22.533505    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:29:23.539055 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:23.539017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" event={"ID":"977cc7d2-b931-4304-9994-74ade71fd50b","Type":"ContainerStarted","Data":"194ea6af47b28281915e380aac7bc7cac428d7922b37aa99e7b7d926772053f3"}
Sep 16 14:29:24.429324 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:24.429287    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:24.429605 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:24.429583    2579 patch_prober.go:28] interesting pod/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 16 14:29:24.429660 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:24.429631    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 16 14:29:25.429337 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:25.429200    2579 patch_prober.go:28] interesting pod/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 16 14:29:25.429337 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:25.429258    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 16 14:29:26.430250 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:26.430207    2579 patch_prober.go:28] interesting pod/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 16 14:29:26.430688 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:26.430322    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 16 14:29:27.430165 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:27.430125    2579 patch_prober.go:28] interesting pod/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 16 14:29:27.430351 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:27.430217    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 16 14:29:28.430128 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:28.430088    2579 patch_prober.go:28] interesting pod/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 16 14:29:28.430313 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:28.430151    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 16 14:29:29.433787 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:29.433747    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:29.434215 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:29.434112    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:29:29.434895 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:29:29.434879    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:30:00.169678 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:00.169640    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp"]
Sep 16 14:30:00.172384 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:00.172361    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp"
Sep 16 14:30:00.175635 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:00.175614    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g952z\""
Sep 16 14:30:00.184229 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:00.184210    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp"
Sep 16 14:30:00.208486 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:00.208453    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp"]
Sep 16 14:30:00.461489 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:00.461405    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp"]
Sep 16 14:30:00.465249 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:30:00.465223    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7831a6af_476e_400d_8f93_aeb9b37fe6f3.slice/crio-c315b8103d22282074d0e34f27c44d682d5a1448df24f2ea97532f220c815d6e WatchSource:0}: Error finding container c315b8103d22282074d0e34f27c44d682d5a1448df24f2ea97532f220c815d6e: Status 404 returned error can't find the container with id c315b8103d22282074d0e34f27c44d682d5a1448df24f2ea97532f220c815d6e
Sep 16 14:30:00.731414 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:00.731330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp" event={"ID":"7831a6af-476e-400d-8f93-aeb9b37fe6f3","Type":"ContainerStarted","Data":"c315b8103d22282074d0e34f27c44d682d5a1448df24f2ea97532f220c815d6e"}
Sep 16 14:30:01.737964 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:01.737933    2579 generic.go:356] "Generic (PLEG): container finished" podID="7831a6af-476e-400d-8f93-aeb9b37fe6f3" containerID="c8afede15e256f7f691db96a4af5ae993cfa418c4db979993c3794b8ac8ab23d" exitCode=0
Sep 16 14:30:01.738332 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:01.738012    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp" event={"ID":"7831a6af-476e-400d-8f93-aeb9b37fe6f3","Type":"ContainerDied","Data":"c8afede15e256f7f691db96a4af5ae993cfa418c4db979993c3794b8ac8ab23d"}
Sep 16 14:30:02.873353 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:02.873331    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp"
Sep 16 14:30:03.749731 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:03.749695    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp"
Sep 16 14:30:03.749879 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:03.749725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp" event={"ID":"7831a6af-476e-400d-8f93-aeb9b37fe6f3","Type":"ContainerDied","Data":"c315b8103d22282074d0e34f27c44d682d5a1448df24f2ea97532f220c815d6e"}
Sep 16 14:30:03.749879 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:03.749776    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c315b8103d22282074d0e34f27c44d682d5a1448df24f2ea97532f220c815d6e"
Sep 16 14:30:23.801289 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:23.801254    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"]
Sep 16 14:30:23.801769 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:23.801506    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2" podUID="a2b6495c-19fa-439b-b040-e5f807cd0164" containerName="maas-api" containerID="cri-o://adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37" gracePeriod=30
Sep 16 14:30:23.834026 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:23.833993    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp"]
Sep 16 14:30:23.837161 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:23.837138    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-dffae957-29826150-2sfbp"]
Sep 16 14:30:24.052035 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.051978    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:30:24.179610 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.179574    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-maas-api-tls\") pod \"a2b6495c-19fa-439b-b040-e5f807cd0164\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") "
Sep 16 14:30:24.179776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.179653    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-metrics-certs\") pod \"a2b6495c-19fa-439b-b040-e5f807cd0164\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") "
Sep 16 14:30:24.179776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.179693    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2b6495c-19fa-439b-b040-e5f807cd0164-openshift-service-ca\") pod \"a2b6495c-19fa-439b-b040-e5f807cd0164\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") "
Sep 16 14:30:24.179776 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.179712    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsx76\" (UniqueName: \"kubernetes.io/projected/a2b6495c-19fa-439b-b040-e5f807cd0164-kube-api-access-dsx76\") pod \"a2b6495c-19fa-439b-b040-e5f807cd0164\" (UID: \"a2b6495c-19fa-439b-b040-e5f807cd0164\") "
Sep 16 14:30:24.180261 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.180044    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2b6495c-19fa-439b-b040-e5f807cd0164-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a2b6495c-19fa-439b-b040-e5f807cd0164" (UID: "a2b6495c-19fa-439b-b040-e5f807cd0164"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:30:24.181916 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.181890    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a2b6495c-19fa-439b-b040-e5f807cd0164" (UID: "a2b6495c-19fa-439b-b040-e5f807cd0164"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:30:24.182059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.181939    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2b6495c-19fa-439b-b040-e5f807cd0164-kube-api-access-dsx76" (OuterVolumeSpecName: "kube-api-access-dsx76") pod "a2b6495c-19fa-439b-b040-e5f807cd0164" (UID: "a2b6495c-19fa-439b-b040-e5f807cd0164"). InnerVolumeSpecName "kube-api-access-dsx76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:30:24.182124 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.182086    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a2b6495c-19fa-439b-b040-e5f807cd0164" (UID: "a2b6495c-19fa-439b-b040-e5f807cd0164"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:30:24.280941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.280908    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:30:24.280941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.280936    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2b6495c-19fa-439b-b040-e5f807cd0164-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:30:24.280941 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.280946    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2b6495c-19fa-439b-b040-e5f807cd0164-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:30:24.281184 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.280955    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsx76\" (UniqueName: \"kubernetes.io/projected/a2b6495c-19fa-439b-b040-e5f807cd0164-kube-api-access-dsx76\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:30:24.860310 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.860275    2579 generic.go:356] "Generic (PLEG): container finished" podID="a2b6495c-19fa-439b-b040-e5f807cd0164" containerID="adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37" exitCode=0
Sep 16 14:30:24.860826 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.860329    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"
Sep 16 14:30:24.860826 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.860369    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2" event={"ID":"a2b6495c-19fa-439b-b040-e5f807cd0164","Type":"ContainerDied","Data":"adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37"}
Sep 16 14:30:24.860826 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.860437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2" event={"ID":"a2b6495c-19fa-439b-b040-e5f807cd0164","Type":"ContainerDied","Data":"aea081e56223155eab047bc49d387820141f828f6c59b9094551ed04c5abd5b7"}
Sep 16 14:30:24.860826 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.860475    2579 scope.go:117] "RemoveContainer" containerID="adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37"
Sep 16 14:30:24.870411 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.870394    2579 scope.go:117] "RemoveContainer" containerID="adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37"
Sep 16 14:30:24.870696 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:30:24.870679    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37\": container with ID starting with adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37 not found: ID does not exist" containerID="adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37"
Sep 16 14:30:24.870760 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.870703    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37"} err="failed to get container status \"adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37\": rpc error: code = NotFound desc = could not find container \"adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37\": container with ID starting with adaafde95a88e5ee1ce172a7988b3554e92dcb50e2581cd3daaa7d92f7eafd37 not found: ID does not exist"
Sep 16 14:30:24.887629 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.887600    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"]
Sep 16 14:30:24.890955 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:24.890933    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dffae957-6cf9f7557b-9ghq2"]
Sep 16 14:30:25.116736 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:25.116661    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7831a6af-476e-400d-8f93-aeb9b37fe6f3" path="/var/lib/kubelet/pods/7831a6af-476e-400d-8f93-aeb9b37fe6f3/volumes"
Sep 16 14:30:25.117056 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:30:25.117043    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2b6495c-19fa-439b-b040-e5f807cd0164" path="/var/lib/kubelet/pods/a2b6495c-19fa-439b-b040-e5f807cd0164/volumes"
Sep 16 14:31:24.006946 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:24.006912    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"]
Sep 16 14:31:24.007401 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:24.007139    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy" containerID="cri-o://194ea6af47b28281915e380aac7bc7cac428d7922b37aa99e7b7d926772053f3" gracePeriod=30
Sep 16 14:31:29.211083 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.211054    2579 generic.go:356] "Generic (PLEG): container finished" podID="977cc7d2-b931-4304-9994-74ade71fd50b" containerID="194ea6af47b28281915e380aac7bc7cac428d7922b37aa99e7b7d926772053f3" exitCode=0
Sep 16 14:31:29.211437 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.211111    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" event={"ID":"977cc7d2-b931-4304-9994-74ade71fd50b","Type":"ContainerDied","Data":"194ea6af47b28281915e380aac7bc7cac428d7922b37aa99e7b7d926772053f3"}
Sep 16 14:31:29.211437 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.211157    2579 scope.go:117] "RemoveContainer" containerID="dbb6d7eea2536cd58e2a21076437be92d699610db61d7103b7d041c7cac3ae5c"
Sep 16 14:31:29.258542 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.258517    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:31:29.308385 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308298    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-socket\") pod \"977cc7d2-b931-4304-9994-74ade71fd50b\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") "
Sep 16 14:31:29.308385 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308355    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-credential-socket\") pod \"977cc7d2-b931-4304-9994-74ade71fd50b\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") "
Sep 16 14:31:29.308385 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308378    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/977cc7d2-b931-4304-9994-74ade71fd50b-istio-podinfo\") pod \"977cc7d2-b931-4304-9994-74ade71fd50b\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") "
Sep 16 14:31:29.308701 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308403    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-envoy\") pod \"977cc7d2-b931-4304-9994-74ade71fd50b\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") "
Sep 16 14:31:29.308701 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308430    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqlgg\" (UniqueName: \"kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-kube-api-access-hqlgg\") pod \"977cc7d2-b931-4304-9994-74ade71fd50b\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") "
Sep 16 14:31:29.308701 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308459    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-istio-token\") pod \"977cc7d2-b931-4304-9994-74ade71fd50b\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") "
Sep 16 14:31:29.308701 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308535    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-certs\") pod \"977cc7d2-b931-4304-9994-74ade71fd50b\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") "
Sep 16 14:31:29.308701 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308574    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/977cc7d2-b931-4304-9994-74ade71fd50b-istiod-ca-cert\") pod \"977cc7d2-b931-4304-9994-74ade71fd50b\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") "
Sep 16 14:31:29.308701 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308598    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-data\") pod \"977cc7d2-b931-4304-9994-74ade71fd50b\" (UID: \"977cc7d2-b931-4304-9994-74ade71fd50b\") "
Sep 16 14:31:29.309033 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308706    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "977cc7d2-b931-4304-9994-74ade71fd50b" (UID: "977cc7d2-b931-4304-9994-74ade71fd50b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:31:29.309033 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308857    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "977cc7d2-b931-4304-9994-74ade71fd50b" (UID: "977cc7d2-b931-4304-9994-74ade71fd50b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:31:29.309033 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.308926    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-data" (OuterVolumeSpecName: "istio-data") pod "977cc7d2-b931-4304-9994-74ade71fd50b" (UID: "977cc7d2-b931-4304-9994-74ade71fd50b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:31:29.309033 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.309017    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-credential-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:31:29.309251 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.309034    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-data\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:31:29.309251 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.309077    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:31:29.309251 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.309120    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "977cc7d2-b931-4304-9994-74ade71fd50b" (UID: "977cc7d2-b931-4304-9994-74ade71fd50b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:31:29.309251 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.309237    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/977cc7d2-b931-4304-9994-74ade71fd50b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "977cc7d2-b931-4304-9994-74ade71fd50b" (UID: "977cc7d2-b931-4304-9994-74ade71fd50b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:31:29.310705 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.310678    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/977cc7d2-b931-4304-9994-74ade71fd50b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "977cc7d2-b931-4304-9994-74ade71fd50b" (UID: "977cc7d2-b931-4304-9994-74ade71fd50b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:31:29.310822 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.310699    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-kube-api-access-hqlgg" (OuterVolumeSpecName: "kube-api-access-hqlgg") pod "977cc7d2-b931-4304-9994-74ade71fd50b" (UID: "977cc7d2-b931-4304-9994-74ade71fd50b"). InnerVolumeSpecName "kube-api-access-hqlgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:31:29.310964 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.310943    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "977cc7d2-b931-4304-9994-74ade71fd50b" (UID: "977cc7d2-b931-4304-9994-74ade71fd50b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:31:29.311111 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.311084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-istio-token" (OuterVolumeSpecName: "istio-token") pod "977cc7d2-b931-4304-9994-74ade71fd50b" (UID: "977cc7d2-b931-4304-9994-74ade71fd50b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:31:29.409926 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.409893    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/977cc7d2-b931-4304-9994-74ade71fd50b-istio-podinfo\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:31:29.409926 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.409916    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-istio-envoy\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:31:29.409926 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.409925    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqlgg\" (UniqueName: \"kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-kube-api-access-hqlgg\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:31:29.409926 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.409934    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/977cc7d2-b931-4304-9994-74ade71fd50b-istio-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:31:29.410195 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.409942    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/977cc7d2-b931-4304-9994-74ade71fd50b-workload-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:31:29.410195 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:29.409950    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/977cc7d2-b931-4304-9994-74ade71fd50b-istiod-ca-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:31:30.219128 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:30.219092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz" event={"ID":"977cc7d2-b931-4304-9994-74ade71fd50b","Type":"ContainerDied","Data":"80bc6036dfe9a430740d8b59e3dbc6dc5e001a04ae059bd10506dba31b8760fc"}
Sep 16 14:31:30.219128 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:30.219119    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"
Sep 16 14:31:30.219575 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:30.219159    2579 scope.go:117] "RemoveContainer" containerID="194ea6af47b28281915e380aac7bc7cac428d7922b37aa99e7b7d926772053f3"
Sep 16 14:31:30.252339 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:30.252316    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"]
Sep 16 14:31:30.263529 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:30.263506    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dffae957-openshift-default-6947df99b8-8p6sz"]
Sep 16 14:31:31.118722 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:31:31.118696    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" path="/var/lib/kubelet/pods/977cc7d2-b931-4304-9994-74ade71fd50b/volumes"
Sep 16 14:32:38.141540 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.141497    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"]
Sep 16 14:32:38.142127 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.142063    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy"
Sep 16 14:32:38.142127 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.142082    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy"
Sep 16 14:32:38.142127 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.142108    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7831a6af-476e-400d-8f93-aeb9b37fe6f3" containerName="cleanup"
Sep 16 14:32:38.142127 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.142116    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7831a6af-476e-400d-8f93-aeb9b37fe6f3" containerName="cleanup"
Sep 16 14:32:38.142351 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.142144    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2b6495c-19fa-439b-b040-e5f807cd0164" containerName="maas-api"
Sep 16 14:32:38.142351 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.142153    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2b6495c-19fa-439b-b040-e5f807cd0164" containerName="maas-api"
Sep 16 14:32:38.142351 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.142245    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2b6495c-19fa-439b-b040-e5f807cd0164" containerName="maas-api"
Sep 16 14:32:38.142351 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.142260    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy"
Sep 16 14:32:38.142351 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.142272    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy"
Sep 16 14:32:38.142351 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.142282    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7831a6af-476e-400d-8f93-aeb9b37fe6f3" containerName="cleanup"
Sep 16 14:32:38.145638 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.145617    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.149734 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.149710    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-b77fde-openshift-default-dockercfg-lxkzb\""
Sep 16 14:32:38.171964 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.171940    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"]
Sep 16 14:32:38.237598 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.237541    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-data\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.237768 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.237632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-credential-socket\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.237768 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.237658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-envoy\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.237768 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.237698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-podinfo\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.237768 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.237722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-token\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.237768 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.237759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-socket\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.237944 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.237828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-certs\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.237944 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.237878    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c303976d-a602-4d88-b315-bfa0781f0ef7-istiod-ca-cert\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.237944 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.237934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chs6j\" (UniqueName: \"kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-kube-api-access-chs6j\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339223 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chs6j\" (UniqueName: \"kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-kube-api-access-chs6j\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339223 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339229    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-data\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-credential-socket\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339284    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-envoy\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-podinfo\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-token\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339724 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-socket\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339724 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-certs\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339724 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c303976d-a602-4d88-b315-bfa0781f0ef7-istiod-ca-cert\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339890 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339762    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-data\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339890 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339832    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-credential-socket\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339995 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-certs\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.339995 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.339979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-socket\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.340211 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.340190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c303976d-a602-4d88-b315-bfa0781f0ef7-istiod-ca-cert\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.341630 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.341610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-envoy\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.341888 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.341872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-podinfo\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.348798 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.348774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-token\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.351783 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.351761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chs6j\" (UniqueName: \"kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-kube-api-access-chs6j\") pod \"e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") " pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.455803 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.455772    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:38.742421 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.742393    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"]
Sep 16 14:32:38.744124 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:32:38.744094    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc303976d_a602_4d88_b315_bfa0781f0ef7.slice/crio-bcd5e08b4a0653a2379cb4a0f9dc8a175e56c163ac74cf7fbe5f9adfc6bad11a WatchSource:0}: Error finding container bcd5e08b4a0653a2379cb4a0f9dc8a175e56c163ac74cf7fbe5f9adfc6bad11a: Status 404 returned error can't find the container with id bcd5e08b4a0653a2379cb4a0f9dc8a175e56c163ac74cf7fbe5f9adfc6bad11a
Sep 16 14:32:38.746178 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.746148    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:32:38.746244 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.746210    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:32:38.746281 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:38.746257    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:32:39.574228 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:39.574193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" event={"ID":"c303976d-a602-4d88-b315-bfa0781f0ef7","Type":"ContainerStarted","Data":"ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357"}
Sep 16 14:32:39.574622 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:39.574247    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" event={"ID":"c303976d-a602-4d88-b315-bfa0781f0ef7","Type":"ContainerStarted","Data":"bcd5e08b4a0653a2379cb4a0f9dc8a175e56c163ac74cf7fbe5f9adfc6bad11a"}
Sep 16 14:32:39.604295 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:39.604208    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" podStartSLOduration=1.6041914529999999 podStartE2EDuration="1.604191453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:32:39.602786156 +0000 UTC m=+1698.902196423" watchObservedRunningTime="2026-09-16 14:32:39.604191453 +0000 UTC m=+1698.903601719"
Sep 16 14:32:40.456490 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:40.456455    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:40.461587 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:40.461543    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:40.579974 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:40.579949    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:40.580824 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:40.580802    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:32:46.828202 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:46.828128    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"]
Sep 16 14:32:46.828677 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:46.828605    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy"
Sep 16 14:32:46.828677 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:46.828625    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="977cc7d2-b931-4304-9994-74ade71fd50b" containerName="istio-proxy"
Sep 16 14:32:46.832008 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:46.831988    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:46.838426 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:46.838405    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-b77fde-serving-cert\""
Sep 16 14:32:46.850225 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:46.850202    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"]
Sep 16 14:32:46.925584 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:46.925543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkb2p\" (UniqueName: \"kubernetes.io/projected/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-kube-api-access-kkb2p\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:46.925742 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:46.925659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:46.925742 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:46.925702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-metrics-certs\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:46.925742 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:46.925722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:47.026858 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:47.026820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkb2p\" (UniqueName: \"kubernetes.io/projected/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-kube-api-access-kkb2p\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:47.027024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:47.026931    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:47.027024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:47.026978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-metrics-certs\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:47.027024 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:47.027005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:47.027193 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:32:47.027123    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-serving-cert: secret "maas-api-e2e-ipp-a-b77fde-serving-cert" not found
Sep 16 14:32:47.027248 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:32:47.027196    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-maas-api-tls podName:6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2 nodeName:}" failed. No retries permitted until 2026-09-16 14:32:47.52718011 +0000 UTC m=+1706.826590375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-maas-api-tls") pod "maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n" (UID: "6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2") : secret "maas-api-e2e-ipp-a-b77fde-serving-cert" not found
Sep 16 14:32:47.027635 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:47.027605    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:47.029438 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:47.029411    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-metrics-certs\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:47.050484 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:47.050460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkb2p\" (UniqueName: \"kubernetes.io/projected/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-kube-api-access-kkb2p\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:47.533485 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:47.533453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:47.535852 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:47.535833    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:47.742989 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:47.742955    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:48.028959 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:48.028927    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"]
Sep 16 14:32:48.031411 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:32:48.031382    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8f71e8_89c2_4ba2_846d_4b8e7248b5a2.slice/crio-94eb9cac37c2721e961034d31da750a0a453bf098664894a4ce48236147ab5bb WatchSource:0}: Error finding container 94eb9cac37c2721e961034d31da750a0a453bf098664894a4ce48236147ab5bb: Status 404 returned error can't find the container with id 94eb9cac37c2721e961034d31da750a0a453bf098664894a4ce48236147ab5bb
Sep 16 14:32:48.627714 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:48.627677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n" event={"ID":"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2","Type":"ContainerStarted","Data":"94eb9cac37c2721e961034d31da750a0a453bf098664894a4ce48236147ab5bb"}
Sep 16 14:32:48.919530 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:48.919493    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"]
Sep 16 14:32:48.923691 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:48.923669    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:48.926675 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:48.926653    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-7b98f7-serving-cert\""
Sep 16 14:32:48.939066 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:48.939030    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"]
Sep 16 14:32:48.946466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:48.946439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-metrics-certs\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:48.946611 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:48.946508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4dsb\" (UniqueName: \"kubernetes.io/projected/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-kube-api-access-m4dsb\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:48.946679 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:48.946656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-maas-api-tls\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:48.946740 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:48.946724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-openshift-service-ca\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:49.047482 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.047443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-openshift-service-ca\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:49.047994 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.047520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-metrics-certs\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:49.047994 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.047586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4dsb\" (UniqueName: \"kubernetes.io/projected/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-kube-api-access-m4dsb\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:49.047994 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.047676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-maas-api-tls\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:49.047994 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:32:49.047803    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-serving-cert: secret "maas-api-e2e-api-a-7b98f7-serving-cert" not found
Sep 16 14:32:49.047994 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:32:49.047874    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-maas-api-tls podName:bd1bfc79-9619-40cf-9bd3-04f71b60e3bb nodeName:}" failed. No retries permitted until 2026-09-16 14:32:49.54785342 +0000 UTC m=+1708.847263682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-maas-api-tls") pod "maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb" (UID: "bd1bfc79-9619-40cf-9bd3-04f71b60e3bb") : secret "maas-api-e2e-api-a-7b98f7-serving-cert" not found
Sep 16 14:32:49.048314 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.048244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-openshift-service-ca\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:49.050753 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.050725    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-metrics-certs\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:49.065909 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.065842    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4dsb\" (UniqueName: \"kubernetes.io/projected/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-kube-api-access-m4dsb\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:49.551450 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.551418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-maas-api-tls\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:49.553887 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.553865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-maas-api-tls\") pod \"maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:49.635061 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.635022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n" event={"ID":"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2","Type":"ContainerStarted","Data":"ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435"}
Sep 16 14:32:49.635262 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.635140    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:49.667972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.667912    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n" podStartSLOduration=3.026481297 podStartE2EDuration="3.667892937s" totalImagesPullingTime="641.41164ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:32:49.667043713 +0000 UTC m=+1708.966454001" watchObservedRunningTime="2026-09-16 14:32:49.667892937 +0000 UTC m=+1708.967303204"
Sep 16 14:32:49.834826 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:49.834729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:50.138990 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:50.138961    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"]
Sep 16 14:32:50.141535 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:32:50.141498    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1bfc79_9619_40cf_9bd3_04f71b60e3bb.slice/crio-44d983673cdea75dc2fddeb60f96311fba972b90a820e30cca6cb4321956afc5 WatchSource:0}: Error finding container 44d983673cdea75dc2fddeb60f96311fba972b90a820e30cca6cb4321956afc5: Status 404 returned error can't find the container with id 44d983673cdea75dc2fddeb60f96311fba972b90a820e30cca6cb4321956afc5
Sep 16 14:32:50.642062 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:50.642032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb" event={"ID":"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb","Type":"ContainerStarted","Data":"b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591"}
Sep 16 14:32:50.642217 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:50.642087    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb" event={"ID":"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb","Type":"ContainerStarted","Data":"44d983673cdea75dc2fddeb60f96311fba972b90a820e30cca6cb4321956afc5"}
Sep 16 14:32:50.642217 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:50.642118    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:32:50.668480 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:50.668438    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb" podStartSLOduration=2.245649914 podStartE2EDuration="2.668421294s" totalImagesPullingTime="422.77138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:32:50.665536312 +0000 UTC m=+1709.964946590" watchObservedRunningTime="2026-09-16 14:32:50.668421294 +0000 UTC m=+1709.967831629"
Sep 16 14:32:55.647987 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:55.647955    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:32:56.653427 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:32:56.653397    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:33:09.753828 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:09.753794    2579 generic.go:356] "Generic (PLEG): container finished" podID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerID="ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357" exitCode=0
Sep 16 14:33:09.754248 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:09.753869    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" event={"ID":"c303976d-a602-4d88-b315-bfa0781f0ef7","Type":"ContainerDied","Data":"ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357"}
Sep 16 14:33:09.754293 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:09.754255    2579 scope.go:117] "RemoveContainer" containerID="ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357"
Sep 16 14:33:09.755383 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:09.755355    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:33:09.755475 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:09.755423    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:33:09.755475 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:09.755454    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:33:10.580252 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:10.580219    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:33:10.762049 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:10.762016    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" event={"ID":"c303976d-a602-4d88-b315-bfa0781f0ef7","Type":"ContainerStarted","Data":"a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9"}
Sep 16 14:33:11.455951 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:11.455912    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:33:11.457329 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:11.457299    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 16 14:33:11.457466 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:11.457349    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 16 14:33:12.457184 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:12.457144    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 16 14:33:12.457606 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:12.457217    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 16 14:33:13.456269 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:13.456235    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 16 14:33:13.456451 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:13.456313    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 16 14:33:14.456460 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:14.456421    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 16 14:33:14.456873 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:14.456479    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 16 14:33:15.456099 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:15.456066    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 16 14:33:15.456290 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:15.456114    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 16 14:33:16.460335 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:16.460304    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:33:16.460753 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:16.460652    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:33:16.461297 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:16.461281    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:33:23.362034 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.361995    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"]
Sep 16 14:33:23.371747 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.371726    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:23.374365 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.374333    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-927f98-serving-cert\""
Sep 16 14:33:23.381348 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.381322    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"]
Sep 16 14:33:23.486513 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.486478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-maas-api-tls\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:23.486709 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.486566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6888\" (UniqueName: \"kubernetes.io/projected/2a0b2cd5-56c4-4119-bc64-fca589dd0127-kube-api-access-z6888\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:23.486709 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.486627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-metrics-certs\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:23.486709 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.486651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a0b2cd5-56c4-4119-bc64-fca589dd0127-openshift-service-ca\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:23.587752 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.587714    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6888\" (UniqueName: \"kubernetes.io/projected/2a0b2cd5-56c4-4119-bc64-fca589dd0127-kube-api-access-z6888\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:23.587921 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.587786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-metrics-certs\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:23.587921 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.587804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a0b2cd5-56c4-4119-bc64-fca589dd0127-openshift-service-ca\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:23.588017 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.587937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-maas-api-tls\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:23.588073 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:33:23.588051    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-serving-cert: secret "maas-api-e2e-api-b-927f98-serving-cert" not found
Sep 16 14:33:23.588140 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:33:23.588127    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-maas-api-tls podName:2a0b2cd5-56c4-4119-bc64-fca589dd0127 nodeName:}" failed. No retries permitted until 2026-09-16 14:33:24.088107455 +0000 UTC m=+1743.387517705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-maas-api-tls") pod "maas-api-e2e-api-b-927f98-c6959478b-fcd4t" (UID: "2a0b2cd5-56c4-4119-bc64-fca589dd0127") : secret "maas-api-e2e-api-b-927f98-serving-cert" not found
Sep 16 14:33:23.588635 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.588615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a0b2cd5-56c4-4119-bc64-fca589dd0127-openshift-service-ca\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:23.590363 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.590346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-metrics-certs\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:23.597647 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:23.597622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6888\" (UniqueName: \"kubernetes.io/projected/2a0b2cd5-56c4-4119-bc64-fca589dd0127-kube-api-access-z6888\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:24.094430 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:24.094402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-maas-api-tls\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:24.097338 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:24.097308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-maas-api-tls\") pod \"maas-api-e2e-api-b-927f98-c6959478b-fcd4t\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:24.285692 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:24.285657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:24.571953 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:24.571927    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"]
Sep 16 14:33:24.574499 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:33:24.574473    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0b2cd5_56c4_4119_bc64_fca589dd0127.slice/crio-281a37ece684c51d61d579e24f8588d0643d49f2a2c9a647cd58c7933ecbf3c3 WatchSource:0}: Error finding container 281a37ece684c51d61d579e24f8588d0643d49f2a2c9a647cd58c7933ecbf3c3: Status 404 returned error can't find the container with id 281a37ece684c51d61d579e24f8588d0643d49f2a2c9a647cd58c7933ecbf3c3
Sep 16 14:33:24.843661 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:24.843576    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t" event={"ID":"2a0b2cd5-56c4-4119-bc64-fca589dd0127","Type":"ContainerStarted","Data":"281a37ece684c51d61d579e24f8588d0643d49f2a2c9a647cd58c7933ecbf3c3"}
Sep 16 14:33:25.850188 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:25.850152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t" event={"ID":"2a0b2cd5-56c4-4119-bc64-fca589dd0127","Type":"ContainerStarted","Data":"277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5"}
Sep 16 14:33:25.850632 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:25.850285    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:33:25.869957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:25.869899    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t" podStartSLOduration=2.518476 podStartE2EDuration="2.869884376s" totalImagesPullingTime="351.408376ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:33:25.868916276 +0000 UTC m=+1745.168326542" watchObservedRunningTime="2026-09-16 14:33:25.869884376 +0000 UTC m=+1745.169294644"
Sep 16 14:33:31.864439 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:33:31.864411    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:34:05.431898 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.431860    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"]
Sep 16 14:34:05.432425 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.432073    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb" podUID="bd1bfc79-9619-40cf-9bd3-04f71b60e3bb" containerName="maas-api" containerID="cri-o://b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591" gracePeriod=30
Sep 16 14:34:05.682914 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.682848    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:34:05.792582 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.792530    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-maas-api-tls\") pod \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") "
Sep 16 14:34:05.792770 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.792653    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4dsb\" (UniqueName: \"kubernetes.io/projected/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-kube-api-access-m4dsb\") pod \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") "
Sep 16 14:34:05.792770 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.792673    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-openshift-service-ca\") pod \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") "
Sep 16 14:34:05.792770 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.792712    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-metrics-certs\") pod \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\" (UID: \"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb\") "
Sep 16 14:34:05.793115 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.793078    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd1bfc79-9619-40cf-9bd3-04f71b60e3bb" (UID: "bd1bfc79-9619-40cf-9bd3-04f71b60e3bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:34:05.794862 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.794825    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bd1bfc79-9619-40cf-9bd3-04f71b60e3bb" (UID: "bd1bfc79-9619-40cf-9bd3-04f71b60e3bb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:34:05.794982 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.794871    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd1bfc79-9619-40cf-9bd3-04f71b60e3bb" (UID: "bd1bfc79-9619-40cf-9bd3-04f71b60e3bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:34:05.794982 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.794961    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-kube-api-access-m4dsb" (OuterVolumeSpecName: "kube-api-access-m4dsb") pod "bd1bfc79-9619-40cf-9bd3-04f71b60e3bb" (UID: "bd1bfc79-9619-40cf-9bd3-04f71b60e3bb"). InnerVolumeSpecName "kube-api-access-m4dsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:34:05.893690 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.893656    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:34:05.893690 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.893687    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4dsb\" (UniqueName: \"kubernetes.io/projected/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-kube-api-access-m4dsb\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:34:05.893690 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.893698    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:34:05.893935 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:05.893706    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:34:06.062611 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:06.062491    2579 generic.go:356] "Generic (PLEG): container finished" podID="bd1bfc79-9619-40cf-9bd3-04f71b60e3bb" containerID="b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591" exitCode=0
Sep 16 14:34:06.062611 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:06.062556    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"
Sep 16 14:34:06.062611 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:06.062585    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb" event={"ID":"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb","Type":"ContainerDied","Data":"b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591"}
Sep 16 14:34:06.062889 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:06.062658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb" event={"ID":"bd1bfc79-9619-40cf-9bd3-04f71b60e3bb","Type":"ContainerDied","Data":"44d983673cdea75dc2fddeb60f96311fba972b90a820e30cca6cb4321956afc5"}
Sep 16 14:34:06.062889 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:06.062680    2579 scope.go:117] "RemoveContainer" containerID="b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591"
Sep 16 14:34:06.076371 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:06.076354    2579 scope.go:117] "RemoveContainer" containerID="b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591"
Sep 16 14:34:06.076698 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:34:06.076675    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591\": container with ID starting with b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591 not found: ID does not exist" containerID="b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591"
Sep 16 14:34:06.076812 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:06.076709    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591"} err="failed to get container status \"b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591\": rpc error: code = NotFound desc = could not find container \"b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591\": container with ID starting with b19de8e32fe2013c9192399376502c20e23eedbe5a0900c0f2d1689b0bd2e591 not found: ID does not exist"
Sep 16 14:34:06.088918 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:06.088894    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"]
Sep 16 14:34:06.090940 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:06.090920    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b98f7-6cbc779c55-k6mwb"]
Sep 16 14:34:07.117293 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:07.117257    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd1bfc79-9619-40cf-9bd3-04f71b60e3bb" path="/var/lib/kubelet/pods/bd1bfc79-9619-40cf-9bd3-04f71b60e3bb/volumes"
Sep 16 14:34:21.192362 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:21.192326    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:34:21.197808 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:21.197782    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:34:29.421452 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.421419    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"]
Sep 16 14:34:29.422022 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.421680    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t" podUID="2a0b2cd5-56c4-4119-bc64-fca589dd0127" containerName="maas-api" containerID="cri-o://277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5" gracePeriod=30
Sep 16 14:34:29.679106 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.679044    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:34:29.824925 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.824892    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-maas-api-tls\") pod \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") "
Sep 16 14:34:29.825097 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.824931    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-metrics-certs\") pod \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") "
Sep 16 14:34:29.825097 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.824997    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6888\" (UniqueName: \"kubernetes.io/projected/2a0b2cd5-56c4-4119-bc64-fca589dd0127-kube-api-access-z6888\") pod \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") "
Sep 16 14:34:29.825097 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.825079    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a0b2cd5-56c4-4119-bc64-fca589dd0127-openshift-service-ca\") pod \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\" (UID: \"2a0b2cd5-56c4-4119-bc64-fca589dd0127\") "
Sep 16 14:34:29.825524 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.825495    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a0b2cd5-56c4-4119-bc64-fca589dd0127-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a0b2cd5-56c4-4119-bc64-fca589dd0127" (UID: "2a0b2cd5-56c4-4119-bc64-fca589dd0127"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:34:29.827168 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.827137    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a0b2cd5-56c4-4119-bc64-fca589dd0127-kube-api-access-z6888" (OuterVolumeSpecName: "kube-api-access-z6888") pod "2a0b2cd5-56c4-4119-bc64-fca589dd0127" (UID: "2a0b2cd5-56c4-4119-bc64-fca589dd0127"). InnerVolumeSpecName "kube-api-access-z6888". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:34:29.827424 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.827402    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2a0b2cd5-56c4-4119-bc64-fca589dd0127" (UID: "2a0b2cd5-56c4-4119-bc64-fca589dd0127"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:34:29.827483 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.827418    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a0b2cd5-56c4-4119-bc64-fca589dd0127" (UID: "2a0b2cd5-56c4-4119-bc64-fca589dd0127"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:34:29.926208 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.926172    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a0b2cd5-56c4-4119-bc64-fca589dd0127-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:34:29.926208 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.926201    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:34:29.926208 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.926211    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a0b2cd5-56c4-4119-bc64-fca589dd0127-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:34:29.926208 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:29.926219    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6888\" (UniqueName: \"kubernetes.io/projected/2a0b2cd5-56c4-4119-bc64-fca589dd0127-kube-api-access-z6888\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:34:30.192922 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:30.192884    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a0b2cd5-56c4-4119-bc64-fca589dd0127" containerID="277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5" exitCode=0
Sep 16 14:34:30.193087 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:30.192947    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"
Sep 16 14:34:30.193087 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:30.192962    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t" event={"ID":"2a0b2cd5-56c4-4119-bc64-fca589dd0127","Type":"ContainerDied","Data":"277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5"}
Sep 16 14:34:30.193087 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:30.193007    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t" event={"ID":"2a0b2cd5-56c4-4119-bc64-fca589dd0127","Type":"ContainerDied","Data":"281a37ece684c51d61d579e24f8588d0643d49f2a2c9a647cd58c7933ecbf3c3"}
Sep 16 14:34:30.193087 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:30.193030    2579 scope.go:117] "RemoveContainer" containerID="277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5"
Sep 16 14:34:30.202361 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:30.202344    2579 scope.go:117] "RemoveContainer" containerID="277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5"
Sep 16 14:34:30.202642 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:34:30.202623    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5\": container with ID starting with 277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5 not found: ID does not exist" containerID="277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5"
Sep 16 14:34:30.202687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:30.202650    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5"} err="failed to get container status \"277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5\": rpc error: code = NotFound desc = could not find container \"277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5\": container with ID starting with 277c7035ddcdeee4ac73897910eb5cb204cc942ba03e1b452e34f12ef3331bd5 not found: ID does not exist"
Sep 16 14:34:30.224674 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:30.224650    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"]
Sep 16 14:34:30.229059 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:30.229032    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-927f98-c6959478b-fcd4t"]
Sep 16 14:34:31.117066 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:31.117033    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a0b2cd5-56c4-4119-bc64-fca589dd0127" path="/var/lib/kubelet/pods/2a0b2cd5-56c4-4119-bc64-fca589dd0127/volumes"
Sep 16 14:34:36.936227 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:36.936189    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"]
Sep 16 14:34:36.936792 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:36.936640    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a0b2cd5-56c4-4119-bc64-fca589dd0127" containerName="maas-api"
Sep 16 14:34:36.936792 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:36.936658    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a0b2cd5-56c4-4119-bc64-fca589dd0127" containerName="maas-api"
Sep 16 14:34:36.936792 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:36.936684    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd1bfc79-9619-40cf-9bd3-04f71b60e3bb" containerName="maas-api"
Sep 16 14:34:36.936792 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:36.936693    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd1bfc79-9619-40cf-9bd3-04f71b60e3bb" containerName="maas-api"
Sep 16 14:34:36.937031 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:36.936797    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd1bfc79-9619-40cf-9bd3-04f71b60e3bb" containerName="maas-api"
Sep 16 14:34:36.937031 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:36.936814    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a0b2cd5-56c4-4119-bc64-fca589dd0127" containerName="maas-api"
Sep 16 14:34:36.941721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:36.941697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:36.951768 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:36.951750    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-80d46a-openshift-default-dockercfg-gzb6n\""
Sep 16 14:34:36.961745 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:36.961721    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"]
Sep 16 14:34:37.093880 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.093850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-podinfo\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.094060 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.093897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-credential-socket\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.094060 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.093938    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-data\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.094060 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.093966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-envoy\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.094232 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.094080    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-socket\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.094232 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.094138    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffxmw\" (UniqueName: \"kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-kube-api-access-ffxmw\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.094232 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.094182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbba2bfb-b110-49f3-8151-82e08b29d131-istiod-ca-cert\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.094232 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.094210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-token\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.094382 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.094242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-certs\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195095 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-envoy\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195095 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-socket\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195316 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffxmw\" (UniqueName: \"kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-kube-api-access-ffxmw\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195316 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbba2bfb-b110-49f3-8151-82e08b29d131-istiod-ca-cert\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195316 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-token\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195316 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-certs\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195316 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195250    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-podinfo\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195316 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-credential-socket\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-data\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195519    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-socket\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-certs\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195856 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-data\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195856 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-credential-socket\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.195946 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.195927    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbba2bfb-b110-49f3-8151-82e08b29d131-istiod-ca-cert\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.197404 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.197385    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-envoy\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.197748 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.197731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-podinfo\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.203472 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.203443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-token\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.203801 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.203786    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffxmw\" (UniqueName: \"kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-kube-api-access-ffxmw\") pod \"e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") " pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.253313 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.253286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:37.542304 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.542223    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"]
Sep 16 14:34:37.546103 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:34:37.546071    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbba2bfb_b110_49f3_8151_82e08b29d131.slice/crio-93e2a8e56b4a29e0f522b3db093c4a23c4978550382830527b8b1600a05a8a82 WatchSource:0}: Error finding container 93e2a8e56b4a29e0f522b3db093c4a23c4978550382830527b8b1600a05a8a82: Status 404 returned error can't find the container with id 93e2a8e56b4a29e0f522b3db093c4a23c4978550382830527b8b1600a05a8a82
Sep 16 14:34:37.548761 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.548728    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:34:37.548874 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.548810    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:34:37.548874 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:37.548854    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:34:38.237085 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:38.237047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" event={"ID":"cbba2bfb-b110-49f3-8151-82e08b29d131","Type":"ContainerStarted","Data":"5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e"}
Sep 16 14:34:38.237442 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:38.237108    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" event={"ID":"cbba2bfb-b110-49f3-8151-82e08b29d131","Type":"ContainerStarted","Data":"93e2a8e56b4a29e0f522b3db093c4a23c4978550382830527b8b1600a05a8a82"}
Sep 16 14:34:38.254325 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:38.254290    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:38.256087 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:38.256042    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 16 14:34:38.256242 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:38.256104    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 16 14:34:38.270116 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:38.270060    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" podStartSLOduration=2.270038207 podStartE2EDuration="2.270038207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:34:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:34:38.267448471 +0000 UTC m=+1817.566858740" watchObservedRunningTime="2026-09-16 14:34:38.270038207 +0000 UTC m=+1817.569448475"
Sep 16 14:34:39.258281 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:39.258252    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:40.247071 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:40.247042    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:34:40.248019 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:34:40.247998    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:35:03.370404 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:03.370368    2579 generic.go:356] "Generic (PLEG): container finished" podID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerID="5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e" exitCode=0
Sep 16 14:35:03.370992 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:03.370430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" event={"ID":"cbba2bfb-b110-49f3-8151-82e08b29d131","Type":"ContainerDied","Data":"5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e"}
Sep 16 14:35:03.370992 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:03.370942    2579 scope.go:117] "RemoveContainer" containerID="5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e"
Sep 16 14:35:03.372179 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:03.372148    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:35:03.372303 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:03.372233    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:35:03.372303 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:03.372281    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:35:04.378715 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:04.378684    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" event={"ID":"cbba2bfb-b110-49f3-8151-82e08b29d131","Type":"ContainerStarted","Data":"a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898"}
Sep 16 14:35:05.254404 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:05.254373    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:35:05.254632 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:05.254609    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 16 14:35:05.254698 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:05.254657    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 16 14:35:06.254472 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:06.254434    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 16 14:35:06.254880 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:06.254492    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 16 14:35:07.254536 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:07.254495    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 16 14:35:07.254992 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:07.254583    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 16 14:35:08.253998 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:08.253957    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 16 14:35:08.254179 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:08.254018    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 16 14:35:09.253962 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:09.253921    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 16 14:35:09.254423 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:09.253981    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 16 14:35:10.247653 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:10.247621    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:35:10.258259 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:10.258232    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:35:10.424073 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:10.424047    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:35:48.879462 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:48.879381    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"]
Sep 16 14:35:48.879968 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:48.879728    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerName="istio-proxy" containerID="cri-o://a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898" gracePeriod=30
Sep 16 14:35:54.138645 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.138621    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:35:54.288356 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.288315    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-data\") pod \"cbba2bfb-b110-49f3-8151-82e08b29d131\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") "
Sep 16 14:35:54.288607 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.288374    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-podinfo\") pod \"cbba2bfb-b110-49f3-8151-82e08b29d131\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") "
Sep 16 14:35:54.288607 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.288405    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-token\") pod \"cbba2bfb-b110-49f3-8151-82e08b29d131\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") "
Sep 16 14:35:54.288607 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.288445    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffxmw\" (UniqueName: \"kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-kube-api-access-ffxmw\") pod \"cbba2bfb-b110-49f3-8151-82e08b29d131\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") "
Sep 16 14:35:54.288607 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.288502    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-socket\") pod \"cbba2bfb-b110-49f3-8151-82e08b29d131\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") "
Sep 16 14:35:54.288607 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.288540    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-credential-socket\") pod \"cbba2bfb-b110-49f3-8151-82e08b29d131\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") "
Sep 16 14:35:54.288897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.288635    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbba2bfb-b110-49f3-8151-82e08b29d131-istiod-ca-cert\") pod \"cbba2bfb-b110-49f3-8151-82e08b29d131\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") "
Sep 16 14:35:54.288897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.288671    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-envoy\") pod \"cbba2bfb-b110-49f3-8151-82e08b29d131\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") "
Sep 16 14:35:54.288897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.288710    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-certs\") pod \"cbba2bfb-b110-49f3-8151-82e08b29d131\" (UID: \"cbba2bfb-b110-49f3-8151-82e08b29d131\") "
Sep 16 14:35:54.288897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.288727    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-data" (OuterVolumeSpecName: "istio-data") pod "cbba2bfb-b110-49f3-8151-82e08b29d131" (UID: "cbba2bfb-b110-49f3-8151-82e08b29d131"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:35:54.288897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.288830    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cbba2bfb-b110-49f3-8151-82e08b29d131" (UID: "cbba2bfb-b110-49f3-8151-82e08b29d131"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:35:54.289149 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.289046    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cbba2bfb-b110-49f3-8151-82e08b29d131" (UID: "cbba2bfb-b110-49f3-8151-82e08b29d131"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:35:54.289149 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.289053    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbba2bfb-b110-49f3-8151-82e08b29d131-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cbba2bfb-b110-49f3-8151-82e08b29d131" (UID: "cbba2bfb-b110-49f3-8151-82e08b29d131"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:35:54.289149 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.289104    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cbba2bfb-b110-49f3-8151-82e08b29d131" (UID: "cbba2bfb-b110-49f3-8151-82e08b29d131"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:35:54.289149 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.289137    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:35:54.289336 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.289155    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-data\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:35:54.289336 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.289169    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-workload-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:35:54.290838 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.290815    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cbba2bfb-b110-49f3-8151-82e08b29d131" (UID: "cbba2bfb-b110-49f3-8151-82e08b29d131"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:35:54.290838 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.290833    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-token" (OuterVolumeSpecName: "istio-token") pod "cbba2bfb-b110-49f3-8151-82e08b29d131" (UID: "cbba2bfb-b110-49f3-8151-82e08b29d131"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:35:54.291207 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.291188    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-kube-api-access-ffxmw" (OuterVolumeSpecName: "kube-api-access-ffxmw") pod "cbba2bfb-b110-49f3-8151-82e08b29d131" (UID: "cbba2bfb-b110-49f3-8151-82e08b29d131"). InnerVolumeSpecName "kube-api-access-ffxmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:35:54.291267 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.291208    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cbba2bfb-b110-49f3-8151-82e08b29d131" (UID: "cbba2bfb-b110-49f3-8151-82e08b29d131"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:35:54.390499 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.390464    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-podinfo\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:35:54.390499 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.390494    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:35:54.390499 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.390505    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffxmw\" (UniqueName: \"kubernetes.io/projected/cbba2bfb-b110-49f3-8151-82e08b29d131-kube-api-access-ffxmw\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:35:54.390770 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.390515    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-credential-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:35:54.390770 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.390523    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbba2bfb-b110-49f3-8151-82e08b29d131-istiod-ca-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:35:54.390770 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.390531    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbba2bfb-b110-49f3-8151-82e08b29d131-istio-envoy\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:35:54.670081 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.670051    2579 generic.go:356] "Generic (PLEG): container finished" podID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerID="a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898" exitCode=0
Sep 16 14:35:54.670254 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.670100    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"
Sep 16 14:35:54.670254 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.670109    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" event={"ID":"cbba2bfb-b110-49f3-8151-82e08b29d131","Type":"ContainerDied","Data":"a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898"}
Sep 16 14:35:54.670254 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.670151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b" event={"ID":"cbba2bfb-b110-49f3-8151-82e08b29d131","Type":"ContainerDied","Data":"93e2a8e56b4a29e0f522b3db093c4a23c4978550382830527b8b1600a05a8a82"}
Sep 16 14:35:54.670254 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.670172    2579 scope.go:117] "RemoveContainer" containerID="a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898"
Sep 16 14:35:54.690063 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.690043    2579 scope.go:117] "RemoveContainer" containerID="5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e"
Sep 16 14:35:54.698834 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.698814    2579 scope.go:117] "RemoveContainer" containerID="a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898"
Sep 16 14:35:54.699183 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:35:54.699118    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898\": container with ID starting with a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898 not found: ID does not exist" containerID="a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898"
Sep 16 14:35:54.699183 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.699150    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898"} err="failed to get container status \"a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898\": rpc error: code = NotFound desc = could not find container \"a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898\": container with ID starting with a13a5473fcb5cb3d92d5769d835b0056f1d693a6e683910cfd59a767225d8898 not found: ID does not exist"
Sep 16 14:35:54.699183 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.699175    2579 scope.go:117] "RemoveContainer" containerID="5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e"
Sep 16 14:35:54.700173 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:35:54.699870    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e\": container with ID starting with 5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e not found: ID does not exist" containerID="5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e"
Sep 16 14:35:54.700173 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.699939    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e"} err="failed to get container status \"5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e\": rpc error: code = NotFound desc = could not find container \"5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e\": container with ID starting with 5334a55fc0680a06d521db7b42fddabd814397dba442b67ca71e5772b3c1843e not found: ID does not exist"
Sep 16 14:35:54.703223 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.703196    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"]
Sep 16 14:35:54.705534 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:54.705503    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-80d46a-openshift-default-59cb966678-nkv5b"]
Sep 16 14:35:55.117605 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:35:55.117495    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" path="/var/lib/kubelet/pods/cbba2bfb-b110-49f3-8151-82e08b29d131/volumes"
Sep 16 14:36:08.251869 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.251834    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"]
Sep 16 14:36:08.252361 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.252055    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n" podUID="6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2" containerName="maas-api" containerID="cri-o://ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435" gracePeriod=30
Sep 16 14:36:08.507391 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.507327    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:36:08.620913 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.620883    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-openshift-service-ca\") pod \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") "
Sep 16 14:36:08.621083 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.620978    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkb2p\" (UniqueName: \"kubernetes.io/projected/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-kube-api-access-kkb2p\") pod \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") "
Sep 16 14:36:08.621083 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.621034    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-maas-api-tls\") pod \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") "
Sep 16 14:36:08.621167 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.621094    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-metrics-certs\") pod \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\" (UID: \"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2\") "
Sep 16 14:36:08.621316 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.621289    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2" (UID: "6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:36:08.621450 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.621429    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:36:08.623292 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.623260    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2" (UID: "6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:36:08.623394 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.623294    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-kube-api-access-kkb2p" (OuterVolumeSpecName: "kube-api-access-kkb2p") pod "6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2" (UID: "6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2"). InnerVolumeSpecName "kube-api-access-kkb2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:36:08.623394 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.623285    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2" (UID: "6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:36:08.722528 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.722492    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkb2p\" (UniqueName: \"kubernetes.io/projected/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-kube-api-access-kkb2p\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:36:08.722528 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.722525    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:36:08.722528 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.722534    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:36:08.746520 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.746482    2579 generic.go:356] "Generic (PLEG): container finished" podID="6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2" containerID="ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435" exitCode=0
Sep 16 14:36:08.746687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.746529    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"
Sep 16 14:36:08.746687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.746584    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n" event={"ID":"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2","Type":"ContainerDied","Data":"ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435"}
Sep 16 14:36:08.746687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.746644    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n" event={"ID":"6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2","Type":"ContainerDied","Data":"94eb9cac37c2721e961034d31da750a0a453bf098664894a4ce48236147ab5bb"}
Sep 16 14:36:08.746687 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.746669    2579 scope.go:117] "RemoveContainer" containerID="ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435"
Sep 16 14:36:08.756325 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.756308    2579 scope.go:117] "RemoveContainer" containerID="ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435"
Sep 16 14:36:08.756637 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:36:08.756619    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435\": container with ID starting with ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435 not found: ID does not exist" containerID="ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435"
Sep 16 14:36:08.756702 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.756647    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435"} err="failed to get container status \"ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435\": rpc error: code = NotFound desc = could not find container \"ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435\": container with ID starting with ba7531ae1e4db8aaf53467e9c3c4c41cc9bfc9f8be8d732b89243be718d82435 not found: ID does not exist"
Sep 16 14:36:08.770110 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.770049    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"]
Sep 16 14:36:08.775161 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:08.775130    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b77fde-5865ccffd-69r9n"]
Sep 16 14:36:09.118590 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:09.118497    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2" path="/var/lib/kubelet/pods/6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2/volumes"
Sep 16 14:36:21.318727 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:21.318691    2579 scope.go:117] "RemoveContainer" containerID="c8afede15e256f7f691db96a4af5ae993cfa418c4db979993c3794b8ac8ab23d"
Sep 16 14:36:58.966558 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:58.966511    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"]
Sep 16 14:36:58.967098 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:36:58.966768    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerName="istio-proxy" containerID="cri-o://a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9" gracePeriod=30
Sep 16 14:37:01.463527 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:01.463490    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 14:37:01.463933 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:01.463571    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:37:04.224264 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.224235    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:37:04.361261 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361173    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-token\") pod \"c303976d-a602-4d88-b315-bfa0781f0ef7\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") "
Sep 16 14:37:04.361261 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361232    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-podinfo\") pod \"c303976d-a602-4d88-b315-bfa0781f0ef7\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") "
Sep 16 14:37:04.361490 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361274    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c303976d-a602-4d88-b315-bfa0781f0ef7-istiod-ca-cert\") pod \"c303976d-a602-4d88-b315-bfa0781f0ef7\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") "
Sep 16 14:37:04.361490 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361302    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-envoy\") pod \"c303976d-a602-4d88-b315-bfa0781f0ef7\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") "
Sep 16 14:37:04.361490 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361323    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-certs\") pod \"c303976d-a602-4d88-b315-bfa0781f0ef7\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") "
Sep 16 14:37:04.361490 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-data\") pod \"c303976d-a602-4d88-b315-bfa0781f0ef7\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") "
Sep 16 14:37:04.361773 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361621    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-credential-socket\") pod \"c303976d-a602-4d88-b315-bfa0781f0ef7\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") "
Sep 16 14:37:04.361773 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361642    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c303976d-a602-4d88-b315-bfa0781f0ef7" (UID: "c303976d-a602-4d88-b315-bfa0781f0ef7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:37:04.361773 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361650    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-socket\") pod \"c303976d-a602-4d88-b315-bfa0781f0ef7\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") "
Sep 16 14:37:04.361773 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361715    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chs6j\" (UniqueName: \"kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-kube-api-access-chs6j\") pod \"c303976d-a602-4d88-b315-bfa0781f0ef7\" (UID: \"c303976d-a602-4d88-b315-bfa0781f0ef7\") "
Sep 16 14:37:04.361773 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361767    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c303976d-a602-4d88-b315-bfa0781f0ef7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c303976d-a602-4d88-b315-bfa0781f0ef7" (UID: "c303976d-a602-4d88-b315-bfa0781f0ef7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:37:04.362031 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361812    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c303976d-a602-4d88-b315-bfa0781f0ef7" (UID: "c303976d-a602-4d88-b315-bfa0781f0ef7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:37:04.362031 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361767    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-data" (OuterVolumeSpecName: "istio-data") pod "c303976d-a602-4d88-b315-bfa0781f0ef7" (UID: "c303976d-a602-4d88-b315-bfa0781f0ef7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:37:04.362031 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.361944    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c303976d-a602-4d88-b315-bfa0781f0ef7" (UID: "c303976d-a602-4d88-b315-bfa0781f0ef7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:37:04.362193 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.362112    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-credential-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:04.362193 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.362125    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:04.362193 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.362135    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c303976d-a602-4d88-b315-bfa0781f0ef7-istiod-ca-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:04.362193 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.362144    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-workload-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:04.362193 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.362152    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-data\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:04.363748 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.363721    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-kube-api-access-chs6j" (OuterVolumeSpecName: "kube-api-access-chs6j") pod "c303976d-a602-4d88-b315-bfa0781f0ef7" (UID: "c303976d-a602-4d88-b315-bfa0781f0ef7"). InnerVolumeSpecName "kube-api-access-chs6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:37:04.363854 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.363719    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c303976d-a602-4d88-b315-bfa0781f0ef7" (UID: "c303976d-a602-4d88-b315-bfa0781f0ef7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:37:04.364008 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.363991    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c303976d-a602-4d88-b315-bfa0781f0ef7" (UID: "c303976d-a602-4d88-b315-bfa0781f0ef7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:37:04.364062 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.364008    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-token" (OuterVolumeSpecName: "istio-token") pod "c303976d-a602-4d88-b315-bfa0781f0ef7" (UID: "c303976d-a602-4d88-b315-bfa0781f0ef7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:37:04.462993 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.462954    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chs6j\" (UniqueName: \"kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-kube-api-access-chs6j\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:04.462993 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.462988    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:04.462993 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.463000    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-podinfo\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:04.463266 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:04.463012    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c303976d-a602-4d88-b315-bfa0781f0ef7-istio-envoy\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:05.048418 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.048385    2579 generic.go:356] "Generic (PLEG): container finished" podID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerID="a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9" exitCode=0
Sep 16 14:37:05.048723 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.048442    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"
Sep 16 14:37:05.048723 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.048461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" event={"ID":"c303976d-a602-4d88-b315-bfa0781f0ef7","Type":"ContainerDied","Data":"a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9"}
Sep 16 14:37:05.048723 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.048567    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg" event={"ID":"c303976d-a602-4d88-b315-bfa0781f0ef7","Type":"ContainerDied","Data":"bcd5e08b4a0653a2379cb4a0f9dc8a175e56c163ac74cf7fbe5f9adfc6bad11a"}
Sep 16 14:37:05.048723 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.048572    2579 scope.go:117] "RemoveContainer" containerID="a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9"
Sep 16 14:37:05.060271 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.060248    2579 scope.go:117] "RemoveContainer" containerID="ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357"
Sep 16 14:37:05.068897 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.068870    2579 scope.go:117] "RemoveContainer" containerID="a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9"
Sep 16 14:37:05.069187 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:37:05.069166    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9\": container with ID starting with a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9 not found: ID does not exist" containerID="a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9"
Sep 16 14:37:05.069241 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.069197    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9"} err="failed to get container status \"a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9\": rpc error: code = NotFound desc = could not find container \"a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9\": container with ID starting with a8e7586bbc1f33c6e074b7cf8cb4b815141da083c8481161debc7586db4966f9 not found: ID does not exist"
Sep 16 14:37:05.069241 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.069215    2579 scope.go:117] "RemoveContainer" containerID="ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357"
Sep 16 14:37:05.069495 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:37:05.069476    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357\": container with ID starting with ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357 not found: ID does not exist" containerID="ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357"
Sep 16 14:37:05.069538 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.069498    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357"} err="failed to get container status \"ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357\": rpc error: code = NotFound desc = could not find container \"ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357\": container with ID starting with ca15bc59da7c7e3553f5c4840c747d790c00f76b8dabecb616c67ae2a9470357 not found: ID does not exist"
Sep 16 14:37:05.077291 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.077260    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"]
Sep 16 14:37:05.082259 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.082230    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-b77fde-openshift-default-f5b9d6468-95xlg"]
Sep 16 14:37:05.116303 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:05.116274    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" path="/var/lib/kubelet/pods/c303976d-a602-4d88-b315-bfa0781f0ef7/volumes"
Sep 16 14:37:29.192596 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.192539    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"]
Sep 16 14:37:29.193153 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.192760    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz" podUID="9944dff5-896e-4688-ada2-0a22e2ea5602" containerName="maas-api" containerID="cri-o://9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599" gracePeriod=30
Sep 16 14:37:29.455239 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.455175    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:37:29.498817 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.498787    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-maas-api-tls\") pod \"9944dff5-896e-4688-ada2-0a22e2ea5602\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") "
Sep 16 14:37:29.499007 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.498826    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9944dff5-896e-4688-ada2-0a22e2ea5602-openshift-service-ca\") pod \"9944dff5-896e-4688-ada2-0a22e2ea5602\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") "
Sep 16 14:37:29.499007 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.498863    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx5dk\" (UniqueName: \"kubernetes.io/projected/9944dff5-896e-4688-ada2-0a22e2ea5602-kube-api-access-rx5dk\") pod \"9944dff5-896e-4688-ada2-0a22e2ea5602\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") "
Sep 16 14:37:29.499272 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.499248    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9944dff5-896e-4688-ada2-0a22e2ea5602-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9944dff5-896e-4688-ada2-0a22e2ea5602" (UID: "9944dff5-896e-4688-ada2-0a22e2ea5602"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:37:29.501020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.500991    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9944dff5-896e-4688-ada2-0a22e2ea5602-kube-api-access-rx5dk" (OuterVolumeSpecName: "kube-api-access-rx5dk") pod "9944dff5-896e-4688-ada2-0a22e2ea5602" (UID: "9944dff5-896e-4688-ada2-0a22e2ea5602"). InnerVolumeSpecName "kube-api-access-rx5dk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:37:29.501020 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.501006    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9944dff5-896e-4688-ada2-0a22e2ea5602" (UID: "9944dff5-896e-4688-ada2-0a22e2ea5602"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:37:29.599721 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.599681    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-metrics-certs\") pod \"9944dff5-896e-4688-ada2-0a22e2ea5602\" (UID: \"9944dff5-896e-4688-ada2-0a22e2ea5602\") "
Sep 16 14:37:29.599924 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.599911    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:29.599969 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.599926    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9944dff5-896e-4688-ada2-0a22e2ea5602-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:29.599969 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.599935    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx5dk\" (UniqueName: \"kubernetes.io/projected/9944dff5-896e-4688-ada2-0a22e2ea5602-kube-api-access-rx5dk\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:29.601734 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.601709    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9944dff5-896e-4688-ada2-0a22e2ea5602" (UID: "9944dff5-896e-4688-ada2-0a22e2ea5602"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:37:29.701720 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:29.701686    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9944dff5-896e-4688-ada2-0a22e2ea5602-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:30.175799 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:30.175768    2579 generic.go:356] "Generic (PLEG): container finished" podID="9944dff5-896e-4688-ada2-0a22e2ea5602" containerID="9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599" exitCode=0
Sep 16 14:37:30.175972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:30.175813    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"
Sep 16 14:37:30.175972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:30.175824    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz" event={"ID":"9944dff5-896e-4688-ada2-0a22e2ea5602","Type":"ContainerDied","Data":"9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599"}
Sep 16 14:37:30.175972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:30.175865    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz" event={"ID":"9944dff5-896e-4688-ada2-0a22e2ea5602","Type":"ContainerDied","Data":"6c57084ec23d6f495974a6eabe8d7b9fa150c5dbc4ec7621523dca7405d3370a"}
Sep 16 14:37:30.175972 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:30.175887    2579 scope.go:117] "RemoveContainer" containerID="9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599"
Sep 16 14:37:30.185872 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:30.185852    2579 scope.go:117] "RemoveContainer" containerID="9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599"
Sep 16 14:37:30.186156 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:37:30.186137    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599\": container with ID starting with 9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599 not found: ID does not exist" containerID="9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599"
Sep 16 14:37:30.186228 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:30.186164    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599"} err="failed to get container status \"9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599\": rpc error: code = NotFound desc = could not find container \"9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599\": container with ID starting with 9ea059104b8c5284c6ebddf7904941414bfeb596a4858434e6cb9665d3b5b599 not found: ID does not exist"
Sep 16 14:37:30.200223 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:30.200194    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"]
Sep 16 14:37:30.206895 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:30.206866    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50b57c-b7db4c6b5-9gtgz"]
Sep 16 14:37:31.116753 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:31.116721    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9944dff5-896e-4688-ada2-0a22e2ea5602" path="/var/lib/kubelet/pods/9944dff5-896e-4688-ada2-0a22e2ea5602/volumes"
Sep 16 14:37:36.980006 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:36.979973    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"]
Sep 16 14:37:36.980504 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:36.980188    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" podUID="879c8928-b952-42a0-a53c-d9ad904573c6" containerName="istio-proxy" containerID="cri-o://e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8" gracePeriod=30
Sep 16 14:37:37.098760 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:37.098721    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 14:37:37.098939 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:37.098776    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" podUID="879c8928-b952-42a0-a53c-d9ad904573c6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:37:42.241361 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.241334    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:37:42.244430 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.244402    2579 generic.go:356] "Generic (PLEG): container finished" podID="879c8928-b952-42a0-a53c-d9ad904573c6" containerID="e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8" exitCode=0
Sep 16 14:37:42.244557 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.244440    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"
Sep 16 14:37:42.244557 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.244477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" event={"ID":"879c8928-b952-42a0-a53c-d9ad904573c6","Type":"ContainerDied","Data":"e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8"}
Sep 16 14:37:42.244557 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.244528    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl" event={"ID":"879c8928-b952-42a0-a53c-d9ad904573c6","Type":"ContainerDied","Data":"e2ea2c7a81f7143d0dc6ffceb8f7788b81347e382976ebf695314cbceb1ea7b5"}
Sep 16 14:37:42.244678 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.244617    2579 scope.go:117] "RemoveContainer" containerID="e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8"
Sep 16 14:37:42.253238 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.253220    2579 scope.go:117] "RemoveContainer" containerID="7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f"
Sep 16 14:37:42.260878 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.260851    2579 scope.go:117] "RemoveContainer" containerID="e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8"
Sep 16 14:37:42.261149 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:37:42.261132    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8\": container with ID starting with e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8 not found: ID does not exist" containerID="e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8"
Sep 16 14:37:42.261232 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.261164    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8"} err="failed to get container status \"e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8\": rpc error: code = NotFound desc = could not find container \"e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8\": container with ID starting with e2d3fa4cad567c9ecf267653217923b219d78a09ba19d21dd57d7b99b4e64be8 not found: ID does not exist"
Sep 16 14:37:42.261232 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.261189    2579 scope.go:117] "RemoveContainer" containerID="7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f"
Sep 16 14:37:42.261507 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:37:42.261488    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f\": container with ID starting with 7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f not found: ID does not exist" containerID="7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f"
Sep 16 14:37:42.261569 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.261513    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f"} err="failed to get container status \"7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f\": rpc error: code = NotFound desc = could not find container \"7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f\": container with ID starting with 7bb23068f0e23125c6e464e1a6dd28adb35bd930494e4c9a068160e225f85c1f not found: ID does not exist"
Sep 16 14:37:42.320094 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320055    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-certs\") pod \"879c8928-b952-42a0-a53c-d9ad904573c6\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") "
Sep 16 14:37:42.320094 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320100    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-data\") pod \"879c8928-b952-42a0-a53c-d9ad904573c6\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") "
Sep 16 14:37:42.320355 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320122    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-istio-token\") pod \"879c8928-b952-42a0-a53c-d9ad904573c6\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") "
Sep 16 14:37:42.320355 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320155    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-credential-socket\") pod \"879c8928-b952-42a0-a53c-d9ad904573c6\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") "
Sep 16 14:37:42.320355 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-envoy\") pod \"879c8928-b952-42a0-a53c-d9ad904573c6\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") "
Sep 16 14:37:42.320355 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320242    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bdvn\" (UniqueName: \"kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-kube-api-access-7bdvn\") pod \"879c8928-b952-42a0-a53c-d9ad904573c6\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") "
Sep 16 14:37:42.320355 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320292    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/879c8928-b952-42a0-a53c-d9ad904573c6-istiod-ca-cert\") pod \"879c8928-b952-42a0-a53c-d9ad904573c6\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") "
Sep 16 14:37:42.320355 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320328    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-socket\") pod \"879c8928-b952-42a0-a53c-d9ad904573c6\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") "
Sep 16 14:37:42.320702 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320364    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/879c8928-b952-42a0-a53c-d9ad904573c6-istio-podinfo\") pod \"879c8928-b952-42a0-a53c-d9ad904573c6\" (UID: \"879c8928-b952-42a0-a53c-d9ad904573c6\") "
Sep 16 14:37:42.320702 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320428    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "879c8928-b952-42a0-a53c-d9ad904573c6" (UID: "879c8928-b952-42a0-a53c-d9ad904573c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:37:42.320702 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320439    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "879c8928-b952-42a0-a53c-d9ad904573c6" (UID: "879c8928-b952-42a0-a53c-d9ad904573c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:37:42.320856 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320702    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "879c8928-b952-42a0-a53c-d9ad904573c6" (UID: "879c8928-b952-42a0-a53c-d9ad904573c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:37:42.320856 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320724    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:42.320856 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320753    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-data\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:42.320856 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320771    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/879c8928-b952-42a0-a53c-d9ad904573c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "879c8928-b952-42a0-a53c-d9ad904573c6" (UID: "879c8928-b952-42a0-a53c-d9ad904573c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:37:42.320856 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.320816    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "879c8928-b952-42a0-a53c-d9ad904573c6" (UID: "879c8928-b952-42a0-a53c-d9ad904573c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:37:42.322657 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.322630    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "879c8928-b952-42a0-a53c-d9ad904573c6" (UID: "879c8928-b952-42a0-a53c-d9ad904573c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:37:42.322786 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.322658    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-kube-api-access-7bdvn" (OuterVolumeSpecName: "kube-api-access-7bdvn") pod "879c8928-b952-42a0-a53c-d9ad904573c6" (UID: "879c8928-b952-42a0-a53c-d9ad904573c6"). InnerVolumeSpecName "kube-api-access-7bdvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:37:42.322884 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.322853    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "879c8928-b952-42a0-a53c-d9ad904573c6" (UID: "879c8928-b952-42a0-a53c-d9ad904573c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:37:42.322945 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.322928    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/879c8928-b952-42a0-a53c-d9ad904573c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "879c8928-b952-42a0-a53c-d9ad904573c6" (UID: "879c8928-b952-42a0-a53c-d9ad904573c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:37:42.421871 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.421828    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bdvn\" (UniqueName: \"kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-kube-api-access-7bdvn\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:42.421871 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.421865    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/879c8928-b952-42a0-a53c-d9ad904573c6-istiod-ca-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:42.421871 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.421880    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-workload-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:42.422206 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.421892    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/879c8928-b952-42a0-a53c-d9ad904573c6-istio-podinfo\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:42.422206 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.421903    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/879c8928-b952-42a0-a53c-d9ad904573c6-istio-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:42.422206 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.421914    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-credential-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:42.422206 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.421925    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/879c8928-b952-42a0-a53c-d9ad904573c6-istio-envoy\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:42.568076 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.568039    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"]
Sep 16 14:37:42.573091 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:42.573062    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50b57c-openshift-default-6469c8499d-qhbtl"]
Sep 16 14:37:43.122658 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:43.122621    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="879c8928-b952-42a0-a53c-d9ad904573c6" path="/var/lib/kubelet/pods/879c8928-b952-42a0-a53c-d9ad904573c6/volumes"
Sep 16 14:37:48.148825 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.148795    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"]
Sep 16 14:37:48.149227 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.149016    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn" podUID="08009254-30a1-4fdb-b492-d7e305e0db6d" containerName="maas-api" containerID="cri-o://1c9251cde6ed8ce16060c71511d63e9fb7ae5d06aeff4e5fc07a3f137414152e" gracePeriod=30
Sep 16 14:37:48.278479 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.278443    2579 generic.go:356] "Generic (PLEG): container finished" podID="08009254-30a1-4fdb-b492-d7e305e0db6d" containerID="1c9251cde6ed8ce16060c71511d63e9fb7ae5d06aeff4e5fc07a3f137414152e" exitCode=0
Sep 16 14:37:48.278681 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.278515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn" event={"ID":"08009254-30a1-4fdb-b492-d7e305e0db6d","Type":"ContainerDied","Data":"1c9251cde6ed8ce16060c71511d63e9fb7ae5d06aeff4e5fc07a3f137414152e"}
Sep 16 14:37:48.398542 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.398516    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:37:48.477929 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.477835    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bl2n\" (UniqueName: \"kubernetes.io/projected/08009254-30a1-4fdb-b492-d7e305e0db6d-kube-api-access-4bl2n\") pod \"08009254-30a1-4fdb-b492-d7e305e0db6d\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") "
Sep 16 14:37:48.477929 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.477909    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-maas-api-tls\") pod \"08009254-30a1-4fdb-b492-d7e305e0db6d\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") "
Sep 16 14:37:48.478111 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.478022    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-metrics-certs\") pod \"08009254-30a1-4fdb-b492-d7e305e0db6d\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") "
Sep 16 14:37:48.478148 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.478122    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08009254-30a1-4fdb-b492-d7e305e0db6d-openshift-service-ca\") pod \"08009254-30a1-4fdb-b492-d7e305e0db6d\" (UID: \"08009254-30a1-4fdb-b492-d7e305e0db6d\") "
Sep 16 14:37:48.478483 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.478450    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08009254-30a1-4fdb-b492-d7e305e0db6d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "08009254-30a1-4fdb-b492-d7e305e0db6d" (UID: "08009254-30a1-4fdb-b492-d7e305e0db6d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:37:48.480176 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.480146    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "08009254-30a1-4fdb-b492-d7e305e0db6d" (UID: "08009254-30a1-4fdb-b492-d7e305e0db6d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:37:48.480517 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.480487    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "08009254-30a1-4fdb-b492-d7e305e0db6d" (UID: "08009254-30a1-4fdb-b492-d7e305e0db6d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:37:48.480517 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.480504    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08009254-30a1-4fdb-b492-d7e305e0db6d-kube-api-access-4bl2n" (OuterVolumeSpecName: "kube-api-access-4bl2n") pod "08009254-30a1-4fdb-b492-d7e305e0db6d" (UID: "08009254-30a1-4fdb-b492-d7e305e0db6d"). InnerVolumeSpecName "kube-api-access-4bl2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:37:48.579742 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.579704    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bl2n\" (UniqueName: \"kubernetes.io/projected/08009254-30a1-4fdb-b492-d7e305e0db6d-kube-api-access-4bl2n\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:48.579742 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.579733    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-maas-api-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:48.579742 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.579742    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08009254-30a1-4fdb-b492-d7e305e0db6d-metrics-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:48.579742 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:48.579750    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08009254-30a1-4fdb-b492-d7e305e0db6d-openshift-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:37:49.285266 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:49.285220    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn" event={"ID":"08009254-30a1-4fdb-b492-d7e305e0db6d","Type":"ContainerDied","Data":"5421bb85446e25bdbb31a6a27e6230df0366f199c948eac3b6ea88cd7f3d5c2b"}
Sep 16 14:37:49.285266 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:49.285264    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"
Sep 16 14:37:49.285793 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:49.285331    2579 scope.go:117] "RemoveContainer" containerID="1c9251cde6ed8ce16060c71511d63e9fb7ae5d06aeff4e5fc07a3f137414152e"
Sep 16 14:37:49.307219 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:49.307191    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"]
Sep 16 14:37:49.313337 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:49.313312    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f72402-645555986f-t87jn"]
Sep 16 14:37:51.116818 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:51.116781    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08009254-30a1-4fdb-b492-d7e305e0db6d" path="/var/lib/kubelet/pods/08009254-30a1-4fdb-b492-d7e305e0db6d/volumes"
Sep 16 14:37:55.509787 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:55.509756    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"]
Sep 16 14:37:55.510183 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:37:55.509974    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy" containerID="cri-o://75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349" gracePeriod=30
Sep 16 14:38:00.765372 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.765338    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:38:00.898081 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898044    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlw4b\" (UniqueName: \"kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-kube-api-access-qlw4b\") pod \"cce425cb-a378-4346-8bab-21f8382bfb41\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") "
Sep 16 14:38:00.898282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898103    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cce425cb-a378-4346-8bab-21f8382bfb41-istiod-ca-cert\") pod \"cce425cb-a378-4346-8bab-21f8382bfb41\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") "
Sep 16 14:38:00.898282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898139    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-data\") pod \"cce425cb-a378-4346-8bab-21f8382bfb41\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") "
Sep 16 14:38:00.898282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898168    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-socket\") pod \"cce425cb-a378-4346-8bab-21f8382bfb41\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") "
Sep 16 14:38:00.898282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898194    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-istio-token\") pod \"cce425cb-a378-4346-8bab-21f8382bfb41\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") "
Sep 16 14:38:00.898282 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898233    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-certs\") pod \"cce425cb-a378-4346-8bab-21f8382bfb41\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") "
Sep 16 14:38:00.898591 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898299    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-credential-socket\") pod \"cce425cb-a378-4346-8bab-21f8382bfb41\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") "
Sep 16 14:38:00.898591 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898354    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cce425cb-a378-4346-8bab-21f8382bfb41-istio-podinfo\") pod \"cce425cb-a378-4346-8bab-21f8382bfb41\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") "
Sep 16 14:38:00.898591 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898389    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-envoy\") pod \"cce425cb-a378-4346-8bab-21f8382bfb41\" (UID: \"cce425cb-a378-4346-8bab-21f8382bfb41\") "
Sep 16 14:38:00.898591 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898446    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cce425cb-a378-4346-8bab-21f8382bfb41" (UID: "cce425cb-a378-4346-8bab-21f8382bfb41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:38:00.898591 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898535    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cce425cb-a378-4346-8bab-21f8382bfb41-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cce425cb-a378-4346-8bab-21f8382bfb41" (UID: "cce425cb-a378-4346-8bab-21f8382bfb41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:38:00.898591 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898440    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-data" (OuterVolumeSpecName: "istio-data") pod "cce425cb-a378-4346-8bab-21f8382bfb41" (UID: "cce425cb-a378-4346-8bab-21f8382bfb41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:38:00.898949 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898711    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cce425cb-a378-4346-8bab-21f8382bfb41" (UID: "cce425cb-a378-4346-8bab-21f8382bfb41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:38:00.898949 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898773    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cce425cb-a378-4346-8bab-21f8382bfb41" (UID: "cce425cb-a378-4346-8bab-21f8382bfb41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:38:00.898949 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898837    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-credential-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:38:00.898949 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898912    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cce425cb-a378-4346-8bab-21f8382bfb41-istiod-ca-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:38:00.898949 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898925    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-data\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:38:00.898949 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898940    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-socket\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:38:00.899262 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.898953    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-workload-certs\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:38:00.900501 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.900475    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-istio-token" (OuterVolumeSpecName: "istio-token") pod "cce425cb-a378-4346-8bab-21f8382bfb41" (UID: "cce425cb-a378-4346-8bab-21f8382bfb41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:38:00.900628 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.900608    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cce425cb-a378-4346-8bab-21f8382bfb41-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cce425cb-a378-4346-8bab-21f8382bfb41" (UID: "cce425cb-a378-4346-8bab-21f8382bfb41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:38:00.900876 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.900845    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cce425cb-a378-4346-8bab-21f8382bfb41" (UID: "cce425cb-a378-4346-8bab-21f8382bfb41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:38:00.900876 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.900853    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-kube-api-access-qlw4b" (OuterVolumeSpecName: "kube-api-access-qlw4b") pod "cce425cb-a378-4346-8bab-21f8382bfb41" (UID: "cce425cb-a378-4346-8bab-21f8382bfb41"). InnerVolumeSpecName "kube-api-access-qlw4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:38:00.999768 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.999733    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-istio-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:38:00.999768 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.999764    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cce425cb-a378-4346-8bab-21f8382bfb41-istio-podinfo\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:38:00.999768 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.999772    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cce425cb-a378-4346-8bab-21f8382bfb41-istio-envoy\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:38:01.000003 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:00.999780    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlw4b\" (UniqueName: \"kubernetes.io/projected/cce425cb-a378-4346-8bab-21f8382bfb41-kube-api-access-qlw4b\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\""
Sep 16 14:38:01.347313 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.347228    2579 generic.go:356] "Generic (PLEG): container finished" podID="cce425cb-a378-4346-8bab-21f8382bfb41" containerID="75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349" exitCode=0
Sep 16 14:38:01.347313 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.347278    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"
Sep 16 14:38:01.347494 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.347316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" event={"ID":"cce425cb-a378-4346-8bab-21f8382bfb41","Type":"ContainerDied","Data":"75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349"}
Sep 16 14:38:01.347494 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.347373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw" event={"ID":"cce425cb-a378-4346-8bab-21f8382bfb41","Type":"ContainerDied","Data":"e9f27f9185541ac90889986256b8f5aea913cceb3fe50dbd1517943daa2698ae"}
Sep 16 14:38:01.347494 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.347396    2579 scope.go:117] "RemoveContainer" containerID="75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349"
Sep 16 14:38:01.365081 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.365052    2579 scope.go:117] "RemoveContainer" containerID="bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b"
Sep 16 14:38:01.374141 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.374112    2579 scope.go:117] "RemoveContainer" containerID="75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349"
Sep 16 14:38:01.374562 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:38:01.374519    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349\": container with ID starting with 75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349 not found: ID does not exist" containerID="75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349"
Sep 16 14:38:01.374685 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.374614    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349"} err="failed to get container status \"75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349\": rpc error: code = NotFound desc = could not find container \"75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349\": container with ID starting with 75aa436d7fb2409e12fb5f085074a4bbc9bc66772daac6a45a6c3cf51781b349 not found: ID does not exist"
Sep 16 14:38:01.374685 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.374646    2579 scope.go:117] "RemoveContainer" containerID="bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b"
Sep 16 14:38:01.375185 ip-10-0-139-140 kubenswrapper[2579]: E0916 14:38:01.375134    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b\": container with ID starting with bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b not found: ID does not exist" containerID="bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b"
Sep 16 14:38:01.375185 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.375169    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b"} err="failed to get container status \"bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b\": rpc error: code = NotFound desc = could not find container \"bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b\": container with ID starting with bcfc7aca2f930cbd06046ddfce4bcc348a9ed63d7573d71e170f364367fc455b not found: ID does not exist"
Sep 16 14:38:01.376643 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.376622    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"]
Sep 16 14:38:01.378367 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:01.378347    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f72402-openshift-default-f6d6f679d-rmwzw"]
Sep 16 14:38:03.116421 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:38:03.116386    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" path="/var/lib/kubelet/pods/cce425cb-a378-4346-8bab-21f8382bfb41/volumes"
Sep 16 14:39:21.222891 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:39:21.222851    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:39:21.229726 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:39:21.229700    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:44:21.252864 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:44:21.252832    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:44:21.260728 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:44:21.260707    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:47:18.448914 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:18.448883    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dv2zf_9176e0ae-8c42-4247-9a57-e0260a972717/global-pull-secret-syncer/0.log"
Sep 16 14:47:18.629511 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:18.629476    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bshdp_cba36ab5-17fb-458a-b1ac-4329c74a478a/konnectivity-agent/0.log"
Sep 16 14:47:18.718133 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:18.718038    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-140.ec2.internal_615418bae492da132dc002c225bf9501/haproxy/0.log"
Sep 16 14:47:25.122201 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:25.122164    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-pmdtr_7062088c-b344-4940-85d0-f635f757bd31/cluster-monitoring-operator/0.log"
Sep 16 14:47:25.150383 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:25.150347    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-qjxdn_12a1d253-2a3c-47dd-b5e6-c275fdf72d26/kube-state-metrics/0.log"
Sep 16 14:47:25.163338 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:25.163311    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-qjxdn_12a1d253-2a3c-47dd-b5e6-c275fdf72d26/kube-rbac-proxy-main/0.log"
Sep 16 14:47:25.179512 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:25.179482    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-qjxdn_12a1d253-2a3c-47dd-b5e6-c275fdf72d26/kube-rbac-proxy-self/0.log"
Sep 16 14:47:25.237609 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:25.237574    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-wb8cm_89a14d69-4ea4-4d9d-951c-c64908f628b0/monitoring-plugin/0.log"
Sep 16 14:47:25.267599 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:25.267569    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n6dlr_95468dde-e111-49af-ae5a-0a36d109007f/node-exporter/0.log"
Sep 16 14:47:25.283663 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:25.283636    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n6dlr_95468dde-e111-49af-ae5a-0a36d109007f/kube-rbac-proxy/0.log"
Sep 16 14:47:25.301953 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:25.301930    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n6dlr_95468dde-e111-49af-ae5a-0a36d109007f/init-textfile/0.log"
Sep 16 14:47:27.855106 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:27.855077    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-85mkf_19cb7589-a354-4795-b9c0-311be25cf056/networking-console-plugin/0.log"
Sep 16 14:47:28.427720 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.427694    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/1.log"
Sep 16 14:47:28.434560 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.434521    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vnfbv_7d90c854-fe26-4de2-9d50-458bcc967694/console-operator/2.log"
Sep 16 14:47:28.713977 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.713894    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"]
Sep 16 14:47:28.714247 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714234    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="879c8928-b952-42a0-a53c-d9ad904573c6" containerName="istio-proxy"
Sep 16 14:47:28.714300 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714250    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="879c8928-b952-42a0-a53c-d9ad904573c6" containerName="istio-proxy"
Sep 16 14:47:28.714300 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714263    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy"
Sep 16 14:47:28.714300 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714271    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy"
Sep 16 14:47:28.714300 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714278    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08009254-30a1-4fdb-b492-d7e305e0db6d" containerName="maas-api"
Sep 16 14:47:28.714300 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714284    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="08009254-30a1-4fdb-b492-d7e305e0db6d" containerName="maas-api"
Sep 16 14:47:28.714300 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714291    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerName="istio-proxy"
Sep 16 14:47:28.714300 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714297    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerName="istio-proxy"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714307    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2" containerName="maas-api"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714313    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2" containerName="maas-api"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714326    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714331    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714337    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerName="istio-proxy"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714342    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerName="istio-proxy"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714352    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9944dff5-896e-4688-ada2-0a22e2ea5602" containerName="maas-api"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714357    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9944dff5-896e-4688-ada2-0a22e2ea5602" containerName="maas-api"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714443    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerName="istio-proxy"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714453    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714460    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="879c8928-b952-42a0-a53c-d9ad904573c6" containerName="istio-proxy"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714469    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9944dff5-896e-4688-ada2-0a22e2ea5602" containerName="maas-api"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714484    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c303976d-a602-4d88-b315-bfa0781f0ef7" containerName="istio-proxy"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714492    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8f71e8-89c2-4ba2-846d-4b8e7248b5a2" containerName="maas-api"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714498    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="08009254-30a1-4fdb-b492-d7e305e0db6d" containerName="maas-api"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714503    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerName="istio-proxy"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714508    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cce425cb-a378-4346-8bab-21f8382bfb41" containerName="istio-proxy"
Sep 16 14:47:28.714810 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.714513    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbba2bfb-b110-49f3-8151-82e08b29d131" containerName="istio-proxy"
Sep 16 14:47:28.717627 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.717610    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.720201 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.720175    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74mws\"/\"openshift-service-ca.crt\""
Sep 16 14:47:28.720316 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.720298    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-74mws\"/\"default-dockercfg-cq4jd\""
Sep 16 14:47:28.721352 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.721334    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74mws\"/\"kube-root-ca.crt\""
Sep 16 14:47:28.729729 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.729700    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"]
Sep 16 14:47:28.777115 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.777088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-lib-modules\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.777218 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.777123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-podres\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.777218 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.777153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-proc\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.777308 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.777243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fmkh\" (UniqueName: \"kubernetes.io/projected/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-kube-api-access-4fmkh\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.777344 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.777320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-sys\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.878555 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.878516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-lib-modules\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.878915 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.878579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-podres\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.878915 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.878611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-proc\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.878915 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.878647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fmkh\" (UniqueName: \"kubernetes.io/projected/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-kube-api-access-4fmkh\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.878915 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.878689    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-lib-modules\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.878915 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.878711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-sys\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.878915 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.878728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-proc\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.878915 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.878740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-podres\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.878915 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.878785    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-sys\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:28.887043 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:28.887019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fmkh\" (UniqueName: \"kubernetes.io/projected/b79bf007-d127-4aeb-b1f8-2d38d4ffa01b-kube-api-access-4fmkh\") pod \"perf-node-gather-daemonset-8g265\" (UID: \"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b\") " pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:29.028335 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:29.028242    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:29.298980 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:29.298949    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"]
Sep 16 14:47:29.301121 ip-10-0-139-140 kubenswrapper[2579]: W0916 14:47:29.301093    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb79bf007_d127_4aeb_b1f8_2d38d4ffa01b.slice/crio-4a8652286553edb243268832f001f6b1c3a99b40f3b3d092199a7d8d94c81a4b WatchSource:0}: Error finding container 4a8652286553edb243268832f001f6b1c3a99b40f3b3d092199a7d8d94c81a4b: Status 404 returned error can't find the container with id 4a8652286553edb243268832f001f6b1c3a99b40f3b3d092199a7d8d94c81a4b
Sep 16 14:47:29.758207 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:29.758175    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-9dtvf_356e2bb2-5bf6-4b36-8b7c-caeff2c0a6b4/volume-data-source-validator/0.log"
Sep 16 14:47:30.077911 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:30.077823    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265" event={"ID":"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b","Type":"ContainerStarted","Data":"87564159bb27aad476070e45c6854bd40a48c5b9c2c851cdcc8bf07b0afcf203"}
Sep 16 14:47:30.077911 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:30.077874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265" event={"ID":"b79bf007-d127-4aeb-b1f8-2d38d4ffa01b","Type":"ContainerStarted","Data":"4a8652286553edb243268832f001f6b1c3a99b40f3b3d092199a7d8d94c81a4b"}
Sep 16 14:47:30.077911 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:30.077900    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:30.096029 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:30.095979    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265" podStartSLOduration=2.095965826 podStartE2EDuration="2.095965826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:47:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:47:30.093626764 +0000 UTC m=+2589.393037031" watchObservedRunningTime="2026-09-16 14:47:30.095965826 +0000 UTC m=+2589.395376092"
Sep 16 14:47:30.932434 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:30.932406    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vp5jx_70310645-9dd0-4568-b1d2-7efa89355c38/dns/0.log"
Sep 16 14:47:30.948319 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:30.948288    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vp5jx_70310645-9dd0-4568-b1d2-7efa89355c38/kube-rbac-proxy/0.log"
Sep 16 14:47:30.965410 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:30.965384    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btn76_280b9b34-af5f-4eb3-aca5-27e6bcb9220c/dns-node-resolver/0.log"
Sep 16 14:47:31.626444 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:31.626413    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rx59j_2b2310b8-b4db-4fa7-8d8d-d31e27a81665/node-ca/0.log"
Sep 16 14:47:33.286129 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:33.286096    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wh64f_c2df28bd-4393-4d8d-ad83-14ae44e56a8e/discovery/0.log"
Sep 16 14:47:33.428471 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:33.428438    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cbdcfd966-ktx58_7639350f-d2a2-43d4-81aa-a63a808f8c90/router/0.log"
Sep 16 14:47:34.311871 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:34.311840    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z95r6_5124a2ad-56f1-4d19-b895-80cfdeb431a7/serve-healthcheck-canary/0.log"
Sep 16 14:47:34.772288 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:34.772260    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-7ww76_704c0090-1f46-4c6d-b6c7-31494b95a5ad/insights-operator/0.log"
Sep 16 14:47:34.772521 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:34.772504    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-7ww76_704c0090-1f46-4c6d-b6c7-31494b95a5ad/insights-operator/1.log"
Sep 16 14:47:34.790668 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:34.790648    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6v7c5_09302756-6ac0-4c12-a4ae-7e5546cde847/kube-rbac-proxy/0.log"
Sep 16 14:47:34.807813 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:34.807791    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6v7c5_09302756-6ac0-4c12-a4ae-7e5546cde847/exporter/0.log"
Sep 16 14:47:34.826792 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:34.826769    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6v7c5_09302756-6ac0-4c12-a4ae-7e5546cde847/extractor/0.log"
Sep 16 14:47:36.091731 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:36.091702    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-74mws/perf-node-gather-daemonset-8g265"
Sep 16 14:47:37.387699 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:37.387675    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-d95qk_748c5491-cc6c-4f4f-a8fd-fd680ca66c52/server/0.log"
Sep 16 14:47:37.490556 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:37.490525    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77f6d9877-f44zn_a352d83e-6203-4d16-91a1-eedc7c36d5b6/manager/0.log"
Sep 16 14:47:37.508130 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:37.508107    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77f6d9877-f44zn_a352d83e-6203-4d16-91a1-eedc7c36d5b6/copy-manifests/0.log"
Sep 16 14:47:39.103023 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:39.102935    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-654b6f4fd4-9kl4v_69be3329-2a70-4d8d-b5a8-77c1cae3535d/manager/0.log"
Sep 16 14:47:39.152925 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:39.152893    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-q6jt7_4bcd5acf-63ba-4136-bd96-ade397573c1a/openshift-lws-operator/0.log"
Sep 16 14:47:39.385130 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:39.385054    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wh64f_c2df28bd-4393-4d8d-ad83-14ae44e56a8e/discovery/0.log"
Sep 16 14:47:39.479491 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:39.479463    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cbdcfd966-ktx58_7639350f-d2a2-43d4-81aa-a63a808f8c90/router/0.log"
Sep 16 14:47:41.620085 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:41.620057    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wh64f_c2df28bd-4393-4d8d-ad83-14ae44e56a8e/discovery/0.log"
Sep 16 14:47:41.724373 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:41.724342    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cbdcfd966-ktx58_7639350f-d2a2-43d4-81aa-a63a808f8c90/router/0.log"
Sep 16 14:47:44.576932 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:44.576829    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-z8ns5_e97758bb-120e-4e06-bd96-060759afdb8d/kube-storage-version-migrator-operator/1.log"
Sep 16 14:47:44.578726 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:44.578692    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-z8ns5_e97758bb-120e-4e06-bd96-060759afdb8d/kube-storage-version-migrator-operator/0.log"
Sep 16 14:47:45.861676 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:45.861643    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwvrg_66575877-fa65-47fe-b600-9c9f1d5eb268/kube-multus-additional-cni-plugins/0.log"
Sep 16 14:47:45.883957 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:45.883932    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwvrg_66575877-fa65-47fe-b600-9c9f1d5eb268/egress-router-binary-copy/0.log"
Sep 16 14:47:45.899102 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:45.899075    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwvrg_66575877-fa65-47fe-b600-9c9f1d5eb268/cni-plugins/0.log"
Sep 16 14:47:45.915825 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:45.915798    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwvrg_66575877-fa65-47fe-b600-9c9f1d5eb268/bond-cni-plugin/0.log"
Sep 16 14:47:45.931427 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:45.931400    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwvrg_66575877-fa65-47fe-b600-9c9f1d5eb268/routeoverride-cni/0.log"
Sep 16 14:47:45.948437 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:45.948411    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwvrg_66575877-fa65-47fe-b600-9c9f1d5eb268/whereabouts-cni-bincopy/0.log"
Sep 16 14:47:45.964603 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:45.964581    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwvrg_66575877-fa65-47fe-b600-9c9f1d5eb268/whereabouts-cni/0.log"
Sep 16 14:47:46.008771 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:46.008741    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkzv6_e473b1f3-e471-4931-bbcb-01aa22cdc91e/kube-multus/0.log"
Sep 16 14:47:46.193259 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:46.193227    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vdsdt_b8d48063-48c0-4bcf-9e7a-1d39b0826ef2/network-metrics-daemon/0.log"
Sep 16 14:47:46.206760 ip-10-0-139-140 kubenswrapper[2579]: I0916 14:47:46.206734    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vdsdt_b8d48063-48c0-4bcf-9e7a-1d39b0826ef2/kube-rbac-proxy/0.log"