Sep 18 19:11:53.057313 ip-10-0-143-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 18 19:11:53.057346 ip-10-0-143-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 18 19:11:53.057354 ip-10-0-143-37 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 18 19:11:53.057565 ip-10-0-143-37 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 18 19:12:03.082122 ip-10-0-143-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 18 19:12:03.082141 ip-10-0-143-37 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 271016309ab648c18324301e4bfe900c --
Sep 18 19:13:54.886254 ip-10-0-143-37 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 19:13:58.175306 ip-10-0-143-37 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 19:13:58.175306 ip-10-0-143-37 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 19:13:58.175306 ip-10-0-143-37 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 19:13:58.175306 ip-10-0-143-37 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 19:13:58.175306 ip-10-0-143-37 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 19:13:58.176046 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.175882    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 19:13:58.179805 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179787    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:13:58.179805 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179805    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179809    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179813    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179816    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179820    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179823    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179826    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179829    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179831    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179834    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179836    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179839    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179842    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179846    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179850    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179853    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179856    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179859    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179866    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179870    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:13:58.179862 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179873    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179876    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179879    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179881    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179884    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179887    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179889    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179892    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179894    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179897    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179900    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179902    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179905    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179907    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179910    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179912    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179915    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179917    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179920    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:13:58.180365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179922    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179925    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179928    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179930    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179933    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179935    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179938    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179941    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179944    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179947    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179950    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179952    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179955    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179958    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179960    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179963    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179965    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179981    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179986    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179990    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:13:58.180828 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179995    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.179998    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180000    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180003    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180006    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180009    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180013    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180016    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180019    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180030    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180034    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180037    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180041    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180044    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180047    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180050    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180054    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180056    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180059    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180062    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:13:58.181332 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180064    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180067    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180070    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180073    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180075    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180078    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180081    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180083    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180087    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180090    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180092    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180095    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180098    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180101    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180103    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180106    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180108    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180111    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180115    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:13:58.181855 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180794    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180801    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180804    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180807    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180810    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180814    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180817    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180820    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180823    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180826    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180829    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180831    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180834    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180837    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180840    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180843    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180845    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180848    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180851    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180854    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:13:58.182331 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180856    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180859    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180862    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180864    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180867    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180869    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180872    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180875    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180877    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180880    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180883    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180885    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180888    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180890    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180893    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180895    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180898    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180901    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180904    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180907    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:13:58.182844 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180909    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180911    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180915    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180918    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180920    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180922    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180925    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180927    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180930    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180932    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180936    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180938    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180941    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180943    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180946    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180949    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180951    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180953    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180956    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180958    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:13:58.183410 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180961    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180963    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180966    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180986    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180989    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180992    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180994    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.180997    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181000    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181005    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181008    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181011    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181014    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181017    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181020    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181023    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181026    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181028    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181032    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:13:58.183901 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181035    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181038    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181042    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181046    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181050    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181052    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181055    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181058    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181062    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181065    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181068    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181070    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181073    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181075    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181078    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181081    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181083    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181086    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181088    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:13:58.184399 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181091    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181448    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181454    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181457    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181459    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181462    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181465    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181470    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181473    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181477    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181480    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181483    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181485    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181488    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181491    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181493    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181496    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181499    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181502    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:13:58.184871 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181505    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181507    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181510    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181512    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181515    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181518    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181521    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181524    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181526    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181529    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181531    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181534    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181536    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181539    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181541    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181544    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181547    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181549    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181552    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:13:58.185370 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181554    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181557    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181559    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181563    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181571    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181574    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181577    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181579    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181582    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181586    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181590    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181593    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181596    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181599    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181607    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181610    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181612    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181615    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181617    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181620    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:13:58.185835 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181622    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181624    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181627    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181629    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181632    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181634    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181637    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181639    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181645    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181647    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181650    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181652    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181654    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181658    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181660    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181663    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181666    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181675    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181677    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181680    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:13:58.186342 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181682    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181685    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181688    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181690    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181693    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181696    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181698    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181701    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181704    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181706    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181709    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181711    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181714    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181717    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181719    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181722    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181724    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181727    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181729    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181732    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:13:58.186882 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181736    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.181738    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181812    2580 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181850    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181860    2580 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181864    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181868    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181871    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181875    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181879    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181889    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181892    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181896    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181899    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181903    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181906    2580 flags.go:64] FLAG: --cgroup-root=""
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181909    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181912    2580 flags.go:64] FLAG: --client-ca-file=""
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181915    2580 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181918    2580 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181924    2580 flags.go:64] FLAG: --cluster-domain=""
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181927    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181930    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181933    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 19:13:58.187376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181936    2580 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181939    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181942    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181945    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181948    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181951    2580 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181954    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181957    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181962    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181965    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181986    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181990    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181994    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.181997    2580 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182000    2580 flags.go:64] FLAG: --enable-server="true"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182003    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182011    2580 flags.go:64] FLAG: --event-burst="100"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182014    2580 flags.go:64] FLAG: --event-qps="50"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182016    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182025    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182028    2580 flags.go:64] FLAG: --eviction-hard=""
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182032    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182035    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182037    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182040    2580 flags.go:64] FLAG: --eviction-soft=""
Sep 18 19:13:58.187948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182043    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182046    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182048    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182051    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182054    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182057    2580 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182059    2580 flags.go:64] FLAG: --feature-gates=""
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182063    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182066    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182068    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182071    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182074    2580 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182077    2580 flags.go:64] FLAG: --help="false"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182079    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182082    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182087    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182090    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182093    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182096    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182099    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182101    2580 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182104    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182107    2580 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 19:13:58.188580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182109    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182112    2580 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182115    2580 flags.go:64] FLAG: --kube-reserved=""
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182118    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182126    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182130    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182133    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182135    2580 flags.go:64] FLAG: --lock-file=""
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182138    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182141    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182143    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182148    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182151    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182154    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182156    2580 flags.go:64] FLAG: --logging-format="text"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182159    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182162    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182165    2580 flags.go:64] FLAG: --manifest-url=""
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182167    2580 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182171    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182174    2580 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182178    2580 flags.go:64] FLAG: --max-pods="110"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182181    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182184    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182188    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 19:13:58.189222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182191    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182193    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182196    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182199    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182205    2580 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182208    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182211    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182214    2580 flags.go:64] FLAG: --pod-cidr=""
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182217    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182222    2580 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182225    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182228    2580 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182237    2580 flags.go:64] FLAG: --port="10250"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182240    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182242    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-040959f8adde09dcf"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182246    2580 flags.go:64] FLAG: --qos-reserved=""
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182249    2580 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182252    2580 flags.go:64] FLAG: --register-node="true"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182254    2580 flags.go:64] FLAG: --register-with-taints=""
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182258    2580 flags.go:64] FLAG: --registry-burst="10"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182260    2580 flags.go:64] FLAG: --registry-qps="5"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182263    2580 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182266    2580 flags.go:64] FLAG: --reserved-memory=""
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182269    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182272    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 19:13:58.189864 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182275    2580 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182277    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182280    2580 flags.go:64] FLAG: --runonce="false"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182283    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182286    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182289    2580 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182293    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182296    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182299    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182302    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182305    2580 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182308    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182311    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182313    2580 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182316    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182319    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182322    2580 flags.go:64] FLAG: --system-cgroups=""
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182325    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182330    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182333    2580 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182343    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182350    2580 flags.go:64] FLAG: --tls-min-version=""
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182353    2580 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182355    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182358    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 19:13:58.190501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182361    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182364    2580 flags.go:64] FLAG: --v="2"
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182368    2580 flags.go:64] FLAG: --version="false"
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182376    2580 flags.go:64] FLAG: --vmodule=""
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182379    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.182383    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182515    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182519    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182522    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182525    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182528    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182531    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182537    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182541    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182543    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182546    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182549    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182552    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182555    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182558    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182560    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:13:58.191118 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182563    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182566    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182569    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182571    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182574    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182577    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182579    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182588    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182591    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182593    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182596    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182598    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182601    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182604    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182607    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182610    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182612    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182615    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182618    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182620    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:13:58.191638 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182623    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182625    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182628    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182633    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182637    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182641    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182644    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182648    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182651    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182654    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182657    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182660    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182662    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182665    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182668    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182671    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182673    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182676    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182679    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:13:58.192146 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182681    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182691    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182694    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182697    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182700    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182703    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182706    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182708    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182711    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182714    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182716    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182719    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182722    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182725    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182728    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182730    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182734    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182737    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182740    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:13:58.192627 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182743    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182745    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182748    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182750    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182753    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182756    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182759    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182761    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182764    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182767    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182769    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182772    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182775    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182778    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182780    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182784    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182786    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182789    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182792    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:13:58.193109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182794    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182797    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182800    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182802    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182805    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182807    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.182810    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.183401    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.191502    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.191517    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.191536    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.191542    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191615    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191621    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191625    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:13:58.193612 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191628    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191631    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191633    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191636    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191639    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191642    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191645    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191649    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191653    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191656    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191660    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191662    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191665    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191674    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191677    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191680    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191683    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191686    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191689    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191692    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:13:58.194007 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191694    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191697    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191699    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191702    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191704    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191707    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191710    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191713    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191716    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191719    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191722    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191724    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191727    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191730    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191732    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191738    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191741    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191744    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191746    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191749    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:13:58.194511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191752    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191755    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191757    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191760    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191762    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191765    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191773    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191776    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191779    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191781    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191784    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191786    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191789    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191793    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191797    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191800    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191802    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191805    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191809    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:13:58.195088 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191812    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191814    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191817    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191820    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191822    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191825    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191828    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191830    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191833    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191836    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191838    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191841    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191843    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191846    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191849    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191852    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191854    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191857    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191859    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191862    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:13:58.195571 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191870    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191873    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191875    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191878    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191883    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191886    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191890    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191892    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191895    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191898    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191900    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191903    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191906    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191909    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191911    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191914    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:13:58.196110 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.191917    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.191922    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192108    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192115    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192118    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192121    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192124    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192128    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192131    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192135    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192137    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192140    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192143    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192146    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:13:58.196520 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192149    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192152    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192154    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192163    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192166    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192168    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192171    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192173    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192176    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192178    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192181    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192183    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192186    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192189    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192191    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192194    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192197    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192199    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192202    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192205    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:13:58.196875 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192207    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192210    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192212    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192215    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192218    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192220    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192223    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192225    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192228    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192230    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192233    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192235    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192238    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192240    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192243    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192245    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192253    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192257    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192260    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192263    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:13:58.197375 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192266    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192269    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192271    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192274    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192276    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192279    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192282    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192284    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192287    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192289    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192292    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192294    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192297    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192300    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192302    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192305    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192307    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192310    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192312    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192315    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:13:58.197859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192317    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192320    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192322    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192325    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192327    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192330    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192332    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192335    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192337    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192345    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192348    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192351    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192354    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192357    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192360    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192363    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192365    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192368    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192371    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:13:58.198365 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192373    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192376    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192379    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192381    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192384    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192386    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192389    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:58.192392    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.192396    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.192512    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.194751    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.195622    2580 server.go:1019] "Starting client certificate rotation"
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.195728    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 19:13:58.199109 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.195765    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 19:13:58.200806 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.200787    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 19:13:58.201946 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.201925    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 19:13:58.205943 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.205926    2580 log.go:25] "Validated CRI v1 runtime API"
Sep 18 19:13:58.207750 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.207736    2580 log.go:25] "Validated CRI v1 image API"
Sep 18 19:13:58.208674 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.208660    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 19:13:58.210932 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.210903    2580 fs.go:135] Filesystem UUIDs: map[61bbc9f7-c0b3-4f38-8576-9d69c6002731:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 85a8c037-a139-46e8-b316-db49a5f58306:/dev/nvme0n1p3]
Sep 18 19:13:58.211006 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.210931    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 19:13:58.216208 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.216108    2580 manager.go:216] Machine: {Timestamp:2026-09-18 19:13:58.215634264 +0000 UTC m=+1.860389595 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101019 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec245e1e454576e205ea90135821e0d9 SystemUUID:ec245e1e-4545-76e2-05ea-90135821e0d9 BootID:27101630-9ab6-48c1-8324-301e4bfe900c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c9:cd:76:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c9:cd:76:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:97:66:d5:56:91 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 19:13:58.216208 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.216205    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 19:13:58.216315 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.216273    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 19:13:58.217999 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.217963    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 19:13:58.218130 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.218001    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 19:13:58.219212 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.219202    2580 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 19:13:58.219251 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.219215    2580 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 19:13:58.219251 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.219227    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 19:13:58.219251 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.219238    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 19:13:58.219328 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.219303    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 19:13:58.223343 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.223331    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 19:13:58.223519 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.223509    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 19:13:58.223550 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.223542    2580 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 19:13:58.223576 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.223561    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 19:13:58.223576 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.223574    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 19:13:58.223631 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.223583    2580 kubelet.go:398] "Adding apiserver pod source"
Sep 18 19:13:58.223631 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.223591    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 19:13:58.228548 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.228531    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 19:13:58.228626 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.228559    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 19:13:58.230538 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.230522    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 19:13:58.233535 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.233448    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 19:13:58.233635 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.233561    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 19:13:58.235418 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235401    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 19:13:58.235418 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235421    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235427    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235432    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235441    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235446    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235459    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235464    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235470    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235476    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235493    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235498    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235521    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 19:13:58.235523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.235527    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 19:13:58.239087 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.239074    2580 server.go:1268] "Started kubelet"
Sep 18 19:13:58.239197 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.239166    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 19:13:58.239250 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.239167    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 19:13:58.239289 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.239251    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 19:13:58.239771 ip-10-0-143-37 systemd[1]: Started Kubernetes Kubelet.
Sep 18 19:13:58.240873 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.240861    2580 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 19:13:58.241059 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.241042    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 19:13:58.241279 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.241265    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 19:13:58.241385 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.241363    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 19:13:58.243024 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.243005    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 19:13:58.243328 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.243307    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 19:13:58.243410 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.243360    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 19:13:58.247003 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.246989    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 19:13:58.247070 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.247000    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 19:13:58.247174 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.247152    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:58.247787 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.247767    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 19:13:58.247855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.247770    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 19:13:58.247962 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.247924    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 19:13:58.248075 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.248063    2580 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 19:13:58.248075 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.248074    2580 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 19:13:58.249697 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.249681    2580 factory.go:55] Registering systemd factory
Sep 18 19:13:58.249697 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.249697    2580 factory.go:223] Registration of the systemd container factory successfully
Sep 18 19:13:58.249900 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.249888    2580 factory.go:153] Registering CRI-O factory
Sep 18 19:13:58.249960 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.249904    2580 factory.go:223] Registration of the crio container factory successfully
Sep 18 19:13:58.249960 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.249950    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 19:13:58.250078 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.249989    2580 factory.go:103] Registering Raw factory
Sep 18 19:13:58.250078 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.250005    2580 manager.go:1196] Started watching for new ooms in manager
Sep 18 19:13:58.250493 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.250479    2580 manager.go:349] Starting recovery of all containers
Sep 18 19:13:58.250704 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.250686    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 19:13:58.251252 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.251234    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 19:13:58.257462 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.257445    2580 manager.go:354] Recovery completed
Sep 18 19:13:58.271143 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.271030    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:13:58.276879 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.276863    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:13:58.276961 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.276893    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:13:58.276961 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.276907    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:13:58.277449 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.277424    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 19:13:58.277449 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.277437    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 19:13:58.277536 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.277453    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 19:13:58.277574 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.277435    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:13:58.278233 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.278217    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:13:58.278302 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.278241    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:13:58.278302 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.278250    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:13:58.279615 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.279602    2580 policy_none.go:49] "None policy: Start"
Sep 18 19:13:58.279615 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.279617    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 19:13:58.279707 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.279627    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 19:13:58.281567 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.281553    2580 policy_none.go:47] "Start"
Sep 18 19:13:58.289257 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.288328    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-37.ec2.internal.18d6802e4adaa3bf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-37.ec2.internal,UID:ip-10-0-143-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-37.ec2.internal,},FirstTimestamp:2026-09-18 19:13:58.239044543 +0000 UTC m=+1.883799854,LastTimestamp:2026-09-18 19:13:58.239044543 +0000 UTC m=+1.883799854,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-37.ec2.internal,}"
Sep 18 19:13:58.297603 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.297548    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-37.ec2.internal.18d6802e4d1bf114  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-37.ec2.internal,UID:ip-10-0-143-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-37.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-37.ec2.internal,},FirstTimestamp:2026-09-18 19:13:58.276878612 +0000 UTC m=+1.921633926,LastTimestamp:2026-09-18 19:13:58.276878612 +0000 UTC m=+1.921633926,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-37.ec2.internal,}"
Sep 18 19:13:58.300444 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.300427    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hm4b"
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.311759    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-37.ec2.internal.18d6802e4d1c4158  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-37.ec2.internal,UID:ip-10-0-143-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-37.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-37.ec2.internal,},FirstTimestamp:2026-09-18 19:13:58.27689916 +0000 UTC m=+1.921654477,LastTimestamp:2026-09-18 19:13:58.27689916 +0000 UTC m=+1.921654477,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-37.ec2.internal,}"
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.312341    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hm4b"
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.316499    2580 manager.go:337] "Starting Device Plugin manager"
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.316528    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.316537    2580 server.go:87] "Starting device plugin registration server"
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.316701    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.316720    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.316784    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.316855    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.316863    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.317397    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 19:13:58.326122 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.317444    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:58.367579 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.367544    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 19:13:58.368867 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.368850    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 19:13:58.368963 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.368897    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 19:13:58.368963 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.368918    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 19:13:58.369107 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.369001    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 19:13:58.371574 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.371559    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:13:58.417836 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.417822    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:13:58.418583 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.418559    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:13:58.418583 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.418586    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:13:58.418698 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.418596    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:13:58.418698 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.418615    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.431087 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.431049    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.431087 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.431068    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-37.ec2.internal\": node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:58.461824 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.461806    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:58.469196 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.469177    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"]
Sep 18 19:13:58.469256 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.469237    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:13:58.470788 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.470773    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:13:58.470844 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.470797    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:13:58.470844 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.470808    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:13:58.473171 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.473158    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:13:58.473295 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.473282    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.473338 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.473311    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:13:58.473885 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.473869    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:13:58.473885 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.473875    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:13:58.474019 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.473897    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:13:58.474019 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.473900    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:13:58.474019 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.473909    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:13:58.474019 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.473910    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:13:58.476202 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.476188    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.476280 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.476212    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:13:58.476846 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.476831    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:13:58.476910 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.476861    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:13:58.476910 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.476877    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:13:58.504559 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.504543    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-37.ec2.internal\" not found" node="ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.508868 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.508854    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-37.ec2.internal\" not found" node="ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.549276 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.549261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6afa4c8539d7081c7f2c331a410f49da-config\") pod \"kube-apiserver-proxy-ip-10-0-143-37.ec2.internal\" (UID: \"6afa4c8539d7081c7f2c331a410f49da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.549348 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.549283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f0a96fe057f99c7c3841fbde0f4638a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"6f0a96fe057f99c7c3841fbde0f4638a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.549348 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.549298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f0a96fe057f99c7c3841fbde0f4638a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"6f0a96fe057f99c7c3841fbde0f4638a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.562196 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.562173    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:58.649663 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.649636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f0a96fe057f99c7c3841fbde0f4638a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"6f0a96fe057f99c7c3841fbde0f4638a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.649741 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.649672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6afa4c8539d7081c7f2c331a410f49da-config\") pod \"kube-apiserver-proxy-ip-10-0-143-37.ec2.internal\" (UID: \"6afa4c8539d7081c7f2c331a410f49da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.649741 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.649688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f0a96fe057f99c7c3841fbde0f4638a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"6f0a96fe057f99c7c3841fbde0f4638a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.649741 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.649735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6afa4c8539d7081c7f2c331a410f49da-config\") pod \"kube-apiserver-proxy-ip-10-0-143-37.ec2.internal\" (UID: \"6afa4c8539d7081c7f2c331a410f49da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.649837 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.649741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f0a96fe057f99c7c3841fbde0f4638a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"6f0a96fe057f99c7c3841fbde0f4638a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.649837 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.649800    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f0a96fe057f99c7c3841fbde0f4638a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"6f0a96fe057f99c7c3841fbde0f4638a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.662737 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.662722    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:58.763414 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.763370    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:58.808528 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.808508    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.813076 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:58.813061    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:58.864172 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.864151    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:58.964637 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:58.964612    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:59.065188 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:59.065139    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:59.165685 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:59.165661    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:59.195847 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.195825    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 19:13:59.196310 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.196046    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 19:13:59.266280 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:59.266258    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:59.319103 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.319052    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 19:08:58 +0000 UTC" deadline="2028-04-27 09:34:45.282405697 +0000 UTC"
Sep 18 19:13:59.319103 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.319077    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14078h20m45.963331141s"
Sep 18 19:13:59.330846 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.330829    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:13:59.366836 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:13:59.366815    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Sep 18 19:13:59.384546 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.384515    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:13:59.447734 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.447709    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:59.461404 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:59.461384    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0a96fe057f99c7c3841fbde0f4638a.slice/crio-8c5a68dc693c90e3efa355a6373d019ff3a0a9e5bbc7227d43c3ec89146eb0a4 WatchSource:0}: Error finding container 8c5a68dc693c90e3efa355a6373d019ff3a0a9e5bbc7227d43c3ec89146eb0a4: Status 404 returned error can't find the container with id 8c5a68dc693c90e3efa355a6373d019ff3a0a9e5bbc7227d43c3ec89146eb0a4
Sep 18 19:13:59.466865 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:13:59.466679    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afa4c8539d7081c7f2c331a410f49da.slice/crio-bbffe3350a6281d41e440d88a7a1825bc97ed986750dee440cfcbdf501a4f3cf WatchSource:0}: Error finding container bbffe3350a6281d41e440d88a7a1825bc97ed986750dee440cfcbdf501a4f3cf: Status 404 returned error can't find the container with id bbffe3350a6281d41e440d88a7a1825bc97ed986750dee440cfcbdf501a4f3cf
Sep 18 19:13:59.468106 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.468089    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 19:13:59.475804 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.475780    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 19:13:59.476706 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.476692    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Sep 18 19:13:59.517234 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.517215    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 19:13:59.843146 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:13:59.843125    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:14:00.017704 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.017673    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:14:00.225297 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.225209    2580 apiserver.go:52] "Watching apiserver"
Sep 18 19:14:00.232960 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.232931    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 19:14:00.233507 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.233476    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw","openshift-cluster-node-tuning-operator/tuned-zxxfj","openshift-image-registry/node-ca-mchl7","openshift-multus/multus-additional-cni-plugins-52rk4","openshift-multus/multus-hg9dp","openshift-multus/network-metrics-daemon-r7bpt","kube-system/global-pull-secret-syncer-p2742","openshift-dns/node-resolver-cmpvg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal","openshift-network-diagnostics/network-check-target-n9gqp","openshift-network-operator/iptables-alerter-vm9bk","openshift-ovn-kubernetes/ovnkube-node-rx96p","kube-system/konnectivity-agent-wfc56"]
Sep 18 19:14:00.236008 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.235987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:00.236119 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.236083    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:00.238339 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.238315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.240932 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.240611    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.242956 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.242935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mchl7"
Sep 18 19:14:00.245239 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.245218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.246297 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.245914    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 19:14:00.246297 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.245938    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:14:00.247384 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.247365    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kgzbw\""
Sep 18 19:14:00.247459 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.247411    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 19:14:00.247496 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.247487    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 19:14:00.247533 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.247366    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 19:14:00.247993 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.247737    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 19:14:00.247993 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.247781    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 19:14:00.247993 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.247792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.247993 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.247744    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 19:14:00.248374 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.248356    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 19:14:00.249228 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.249208    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 19:14:00.249341 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.249326    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9f6lc\""
Sep 18 19:14:00.249383 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.249211    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 19:14:00.249452 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.249211    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 19:14:00.249540 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.249527    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 19:14:00.249576 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.249571    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tnnmq\""
Sep 18 19:14:00.249736 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.249721    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 19:14:00.250691 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.250654    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rrlpz\""
Sep 18 19:14:00.252172 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.252153    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cmpvg"
Sep 18 19:14:00.254468 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.254447    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 19:14:00.255161 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.255143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:00.255867 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.255842    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 19:14:00.256148 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.256129    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 19:14:00.256551 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.256531    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 19:14:00.256923 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.256903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-hostroot\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.257020 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.256967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/373c0994-3612-49aa-80f4-37ed02681856-hosts-file\") pod \"node-resolver-cmpvg\" (UID: \"373c0994-3612-49aa-80f4-37ed02681856\") " pod="openshift-dns/node-resolver-cmpvg"
Sep 18 19:14:00.257084 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257043    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff04f9c0-a964-4381-b1be-7934d50433af-tmp\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.257138 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.257138 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-log-socket\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.257242 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2p64\" (UniqueName: \"kubernetes.io/projected/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-kube-api-access-x2p64\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.257242 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-lib-modules\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.257242 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-run-systemd\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.257242 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-run-k8s-cni-cncf-io\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.257242 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3fd8613-128f-437b-b356-c618813583d0-multus-daemon-config\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.257481 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-systemd\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.257481 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-system-cni-dir\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.257481 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-etc-kubernetes\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.257481 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwk56\" (UniqueName: \"kubernetes.io/projected/373c0994-3612-49aa-80f4-37ed02681856-kube-api-access-kwk56\") pod \"node-resolver-cmpvg\" (UID: \"373c0994-3612-49aa-80f4-37ed02681856\") " pod="openshift-dns/node-resolver-cmpvg"
Sep 18 19:14:00.257481 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-host\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.257481 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-run-openvswitch\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.257481 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-sysctl-conf\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.257481 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-var-lib-cni-multus\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.257852 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rrsm\" (UniqueName: \"kubernetes.io/projected/d3082557-8a7a-424f-b6af-d746972e7352-kube-api-access-9rrsm\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:00.257852 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257752    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-kubelet\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.257852 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-systemd-units\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.257852 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.258065 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-ovnkube-script-lib\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.258065 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.257965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.258065 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.258016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-slash\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.258065 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.258039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-var-lib-openvswitch\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.258181 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.258066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-node-log\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.258181 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.258097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.258181 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.258127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-multus-cni-dir\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.258181 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.258156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-multus-conf-dir\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.258292 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.258183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-run-ovn\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.258292 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.258211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.258292 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.258238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4xf4\" (UniqueName: \"kubernetes.io/projected/ff04f9c0-a964-4381-b1be-7934d50433af-kube-api-access-h4xf4\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.258292 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.258267    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-env-overrides\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.259780 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.259760    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.259891    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xzmsw\""
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.258302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-run\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260131    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-system-cni-dir\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-ovnkube-config\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-multus-socket-dir-parent\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-var-lib-cni-bin\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-var-lib-kubelet\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260444    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kr9kd\""
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260460    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/373c0994-3612-49aa-80f4-37ed02681856-tmp-dir\") pod \"node-resolver-cmpvg\" (UID: \"373c0994-3612-49aa-80f4-37ed02681856\") " pod="openshift-dns/node-resolver-cmpvg"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-sysconfig\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff04f9c0-a964-4381-b1be-7934d50433af-etc-tuned\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-etc-openvswitch\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-ovn-node-metrics-cert\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7a6186c8-e5b6-4b5c-827f-0702f4786c68-serviceca\") pod \"node-ca-mchl7\" (UID: \"7a6186c8-e5b6-4b5c-827f-0702f4786c68\") " pod="openshift-image-registry/node-ca-mchl7"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-run-multus-certs\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.262307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf6hz\" (UniqueName: \"kubernetes.io/projected/7a6186c8-e5b6-4b5c-827f-0702f4786c68-kube-api-access-vf6hz\") pod \"node-ca-mchl7\" (UID: \"7a6186c8-e5b6-4b5c-827f-0702f4786c68\") " pod="openshift-image-registry/node-ca-mchl7"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-cnibin\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3fd8613-128f-437b-b356-c618813583d0-cni-binary-copy\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.260954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4jh5\" (UniqueName: \"kubernetes.io/projected/d3fd8613-128f-437b-b356-c618813583d0-kube-api-access-q4jh5\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-kubernetes\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-run-netns\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-var-lib-kubelet\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261129    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-modprobe-d\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a6186c8-e5b6-4b5c-827f-0702f4786c68-host\") pod \"node-ca-mchl7\" (UID: \"7a6186c8-e5b6-4b5c-827f-0702f4786c68\") " pod="openshift-image-registry/node-ca-mchl7"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-run-netns\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-cni-bin\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-cni-netd\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261259    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-cnibin\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-sysctl-d\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.263246 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-sys\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.264552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68wgr\" (UniqueName: \"kubernetes.io/projected/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-kube-api-access-68wgr\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.264552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261327    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ch9ws\""
Sep 18 19:14:00.264552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.261759    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:00.264552 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.261823    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:00.264552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.262238    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 19:14:00.264552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.263546    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fr685\""
Sep 18 19:14:00.264552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.263750    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 19:14:00.264552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.264147    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 19:14:00.264552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.264189    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 19:14:00.264552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.264277    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:00.264552 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.264348    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:00.267441 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.267424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vm9bk"
Sep 18 19:14:00.273558 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.273538    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 19:14:00.273647 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.273604    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n5qr9\""
Sep 18 19:14:00.273819 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.273787    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 19:14:00.274020 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.273961    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:14:00.296249 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.296226    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 19:14:00.309131 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.309109    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5dkdl"
Sep 18 19:14:00.336655 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.336630    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5dkdl"
Sep 18 19:14:00.349718 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.349698    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 19:14:00.362130 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-node-log\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.362231 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.362231 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-multus-cni-dir\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.362231 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-multus-conf-dir\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.362231 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-kubelet-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.362417 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362221    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-node-log\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.362417 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.362417 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-sys-fs\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.362417 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-multus-conf-dir\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.362417 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-multus-cni-dir\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.362417 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-run-ovn\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.362417 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.362417 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4xf4\" (UniqueName: \"kubernetes.io/projected/ff04f9c0-a964-4381-b1be-7934d50433af-kube-api-access-h4xf4\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.362417 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a07cc7e5-d5f1-44e3-affc-88808fec404e-konnectivity-ca\") pod \"konnectivity-agent-wfc56\" (UID: \"a07cc7e5-d5f1-44e3-affc-88808fec404e\") " pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362426    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-run-ovn\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtg64\" (UniqueName: \"kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64\") pod \"network-check-target-n9gqp\" (UID: \"7dee6d26-e153-4f04-84f1-5b6e0cb288e7\") " pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmpcv\" (UniqueName: \"kubernetes.io/projected/594ef2ba-5b57-424d-9eed-84f7341fb0ba-kube-api-access-cmpcv\") pod \"iptables-alerter-vm9bk\" (UID: \"594ef2ba-5b57-424d-9eed-84f7341fb0ba\") " pod="openshift-network-operator/iptables-alerter-vm9bk"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-env-overrides\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-run\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-etc-selinux\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-system-cni-dir\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-ovnkube-config\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-multus-socket-dir-parent\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-var-lib-cni-bin\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-var-lib-kubelet\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-system-cni-dir\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362801    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/373c0994-3612-49aa-80f4-37ed02681856-tmp-dir\") pod \"node-resolver-cmpvg\" (UID: \"373c0994-3612-49aa-80f4-37ed02681856\") " pod="openshift-dns/node-resolver-cmpvg"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-run\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.362833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-sysconfig\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff04f9c0-a964-4381-b1be-7934d50433af-etc-tuned\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-etc-openvswitch\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-ovn-node-metrics-cert\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7a6186c8-e5b6-4b5c-827f-0702f4786c68-serviceca\") pod \"node-ca-mchl7\" (UID: \"7a6186c8-e5b6-4b5c-827f-0702f4786c68\") " pod="openshift-image-registry/node-ca-mchl7"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.362953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-run-multus-certs\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-var-lib-cni-bin\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/594ef2ba-5b57-424d-9eed-84f7341fb0ba-iptables-alerter-script\") pod \"iptables-alerter-vm9bk\" (UID: \"594ef2ba-5b57-424d-9eed-84f7341fb0ba\") " pod="openshift-network-operator/iptables-alerter-vm9bk"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf6hz\" (UniqueName: \"kubernetes.io/projected/7a6186c8-e5b6-4b5c-827f-0702f4786c68-kube-api-access-vf6hz\") pod \"node-ca-mchl7\" (UID: \"7a6186c8-e5b6-4b5c-827f-0702f4786c68\") " pod="openshift-image-registry/node-ca-mchl7"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-multus-socket-dir-parent\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/373c0994-3612-49aa-80f4-37ed02681856-tmp-dir\") pod \"node-resolver-cmpvg\" (UID: \"373c0994-3612-49aa-80f4-37ed02681856\") " pod="openshift-dns/node-resolver-cmpvg"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-env-overrides\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-cnibin\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-var-lib-kubelet\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-run-multus-certs\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.363608 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.363269    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363273    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3fd8613-128f-437b-b356-c618813583d0-cni-binary-copy\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-ovnkube-config\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-sysconfig\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-cnibin\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363592    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-etc-openvswitch\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363579    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.363655    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs podName:d3082557-8a7a-424f-b6af-d746972e7352 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:00.863614022 +0000 UTC m=+4.508369342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs") pod "network-metrics-daemon-r7bpt" (UID: "d3082557-8a7a-424f-b6af-d746972e7352") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363758    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3fd8613-128f-437b-b356-c618813583d0-cni-binary-copy\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4jh5\" (UniqueName: \"kubernetes.io/projected/d3fd8613-128f-437b-b356-c618813583d0-kube-api-access-q4jh5\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-kubernetes\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363760    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7a6186c8-e5b6-4b5c-827f-0702f4786c68-serviceca\") pod \"node-ca-mchl7\" (UID: \"7a6186c8-e5b6-4b5c-827f-0702f4786c68\") " pod="openshift-image-registry/node-ca-mchl7"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-run-netns\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363882    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-var-lib-kubelet\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-kubernetes\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.364265 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-modprobe-d\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a6186c8-e5b6-4b5c-827f-0702f4786c68-host\") pod \"node-ca-mchl7\" (UID: \"7a6186c8-e5b6-4b5c-827f-0702f4786c68\") " pod="openshift-image-registry/node-ca-mchl7"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-run-netns\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.363986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-cni-bin\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-cni-netd\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-modprobe-d\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-cnibin\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a6186c8-e5b6-4b5c-827f-0702f4786c68-host\") pod \"node-ca-mchl7\" (UID: \"7a6186c8-e5b6-4b5c-827f-0702f4786c68\") " pod="openshift-image-registry/node-ca-mchl7"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-var-lib-kubelet\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-sysctl-d\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-sys\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-cni-netd\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-cni-bin\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364136    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-cnibin\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wgr\" (UniqueName: \"kubernetes.io/projected/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-kube-api-access-68wgr\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-sys\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-hostroot\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.364816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-run-netns\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/373c0994-3612-49aa-80f4-37ed02681856-hosts-file\") pod \"node-resolver-cmpvg\" (UID: \"373c0994-3612-49aa-80f4-37ed02681856\") " pod="openshift-dns/node-resolver-cmpvg"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364214    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-run-netns\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-sysctl-d\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364239    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-hostroot\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff04f9c0-a964-4381-b1be-7934d50433af-tmp\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/373c0994-3612-49aa-80f4-37ed02681856-hosts-file\") pod \"node-resolver-cmpvg\" (UID: \"373c0994-3612-49aa-80f4-37ed02681856\") " pod="openshift-dns/node-resolver-cmpvg"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/594ef2ba-5b57-424d-9eed-84f7341fb0ba-host-slash\") pod \"iptables-alerter-vm9bk\" (UID: \"594ef2ba-5b57-424d-9eed-84f7341fb0ba\") " pod="openshift-network-operator/iptables-alerter-vm9bk"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-registration-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhbkx\" (UniqueName: \"kubernetes.io/projected/2bd6983a-dfa9-437e-b2ee-36d64d039b92-kube-api-access-xhbkx\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-log-socket\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2p64\" (UniqueName: \"kubernetes.io/projected/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-kube-api-access-x2p64\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364432    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-log-socket\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-lib-modules\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-run-systemd\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364492    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a07cc7e5-d5f1-44e3-affc-88808fec404e-agent-certs\") pod \"konnectivity-agent-wfc56\" (UID: \"a07cc7e5-d5f1-44e3-affc-88808fec404e\") " pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:00.365342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-run-k8s-cni-cncf-io\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3fd8613-128f-437b-b356-c618813583d0-multus-daemon-config\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-systemd\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-device-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-system-cni-dir\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-etc-kubernetes\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwk56\" (UniqueName: \"kubernetes.io/projected/373c0994-3612-49aa-80f4-37ed02681856-kube-api-access-kwk56\") pod \"node-resolver-cmpvg\" (UID: \"373c0994-3612-49aa-80f4-37ed02681856\") " pod="openshift-dns/node-resolver-cmpvg"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-host\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-run-openvswitch\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-lib-modules\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-sysctl-conf\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-kubelet-config\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364744    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-run-systemd\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364778    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-etc-kubernetes\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-dbus\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:00.365814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-var-lib-cni-multus\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364878    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-systemd\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rrsm\" (UniqueName: \"kubernetes.io/projected/d3082557-8a7a-424f-b6af-d746972e7352-kube-api-access-9rrsm\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-kubelet\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-run-k8s-cni-cncf-io\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-systemd-units\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.364957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-host\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365012    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-systemd-units\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-run-openvswitch\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-system-cni-dir\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3fd8613-128f-437b-b356-c618813583d0-host-var-lib-cni-multus\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff04f9c0-a964-4381-b1be-7934d50433af-etc-sysctl-conf\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-kubelet\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-ovnkube-script-lib\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-socket-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-slash\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.366520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-var-lib-openvswitch\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.367177 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-var-lib-openvswitch\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.367177 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3fd8613-128f-437b-b356-c618813583d0-multus-daemon-config\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.367177 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-host-slash\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.367177 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-ovnkube-script-lib\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.367177 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.365833    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.367372 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.367353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff04f9c0-a964-4381-b1be-7934d50433af-tmp\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.367372 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.367359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-ovn-node-metrics-cert\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.368096 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.368079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff04f9c0-a964-4381-b1be-7934d50433af-etc-tuned\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.375793 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.375750    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" event={"ID":"6afa4c8539d7081c7f2c331a410f49da","Type":"ContainerStarted","Data":"bbffe3350a6281d41e440d88a7a1825bc97ed986750dee440cfcbdf501a4f3cf"}
Sep 18 19:14:00.377020 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.376989    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" event={"ID":"6f0a96fe057f99c7c3841fbde0f4638a","Type":"ContainerStarted","Data":"8c5a68dc693c90e3efa355a6373d019ff3a0a9e5bbc7227d43c3ec89146eb0a4"}
Sep 18 19:14:00.382778 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.382760    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf6hz\" (UniqueName: \"kubernetes.io/projected/7a6186c8-e5b6-4b5c-827f-0702f4786c68-kube-api-access-vf6hz\") pod \"node-ca-mchl7\" (UID: \"7a6186c8-e5b6-4b5c-827f-0702f4786c68\") " pod="openshift-image-registry/node-ca-mchl7"
Sep 18 19:14:00.384550 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.384528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4xf4\" (UniqueName: \"kubernetes.io/projected/ff04f9c0-a964-4381-b1be-7934d50433af-kube-api-access-h4xf4\") pod \"tuned-zxxfj\" (UID: \"ff04f9c0-a964-4381-b1be-7934d50433af\") " pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.388768 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.388742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwk56\" (UniqueName: \"kubernetes.io/projected/373c0994-3612-49aa-80f4-37ed02681856-kube-api-access-kwk56\") pod \"node-resolver-cmpvg\" (UID: \"373c0994-3612-49aa-80f4-37ed02681856\") " pod="openshift-dns/node-resolver-cmpvg"
Sep 18 19:14:00.388996 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.388958    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2p64\" (UniqueName: \"kubernetes.io/projected/ddf53171-d25a-4e1b-8aa4-00e664f2f2d3-kube-api-access-x2p64\") pod \"multus-additional-cni-plugins-52rk4\" (UID: \"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3\") " pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.390887 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.390867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4jh5\" (UniqueName: \"kubernetes.io/projected/d3fd8613-128f-437b-b356-c618813583d0-kube-api-access-q4jh5\") pod \"multus-hg9dp\" (UID: \"d3fd8613-128f-437b-b356-c618813583d0\") " pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.391545 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.391527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rrsm\" (UniqueName: \"kubernetes.io/projected/d3082557-8a7a-424f-b6af-d746972e7352-kube-api-access-9rrsm\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:00.392330 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.392311    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68wgr\" (UniqueName: \"kubernetes.io/projected/65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe-kube-api-access-68wgr\") pod \"ovnkube-node-rx96p\" (UID: \"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.466104 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/594ef2ba-5b57-424d-9eed-84f7341fb0ba-host-slash\") pod \"iptables-alerter-vm9bk\" (UID: \"594ef2ba-5b57-424d-9eed-84f7341fb0ba\") " pod="openshift-network-operator/iptables-alerter-vm9bk"
Sep 18 19:14:00.466199 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-registration-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466199 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhbkx\" (UniqueName: \"kubernetes.io/projected/2bd6983a-dfa9-437e-b2ee-36d64d039b92-kube-api-access-xhbkx\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466199 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466148    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a07cc7e5-d5f1-44e3-affc-88808fec404e-agent-certs\") pod \"konnectivity-agent-wfc56\" (UID: \"a07cc7e5-d5f1-44e3-affc-88808fec404e\") " pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:00.466199 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-device-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466199 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/594ef2ba-5b57-424d-9eed-84f7341fb0ba-host-slash\") pod \"iptables-alerter-vm9bk\" (UID: \"594ef2ba-5b57-424d-9eed-84f7341fb0ba\") " pod="openshift-network-operator/iptables-alerter-vm9bk"
Sep 18 19:14:00.466394 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-kubelet-config\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:00.466394 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-registration-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466394 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-dbus\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:00.466394 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:00.466394 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-device-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466394 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-socket-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466394 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-kubelet-config\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:00.466394 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-kubelet-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466394 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-sys-fs\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a07cc7e5-d5f1-44e3-affc-88808fec404e-konnectivity-ca\") pod \"konnectivity-agent-wfc56\" (UID: \"a07cc7e5-d5f1-44e3-affc-88808fec404e\") " pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtg64\" (UniqueName: \"kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64\") pod \"network-check-target-n9gqp\" (UID: \"7dee6d26-e153-4f04-84f1-5b6e0cb288e7\") " pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-dbus\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-socket-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmpcv\" (UniqueName: \"kubernetes.io/projected/594ef2ba-5b57-424d-9eed-84f7341fb0ba-kube-api-access-cmpcv\") pod \"iptables-alerter-vm9bk\" (UID: \"594ef2ba-5b57-424d-9eed-84f7341fb0ba\") " pod="openshift-network-operator/iptables-alerter-vm9bk"
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-etc-selinux\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-sys-fs\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/594ef2ba-5b57-424d-9eed-84f7341fb0ba-iptables-alerter-script\") pod \"iptables-alerter-vm9bk\" (UID: \"594ef2ba-5b57-424d-9eed-84f7341fb0ba\") " pod="openshift-network-operator/iptables-alerter-vm9bk"
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-kubelet-dir\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.466680    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.466700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2bd6983a-dfa9-437e-b2ee-36d64d039b92-etc-selinux\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.466755 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.466732    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret podName:b82e3dd9-8c44-49cc-861b-69e0b21d16ec nodeName:}" failed. No retries permitted until 2026-09-18 19:14:00.966712731 +0000 UTC m=+4.611468042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret") pod "global-pull-secret-syncer-p2742" (UID: "b82e3dd9-8c44-49cc-861b-69e0b21d16ec") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:00.467603 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.467234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/594ef2ba-5b57-424d-9eed-84f7341fb0ba-iptables-alerter-script\") pod \"iptables-alerter-vm9bk\" (UID: \"594ef2ba-5b57-424d-9eed-84f7341fb0ba\") " pod="openshift-network-operator/iptables-alerter-vm9bk"
Sep 18 19:14:00.467997 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.467932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a07cc7e5-d5f1-44e3-affc-88808fec404e-konnectivity-ca\") pod \"konnectivity-agent-wfc56\" (UID: \"a07cc7e5-d5f1-44e3-affc-88808fec404e\") " pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:00.468643 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.468621    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a07cc7e5-d5f1-44e3-affc-88808fec404e-agent-certs\") pod \"konnectivity-agent-wfc56\" (UID: \"a07cc7e5-d5f1-44e3-affc-88808fec404e\") " pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:00.492627 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.492577    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:14:00.492627 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.492602    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:14:00.492627 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.492618    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vtg64 for pod openshift-network-diagnostics/network-check-target-n9gqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:00.492798 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.492684    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64 podName:7dee6d26-e153-4f04-84f1-5b6e0cb288e7 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:00.992671203 +0000 UTC m=+4.637426517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vtg64" (UniqueName: "kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64") pod "network-check-target-n9gqp" (UID: "7dee6d26-e153-4f04-84f1-5b6e0cb288e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:00.495326 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.495302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmpcv\" (UniqueName: \"kubernetes.io/projected/594ef2ba-5b57-424d-9eed-84f7341fb0ba-kube-api-access-cmpcv\") pod \"iptables-alerter-vm9bk\" (UID: \"594ef2ba-5b57-424d-9eed-84f7341fb0ba\") " pod="openshift-network-operator/iptables-alerter-vm9bk"
Sep 18 19:14:00.499075 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.499056    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhbkx\" (UniqueName: \"kubernetes.io/projected/2bd6983a-dfa9-437e-b2ee-36d64d039b92-kube-api-access-xhbkx\") pod \"aws-ebs-csi-driver-node-59tcw\" (UID: \"2bd6983a-dfa9-437e-b2ee-36d64d039b92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.550881 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.550859    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:00.560128 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.560109    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zxxfj"
Sep 18 19:14:00.569710 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.569684    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mchl7"
Sep 18 19:14:00.578016 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.577997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52rk4"
Sep 18 19:14:00.583628 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.583612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hg9dp"
Sep 18 19:14:00.597764 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.597744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cmpvg"
Sep 18 19:14:00.604132 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.604113    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:00.611016 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.610998    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw"
Sep 18 19:14:00.618722 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.618707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vm9bk"
Sep 18 19:14:00.868875 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.868840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:00.869059 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.868992    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:00.869104 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.869063    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs podName:d3082557-8a7a-424f-b6af-d746972e7352 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:01.869044528 +0000 UTC m=+5.513799833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs") pod "network-metrics-daemon-r7bpt" (UID: "d3082557-8a7a-424f-b6af-d746972e7352") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:00.969362 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:00.969330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:00.969516 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.969495    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:00.969588 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:00.969575    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret podName:b82e3dd9-8c44-49cc-861b-69e0b21d16ec nodeName:}" failed. No retries permitted until 2026-09-18 19:14:01.969556284 +0000 UTC m=+5.614311585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret") pod "global-pull-secret-syncer-p2742" (UID: "b82e3dd9-8c44-49cc-861b-69e0b21d16ec") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:01.070205 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.070164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtg64\" (UniqueName: \"kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64\") pod \"network-check-target-n9gqp\" (UID: \"7dee6d26-e153-4f04-84f1-5b6e0cb288e7\") " pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:01.070355 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:01.070320    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:14:01.070355 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:01.070339    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:14:01.070355 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:01.070351    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vtg64 for pod openshift-network-diagnostics/network-check-target-n9gqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:01.070517 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:01.070415    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64 podName:7dee6d26-e153-4f04-84f1-5b6e0cb288e7 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:02.070396074 +0000 UTC m=+5.715151375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtg64" (UniqueName: "kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64") pod "network-check-target-n9gqp" (UID: "7dee6d26-e153-4f04-84f1-5b6e0cb288e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:01.339558 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.339447    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 19:09:00 +0000 UTC" deadline="2028-05-13 12:54:20.198033052 +0000 UTC"
Sep 18 19:14:01.339558 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.339479    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14465h40m18.858558087s"
Sep 18 19:14:01.353578 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:14:01.353551    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594ef2ba_5b57_424d_9eed_84f7341fb0ba.slice/crio-7f0a10fa15b4c740c0fc1394d820bc03bde9a887504ec5f64dd58ff90d798ff0 WatchSource:0}: Error finding container 7f0a10fa15b4c740c0fc1394d820bc03bde9a887504ec5f64dd58ff90d798ff0: Status 404 returned error can't find the container with id 7f0a10fa15b4c740c0fc1394d820bc03bde9a887504ec5f64dd58ff90d798ff0
Sep 18 19:14:01.356534 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:14:01.356287    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff04f9c0_a964_4381_b1be_7934d50433af.slice/crio-0b063d592bf573877280b1e57f14a4fd412951cf8d4f207dc0c6be5639e05da6 WatchSource:0}: Error finding container 0b063d592bf573877280b1e57f14a4fd412951cf8d4f207dc0c6be5639e05da6: Status 404 returned error can't find the container with id 0b063d592bf573877280b1e57f14a4fd412951cf8d4f207dc0c6be5639e05da6
Sep 18 19:14:01.361511 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:14:01.361491    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ef3b15_9c5b_43b6_8cdb_e4cb3e03e3fe.slice/crio-930b7de58736a46d8e95f9c78693de31fa175ababa21beb3356d851cb4221cba WatchSource:0}: Error finding container 930b7de58736a46d8e95f9c78693de31fa175ababa21beb3356d851cb4221cba: Status 404 returned error can't find the container with id 930b7de58736a46d8e95f9c78693de31fa175ababa21beb3356d851cb4221cba
Sep 18 19:14:01.363428 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:14:01.363394    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf53171_d25a_4e1b_8aa4_00e664f2f2d3.slice/crio-336573d924e3d9fb60a862429bada0553d6bd85fb3207a4989ae6793d13f4a6a WatchSource:0}: Error finding container 336573d924e3d9fb60a862429bada0553d6bd85fb3207a4989ae6793d13f4a6a: Status 404 returned error can't find the container with id 336573d924e3d9fb60a862429bada0553d6bd85fb3207a4989ae6793d13f4a6a
Sep 18 19:14:01.364554 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:14:01.364432    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fd8613_128f_437b_b356_c618813583d0.slice/crio-12ab4df3a75dc3fdeabf0e745c6fff5e912ee8ae09c4471db908734eb7b6f9f6 WatchSource:0}: Error finding container 12ab4df3a75dc3fdeabf0e745c6fff5e912ee8ae09c4471db908734eb7b6f9f6: Status 404 returned error can't find the container with id 12ab4df3a75dc3fdeabf0e745c6fff5e912ee8ae09c4471db908734eb7b6f9f6
Sep 18 19:14:01.366149 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:14:01.366073    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07cc7e5_d5f1_44e3_affc_88808fec404e.slice/crio-851349ba5a4b0ba8ffb1dcae562c82fff2a0537f1c4c969d4e6d7429b36f9173 WatchSource:0}: Error finding container 851349ba5a4b0ba8ffb1dcae562c82fff2a0537f1c4c969d4e6d7429b36f9173: Status 404 returned error can't find the container with id 851349ba5a4b0ba8ffb1dcae562c82fff2a0537f1c4c969d4e6d7429b36f9173
Sep 18 19:14:01.368778 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:14:01.368674    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6186c8_e5b6_4b5c_827f_0702f4786c68.slice/crio-fc6dcac6707fec76cb9f825a13ee987265b0ba4fb0227330883483016babcd98 WatchSource:0}: Error finding container fc6dcac6707fec76cb9f825a13ee987265b0ba4fb0227330883483016babcd98: Status 404 returned error can't find the container with id fc6dcac6707fec76cb9f825a13ee987265b0ba4fb0227330883483016babcd98
Sep 18 19:14:01.369313 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.369190    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:01.369313 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.369301    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:01.369409 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:01.369312    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:01.369461 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:01.369407    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:01.369517 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.369467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:01.369620 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:01.369569    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:01.379600 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.379577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cmpvg" event={"ID":"373c0994-3612-49aa-80f4-37ed02681856","Type":"ContainerStarted","Data":"199dae16f83975f8b748137d3f4993262e41b25703f5f8e0c0a0e304e260f479"}
Sep 18 19:14:01.380835 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.380811    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw" event={"ID":"2bd6983a-dfa9-437e-b2ee-36d64d039b92","Type":"ContainerStarted","Data":"fcb2f18f06a6beb509a760733658899613b551591316ee2a57ffe800f213d275"}
Sep 18 19:14:01.382055 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.382027    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wfc56" event={"ID":"a07cc7e5-d5f1-44e3-affc-88808fec404e","Type":"ContainerStarted","Data":"851349ba5a4b0ba8ffb1dcae562c82fff2a0537f1c4c969d4e6d7429b36f9173"}
Sep 18 19:14:01.383139 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.383105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hg9dp" event={"ID":"d3fd8613-128f-437b-b356-c618813583d0","Type":"ContainerStarted","Data":"12ab4df3a75dc3fdeabf0e745c6fff5e912ee8ae09c4471db908734eb7b6f9f6"}
Sep 18 19:14:01.384236 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.384217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52rk4" event={"ID":"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3","Type":"ContainerStarted","Data":"336573d924e3d9fb60a862429bada0553d6bd85fb3207a4989ae6793d13f4a6a"}
Sep 18 19:14:01.385476 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.385454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p" event={"ID":"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe","Type":"ContainerStarted","Data":"930b7de58736a46d8e95f9c78693de31fa175ababa21beb3356d851cb4221cba"}
Sep 18 19:14:01.386594 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.386572    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mchl7" event={"ID":"7a6186c8-e5b6-4b5c-827f-0702f4786c68","Type":"ContainerStarted","Data":"fc6dcac6707fec76cb9f825a13ee987265b0ba4fb0227330883483016babcd98"}
Sep 18 19:14:01.387938 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.387914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zxxfj" event={"ID":"ff04f9c0-a964-4381-b1be-7934d50433af","Type":"ContainerStarted","Data":"0b063d592bf573877280b1e57f14a4fd412951cf8d4f207dc0c6be5639e05da6"}
Sep 18 19:14:01.389228 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.389197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vm9bk" event={"ID":"594ef2ba-5b57-424d-9eed-84f7341fb0ba","Type":"ContainerStarted","Data":"7f0a10fa15b4c740c0fc1394d820bc03bde9a887504ec5f64dd58ff90d798ff0"}
Sep 18 19:14:01.875872 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.875587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:01.876069 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:01.875995    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:01.876069 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:01.876068    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs podName:d3082557-8a7a-424f-b6af-d746972e7352 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:03.876050732 +0000 UTC m=+7.520806036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs") pod "network-metrics-daemon-r7bpt" (UID: "d3082557-8a7a-424f-b6af-d746972e7352") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:01.976312 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:01.976277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:01.976476 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:01.976444    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:01.976538 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:01.976504    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret podName:b82e3dd9-8c44-49cc-861b-69e0b21d16ec nodeName:}" failed. No retries permitted until 2026-09-18 19:14:03.976486418 +0000 UTC m=+7.621241717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret") pod "global-pull-secret-syncer-p2742" (UID: "b82e3dd9-8c44-49cc-861b-69e0b21d16ec") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:02.076766 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:02.076732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtg64\" (UniqueName: \"kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64\") pod \"network-check-target-n9gqp\" (UID: \"7dee6d26-e153-4f04-84f1-5b6e0cb288e7\") " pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:02.076915 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:02.076904    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:14:02.077018 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:02.076925    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:14:02.077018 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:02.076939    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vtg64 for pod openshift-network-diagnostics/network-check-target-n9gqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:02.077018 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:02.077014    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64 podName:7dee6d26-e153-4f04-84f1-5b6e0cb288e7 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:04.076995143 +0000 UTC m=+7.721750442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtg64" (UniqueName: "kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64") pod "network-check-target-n9gqp" (UID: "7dee6d26-e153-4f04-84f1-5b6e0cb288e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:02.339666 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:02.339609    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 19:09:00 +0000 UTC" deadline="2028-06-29 11:49:36.716202714 +0000 UTC"
Sep 18 19:14:02.339666 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:02.339667    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15592h35m34.376540061s"
Sep 18 19:14:02.411941 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:02.411905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" event={"ID":"6afa4c8539d7081c7f2c331a410f49da","Type":"ContainerStarted","Data":"5cd3c6a210de9a3d947f6b0eea391e78d6c473e15d73e1914d495b2f4ae64418"}
Sep 18 19:14:02.429220 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:02.429188    2580 generic.go:356] "Generic (PLEG): container finished" podID="6f0a96fe057f99c7c3841fbde0f4638a" containerID="d03adcd257edeb212bbc88e4e39ed4660639b50e07925de5195afc99e39135a5" exitCode=0
Sep 18 19:14:02.429354 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:02.429233    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" event={"ID":"6f0a96fe057f99c7c3841fbde0f4638a","Type":"ContainerDied","Data":"d03adcd257edeb212bbc88e4e39ed4660639b50e07925de5195afc99e39135a5"}
Sep 18 19:14:02.464128 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:02.464078    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" podStartSLOduration=3.464059908 podStartE2EDuration="3.464059908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:13:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:02.438542309 +0000 UTC m=+6.083297659" watchObservedRunningTime="2026-09-18 19:14:02.464059908 +0000 UTC m=+6.108815231"
Sep 18 19:14:03.370649 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:03.369847    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:03.370649 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:03.369961    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:03.370649 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:03.370373    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:03.370649 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:03.370473    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:03.370649 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:03.370537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:03.370649 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:03.370608    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:03.468649 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:03.468584    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" event={"ID":"6f0a96fe057f99c7c3841fbde0f4638a","Type":"ContainerStarted","Data":"a69373d48d3ee98d7bfce515ff278492675345a2ebaa519a6847ff9d3cf57e05"}
Sep 18 19:14:03.497163 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:03.497105    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" podStartSLOduration=4.497086367 podStartE2EDuration="4.497086367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:13:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:03.495146075 +0000 UTC m=+7.139901407" watchObservedRunningTime="2026-09-18 19:14:03.497086367 +0000 UTC m=+7.141841688"
Sep 18 19:14:03.892901 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:03.892859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:03.893135 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:03.893107    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:03.893215 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:03.893176    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs podName:d3082557-8a7a-424f-b6af-d746972e7352 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:07.893156338 +0000 UTC m=+11.537911647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs") pod "network-metrics-daemon-r7bpt" (UID: "d3082557-8a7a-424f-b6af-d746972e7352") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:03.994226 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:03.994192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:03.994386 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:03.994352    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:03.994469 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:03.994419    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret podName:b82e3dd9-8c44-49cc-861b-69e0b21d16ec nodeName:}" failed. No retries permitted until 2026-09-18 19:14:07.994399891 +0000 UTC m=+11.639155203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret") pod "global-pull-secret-syncer-p2742" (UID: "b82e3dd9-8c44-49cc-861b-69e0b21d16ec") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:04.095632 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:04.095027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtg64\" (UniqueName: \"kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64\") pod \"network-check-target-n9gqp\" (UID: \"7dee6d26-e153-4f04-84f1-5b6e0cb288e7\") " pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:04.095632 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:04.095204    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:14:04.095632 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:04.095222    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:14:04.095632 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:04.095234    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vtg64 for pod openshift-network-diagnostics/network-check-target-n9gqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:04.095632 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:04.095289    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64 podName:7dee6d26-e153-4f04-84f1-5b6e0cb288e7 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:08.095272204 +0000 UTC m=+11.740027507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtg64" (UniqueName: "kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64") pod "network-check-target-n9gqp" (UID: "7dee6d26-e153-4f04-84f1-5b6e0cb288e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:05.369716 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:05.369682    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:05.370171 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:05.369700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:05.370171 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:05.369820    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:05.370171 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:05.369871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:05.370171 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:05.369949    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:05.370171 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:05.370068    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:07.369992 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:07.369951    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:07.370419 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:07.370091    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:07.370419 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:07.370317    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:07.370419 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:07.370346    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:07.370549 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:07.370429    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:07.370549 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:07.370473    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:07.925488 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:07.925445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:07.925651 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:07.925572    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:07.925718 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:07.925660    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs podName:d3082557-8a7a-424f-b6af-d746972e7352 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:15.925622441 +0000 UTC m=+19.570377743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs") pod "network-metrics-daemon-r7bpt" (UID: "d3082557-8a7a-424f-b6af-d746972e7352") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:08.026434 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:08.026393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:08.026597 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:08.026585    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:08.026659 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:08.026644    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret podName:b82e3dd9-8c44-49cc-861b-69e0b21d16ec nodeName:}" failed. No retries permitted until 2026-09-18 19:14:16.026625394 +0000 UTC m=+19.671380699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret") pod "global-pull-secret-syncer-p2742" (UID: "b82e3dd9-8c44-49cc-861b-69e0b21d16ec") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:08.128342 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:08.127663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtg64\" (UniqueName: \"kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64\") pod \"network-check-target-n9gqp\" (UID: \"7dee6d26-e153-4f04-84f1-5b6e0cb288e7\") " pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:08.128342 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:08.127888    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:14:08.128342 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:08.127913    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:14:08.128342 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:08.127926    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vtg64 for pod openshift-network-diagnostics/network-check-target-n9gqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:08.128342 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:08.128004    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64 podName:7dee6d26-e153-4f04-84f1-5b6e0cb288e7 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:16.127964931 +0000 UTC m=+19.772720243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtg64" (UniqueName: "kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64") pod "network-check-target-n9gqp" (UID: "7dee6d26-e153-4f04-84f1-5b6e0cb288e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:09.369899 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:09.369552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:09.369899 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:09.369572    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:09.369899 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:09.369577    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:09.369899 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:09.369696    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:09.369899 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:09.369857    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:09.370434 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:09.369959    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:11.370127 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:11.370095    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:11.370562 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:11.370095    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:11.370562 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:11.370212    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:11.370562 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:11.370225    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:11.370562 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:11.370357    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:11.370562 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:11.370447    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:13.369612 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:13.369574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:13.370140 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:13.369702    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:13.370140 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:13.369702    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:13.370140 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:13.369739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:13.370140 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:13.369842    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:13.370140 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:13.369936    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:15.370031 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:15.369908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:15.370603 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:15.370045    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:15.370603 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:15.370052    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:15.370603 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:15.370154    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:15.370603 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:15.370049    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:15.370603 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:15.370288    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:15.989103 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:15.989067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:15.989340 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:15.989203    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:15.989340 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:15.989277    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs podName:d3082557-8a7a-424f-b6af-d746972e7352 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:31.98925851 +0000 UTC m=+35.634013822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs") pod "network-metrics-daemon-r7bpt" (UID: "d3082557-8a7a-424f-b6af-d746972e7352") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:16.089832 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:16.089796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:16.089998 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:16.089946    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:16.090045 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:16.090036    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret podName:b82e3dd9-8c44-49cc-861b-69e0b21d16ec nodeName:}" failed. No retries permitted until 2026-09-18 19:14:32.090014927 +0000 UTC m=+35.734770240 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret") pod "global-pull-secret-syncer-p2742" (UID: "b82e3dd9-8c44-49cc-861b-69e0b21d16ec") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:16.190437 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:16.190407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtg64\" (UniqueName: \"kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64\") pod \"network-check-target-n9gqp\" (UID: \"7dee6d26-e153-4f04-84f1-5b6e0cb288e7\") " pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:16.190595 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:16.190568    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:14:16.190675 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:16.190605    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:14:16.190675 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:16.190619    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vtg64 for pod openshift-network-diagnostics/network-check-target-n9gqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:16.190753 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:16.190682    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64 podName:7dee6d26-e153-4f04-84f1-5b6e0cb288e7 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:32.190661988 +0000 UTC m=+35.835417311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtg64" (UniqueName: "kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64") pod "network-check-target-n9gqp" (UID: "7dee6d26-e153-4f04-84f1-5b6e0cb288e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:17.370059 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:17.370019    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:17.370468 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:17.370023    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:17.370468 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:17.370135    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:17.370468 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:17.370192    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:17.370468 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:17.370287    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:17.370468 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:17.370355    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:19.370068 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.370039    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:19.370068 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.370051    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:19.370068 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.370051    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:19.370586 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:19.370180    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:19.370586 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:19.370262    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:19.370586 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:19.370344    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:19.505364 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.505324    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cmpvg" event={"ID":"373c0994-3612-49aa-80f4-37ed02681856","Type":"ContainerStarted","Data":"91d9c9e2b4b90941cf3e17e3ebf677a1d64205f211655f77459c6d9b2bf973ab"}
Sep 18 19:14:19.507095 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.507070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw" event={"ID":"2bd6983a-dfa9-437e-b2ee-36d64d039b92","Type":"ContainerStarted","Data":"124cfb9c201dea21d65f7b059d1cbbc0324c88f898c569877919f813c37ec7d7"}
Sep 18 19:14:19.508824 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.508791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wfc56" event={"ID":"a07cc7e5-d5f1-44e3-affc-88808fec404e","Type":"ContainerStarted","Data":"14800faf41a577c226df773a4195758fddd0ab35df61608c5b73b1f0ac8e7a13"}
Sep 18 19:14:19.510601 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.510570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hg9dp" event={"ID":"d3fd8613-128f-437b-b356-c618813583d0","Type":"ContainerStarted","Data":"953d7ee57cb85f4904016c0be895548d5fb4a87f02a998058baf25d1e01bf210"}
Sep 18 19:14:19.513264 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.513240    2580 generic.go:356] "Generic (PLEG): container finished" podID="ddf53171-d25a-4e1b-8aa4-00e664f2f2d3" containerID="f8efed76201de1b40693ba7e5bdd89fb32dc95f154dcba9fedcc166092d5ce8a" exitCode=0
Sep 18 19:14:19.513354 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.513332    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52rk4" event={"ID":"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3","Type":"ContainerDied","Data":"f8efed76201de1b40693ba7e5bdd89fb32dc95f154dcba9fedcc166092d5ce8a"}
Sep 18 19:14:19.516810 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.516794    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:14:19.517678 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.517323    2580 generic.go:356] "Generic (PLEG): container finished" podID="65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe" containerID="3c9c0dcd0719ef6b11b74ec3aa1a23cb7085bc76e185db684dc9297ab818ffc0" exitCode=1
Sep 18 19:14:19.517678 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.517399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p" event={"ID":"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe","Type":"ContainerStarted","Data":"2c10a0876e8ef218417efce7292116080aece967861f23a820ac605eaf08d3ce"}
Sep 18 19:14:19.517678 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.517487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p" event={"ID":"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe","Type":"ContainerDied","Data":"3c9c0dcd0719ef6b11b74ec3aa1a23cb7085bc76e185db684dc9297ab818ffc0"}
Sep 18 19:14:19.517678 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.517542    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p" event={"ID":"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe","Type":"ContainerStarted","Data":"045a029e6ffbc069cd506ee2d3de3f068f9137edcd04adaebf63777b09089e80"}
Sep 18 19:14:19.519706 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.519679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mchl7" event={"ID":"7a6186c8-e5b6-4b5c-827f-0702f4786c68","Type":"ContainerStarted","Data":"4c53ed8b6e6924c7abad388ee47c8ad02be2ed1e4d7afa61a7e9f01621bb6ff2"}
Sep 18 19:14:19.521482 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.521460    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zxxfj" event={"ID":"ff04f9c0-a964-4381-b1be-7934d50433af","Type":"ContainerStarted","Data":"e1f57187baf85ac93f768d1cc786eb180cb5ac94128a051a29b8bc07ba564a78"}
Sep 18 19:14:19.523275 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.523231    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cmpvg" podStartSLOduration=4.066691321 podStartE2EDuration="21.5232189s" totalImagesPullingTime="17.456527579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:19.522855033 +0000 UTC m=+23.167610368" watchObservedRunningTime="2026-09-18 19:14:19.5232189 +0000 UTC m=+23.167974220"
Sep 18 19:14:19.584439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.584290    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zxxfj" podStartSLOduration=4.122435259 podStartE2EDuration="21.58427478s" totalImagesPullingTime="17.461839521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:19.58378195 +0000 UTC m=+23.228537295" watchObservedRunningTime="2026-09-18 19:14:19.58427478 +0000 UTC m=+23.229030099"
Sep 18 19:14:19.585071 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.585021    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wfc56" podStartSLOduration=4.217124368 podStartE2EDuration="21.584957311s" totalImagesPullingTime="17.367832943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:19.557342089 +0000 UTC m=+23.202097433" watchObservedRunningTime="2026-09-18 19:14:19.584957311 +0000 UTC m=+23.229712630"
Sep 18 19:14:19.649848 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.649804    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mchl7" podStartSLOduration=4.284839845 podStartE2EDuration="21.649784281s" totalImagesPullingTime="17.364944436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:19.606450276 +0000 UTC m=+23.251205606" watchObservedRunningTime="2026-09-18 19:14:19.649784281 +0000 UTC m=+23.294539602"
Sep 18 19:14:19.670833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:19.670799    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hg9dp" podStartSLOduration=3.815067722 podStartE2EDuration="21.670782275s" totalImagesPullingTime="17.855714553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:19.670242258 +0000 UTC m=+23.314997597" watchObservedRunningTime="2026-09-18 19:14:19.670782275 +0000 UTC m=+23.315537632"
Sep 18 19:14:20.384786 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:20.384749    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 19:14:20.526932 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:20.526861    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:14:20.527324 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:20.527291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p" event={"ID":"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe","Type":"ContainerStarted","Data":"2e3db0784e175b5ad48b847e55b4d7a54d87b260eba8f99b263f01782a601362"}
Sep 18 19:14:20.527443 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:20.527370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p" event={"ID":"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe","Type":"ContainerStarted","Data":"73efd8ae3531c2711993b8d540671e9dbc28919591d8f763b719cdb8a48e4269"}
Sep 18 19:14:20.527443 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:20.527420    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p" event={"ID":"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe","Type":"ContainerStarted","Data":"4fbd1cb5b5d88343de4b5f3909f606c4dfcee4d53ea2f3138130bbe1830244ce"}
Sep 18 19:14:20.529005 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:20.528960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vm9bk" event={"ID":"594ef2ba-5b57-424d-9eed-84f7341fb0ba","Type":"ContainerStarted","Data":"cbf6355914be4dbd8802c5f4016b3cd8ff118a357a301f2b038e88519f710e02"}
Sep 18 19:14:20.531281 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:20.531257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw" event={"ID":"2bd6983a-dfa9-437e-b2ee-36d64d039b92","Type":"ContainerStarted","Data":"1e5197787afc57abae2b39aa9290b466b556e19d7eb44eb4ef832c1bbaaa5847"}
Sep 18 19:14:21.329557 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:21.329466    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T19:14:20.384774071Z","UUID":"34b98143-dafd-42f7-bd6b-140367113b79","Handler":null,"Name":"","Endpoint":""}
Sep 18 19:14:21.331080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:21.331050    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 19:14:21.331080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:21.331083    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 19:14:21.369813 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:21.369784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:21.369950 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:21.369891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:21.369950 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:21.369916    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:21.369950 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:21.369904    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:21.370156 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:21.370019    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:21.370156 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:21.370099    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:22.539492 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:22.539305    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:14:22.539944 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:22.539863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p" event={"ID":"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe","Type":"ContainerStarted","Data":"a8b79812ca1f8074f77ec85533342c39ff96a812fa6c786cfe881994121b8d28"}
Sep 18 19:14:22.542331 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:22.542296    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw" event={"ID":"2bd6983a-dfa9-437e-b2ee-36d64d039b92","Type":"ContainerStarted","Data":"9ee50a5d8007c7edc899d45adbf1541421d5a0b5bc97727edc0a3ff1a49fe8e6"}
Sep 18 19:14:22.574267 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:22.574224    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vm9bk" podStartSLOduration=7.11157568 podStartE2EDuration="24.574210773s" totalImagesPullingTime="17.462635093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:20.568937983 +0000 UTC m=+24.213693303" watchObservedRunningTime="2026-09-18 19:14:22.574210773 +0000 UTC m=+26.218966093"
Sep 18 19:14:22.574494 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:22.574465    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59tcw" podStartSLOduration=5.001076176 podStartE2EDuration="24.574454628s" totalImagesPullingTime="19.573378452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:22.573947383 +0000 UTC m=+26.218702746" watchObservedRunningTime="2026-09-18 19:14:22.574454628 +0000 UTC m=+26.219209953"
Sep 18 19:14:23.281308 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:23.281276    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:23.281930 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:23.281904    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:23.369567 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:23.369538    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:23.369699 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:23.369581    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:23.369699 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:23.369549    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:23.369699 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:23.369649    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:23.369831 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:23.369702    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:23.369831 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:23.369784    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:23.544457 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:23.544379    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:23.545019 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:23.544829    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wfc56"
Sep 18 19:14:24.548569 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:24.548371    2580 generic.go:356] "Generic (PLEG): container finished" podID="ddf53171-d25a-4e1b-8aa4-00e664f2f2d3" containerID="8c39ce6727b3f6306f9e4cb2a0613aec7d8678492a846f54721c350172f7e271" exitCode=0
Sep 18 19:14:24.549198 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:24.548447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52rk4" event={"ID":"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3","Type":"ContainerDied","Data":"8c39ce6727b3f6306f9e4cb2a0613aec7d8678492a846f54721c350172f7e271"}
Sep 18 19:14:24.552333 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:24.552317    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:14:24.552690 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:24.552672    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p" event={"ID":"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe","Type":"ContainerStarted","Data":"8fa23549b490ae02f7744d17441f735f5b93149386ba25be02e2616831f84e8c"}
Sep 18 19:14:24.552890 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:24.552874    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:24.552948 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:24.552942    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:24.553104 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:24.553092    2580 scope.go:117] "RemoveContainer" containerID="3c9c0dcd0719ef6b11b74ec3aa1a23cb7085bc76e185db684dc9297ab818ffc0"
Sep 18 19:14:24.569654 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:24.569637    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:25.369629 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:25.369586    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:25.369806 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:25.369595    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:25.369806 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:25.369690    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:25.369933 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:25.369802    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:25.369933 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:25.369598    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:25.369933 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:25.369908    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:25.558354 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:25.558332    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:14:25.558789 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:25.558770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p" event={"ID":"65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe","Type":"ContainerStarted","Data":"98bbcca7610c9d63912d48f666100d7ecaa16be9d72f4babcfeec319b6523d01"}
Sep 18 19:14:25.559107 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:25.559024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:25.573850 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:25.573817    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:25.658415 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:25.658362    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p" podStartSLOduration=10.189180067 podStartE2EDuration="27.658341554s" totalImagesPullingTime="17.469161487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:25.609569339 +0000 UTC m=+29.254324671" watchObservedRunningTime="2026-09-18 19:14:25.658341554 +0000 UTC m=+29.303096874"
Sep 18 19:14:26.403043 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:26.403015    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9gqp"]
Sep 18 19:14:26.403178 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:26.403104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:26.403216 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:26.403184    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:26.405033 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:26.405014    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p2742"]
Sep 18 19:14:26.405147 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:26.405084    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:26.405199 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:26.405163    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:26.407832 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:26.407813    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r7bpt"]
Sep 18 19:14:26.407906 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:26.407877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:26.407958 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:26.407944    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:26.562744 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:26.562717    2580 generic.go:356] "Generic (PLEG): container finished" podID="ddf53171-d25a-4e1b-8aa4-00e664f2f2d3" containerID="e5435ab7101e016cedcee3715525711f6faf422d3b5a8a62a741acec1e8f2e0c" exitCode=0
Sep 18 19:14:26.563067 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:26.562800    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52rk4" event={"ID":"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3","Type":"ContainerDied","Data":"e5435ab7101e016cedcee3715525711f6faf422d3b5a8a62a741acec1e8f2e0c"}
Sep 18 19:14:28.370643 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:28.370615    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:28.370961 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:28.370691    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:28.370961 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:28.370801    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:28.370961 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:28.370920    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:28.370961 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:28.370931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:28.371111 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:28.371053    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:28.569556 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:28.569528    2580 generic.go:356] "Generic (PLEG): container finished" podID="ddf53171-d25a-4e1b-8aa4-00e664f2f2d3" containerID="ab554c261a8bb10f5659e712b2cbf3663b0c8456cd12d7dccc732d4f9a5f3636" exitCode=0
Sep 18 19:14:28.569680 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:28.569577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52rk4" event={"ID":"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3","Type":"ContainerDied","Data":"ab554c261a8bb10f5659e712b2cbf3663b0c8456cd12d7dccc732d4f9a5f3636"}
Sep 18 19:14:30.370383 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:30.370144    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:30.370796 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:30.370144    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:30.370796 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:30.370478    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:30.370796 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:30.370185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:30.371347 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:30.371323    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:30.371589 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:30.371562    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:32.007904 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.007873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:32.008446 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:32.007995    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:32.008446 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:32.008069    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs podName:d3082557-8a7a-424f-b6af-d746972e7352 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:04.008051486 +0000 UTC m=+67.652806785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs") pod "network-metrics-daemon-r7bpt" (UID: "d3082557-8a7a-424f-b6af-d746972e7352") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:14:32.108894 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.108861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:32.109070 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:32.109035    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:32.109134 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:32.109102    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret podName:b82e3dd9-8c44-49cc-861b-69e0b21d16ec nodeName:}" failed. No retries permitted until 2026-09-18 19:15:04.109082313 +0000 UTC m=+67.753837615 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret") pod "global-pull-secret-syncer-p2742" (UID: "b82e3dd9-8c44-49cc-861b-69e0b21d16ec") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:14:32.209885 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.209857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtg64\" (UniqueName: \"kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64\") pod \"network-check-target-n9gqp\" (UID: \"7dee6d26-e153-4f04-84f1-5b6e0cb288e7\") " pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:32.210062 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:32.210017    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:14:32.210062 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:32.210041    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:14:32.210062 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:32.210051    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vtg64 for pod openshift-network-diagnostics/network-check-target-n9gqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:32.210230 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:32.210105    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64 podName:7dee6d26-e153-4f04-84f1-5b6e0cb288e7 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:04.210087866 +0000 UTC m=+67.854843166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtg64" (UniqueName: "kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64") pod "network-check-target-n9gqp" (UID: "7dee6d26-e153-4f04-84f1-5b6e0cb288e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:14:32.370221 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.370188    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:32.370389 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.370188    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:32.370389 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:32.370320    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:14:32.370389 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.370330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:32.370522 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:32.370429    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9gqp" podUID="7dee6d26-e153-4f04-84f1-5b6e0cb288e7"
Sep 18 19:14:32.370522 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:32.370491    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p2742" podUID="b82e3dd9-8c44-49cc-861b-69e0b21d16ec"
Sep 18 19:14:32.780269 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.780243    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeReady"
Sep 18 19:14:32.780389 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.780331    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 19:14:32.873279 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.873257    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78886b55c6-pkb2r"]
Sep 18 19:14:32.893269 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.893242    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:32.900581 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.900560    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 19:14:32.904992 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.904950    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qbqcn\""
Sep 18 19:14:32.905694 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.905673    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 19:14:32.907961 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.907938    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 19:14:32.910055 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.910032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78886b55c6-pkb2r"]
Sep 18 19:14:32.922923 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.922901    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 19:14:32.928423 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.928402    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nf6c8"]
Sep 18 19:14:32.951778 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.951724    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rzqsw"]
Sep 18 19:14:32.951857 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.951727    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nf6c8"
Sep 18 19:14:32.958336 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.958316    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lcfbs\""
Sep 18 19:14:32.958434 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.958316    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 19:14:32.958434 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.958318    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 19:14:32.959012 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.958995    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 19:14:32.978709 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.978690    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nf6c8"]
Sep 18 19:14:32.978798 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.978764    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:32.998483 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.998464    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 19:14:32.998859 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.998840    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 19:14:32.998956 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.998888    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7n8q\""
Sep 18 19:14:32.999629 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:32.999613    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rzqsw"]
Sep 18 19:14:33.014252 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.014231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-installation-pull-secrets\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.014697 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.014258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-bound-sa-token\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.014697 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.014303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-image-registry-private-configuration\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.014697 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.014333    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-ca-trust-extracted\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.014697 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.014362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-certificates\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.014697 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.014375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-trusted-ca\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.014697 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.014391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbwtd\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-kube-api-access-pbwtd\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.014697 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.014440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.115230 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-image-registry-private-configuration\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.115294 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-ca-trust-extracted\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.115294 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/646e7537-ad0c-4b98-85a3-7da9f26d66e9-config-volume\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.115294 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-certificates\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.115414 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-trusted-ca\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.115448 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.115495 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbwtd\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-kube-api-access-pbwtd\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.115495 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/646e7537-ad0c-4b98-85a3-7da9f26d66e9-tmp-dir\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.115584 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115521    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63e24fba-9743-4bbf-9613-c0b0e126d7ba-cert\") pod \"ingress-canary-nf6c8\" (UID: \"63e24fba-9743-4bbf-9613-c0b0e126d7ba\") " pod="openshift-ingress-canary/ingress-canary-nf6c8"
Sep 18 19:14:33.115678 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx5gt\" (UniqueName: \"kubernetes.io/projected/63e24fba-9743-4bbf-9613-c0b0e126d7ba-kube-api-access-zx5gt\") pod \"ingress-canary-nf6c8\" (UID: \"63e24fba-9743-4bbf-9613-c0b0e126d7ba\") " pod="openshift-ingress-canary/ingress-canary-nf6c8"
Sep 18 19:14:33.115750 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-ca-trust-extracted\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.115750 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.115836 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:33.115796    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:14:33.115836 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:33.115812    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78886b55c6-pkb2r: secret "image-registry-tls" not found
Sep 18 19:14:33.115836 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-installation-pull-secrets\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.115987 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-bound-sa-token\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.115987 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.115882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fptc6\" (UniqueName: \"kubernetes.io/projected/646e7537-ad0c-4b98-85a3-7da9f26d66e9-kube-api-access-fptc6\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.116081 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:33.115995    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls podName:ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:33.615953223 +0000 UTC m=+37.260708529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls") pod "image-registry-78886b55c6-pkb2r" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4") : secret "image-registry-tls" not found
Sep 18 19:14:33.116081 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.116038    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-certificates\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.116319 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.116303    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-trusted-ca\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.119360 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.119341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-installation-pull-secrets\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.119448 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.119349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-image-registry-private-configuration\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.134672 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.134647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-bound-sa-token\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.135784 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.135765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbwtd\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-kube-api-access-pbwtd\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.217115 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.217073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/646e7537-ad0c-4b98-85a3-7da9f26d66e9-config-volume\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.217115 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.217100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.217236 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.217118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/646e7537-ad0c-4b98-85a3-7da9f26d66e9-tmp-dir\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.217236 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.217132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63e24fba-9743-4bbf-9613-c0b0e126d7ba-cert\") pod \"ingress-canary-nf6c8\" (UID: \"63e24fba-9743-4bbf-9613-c0b0e126d7ba\") " pod="openshift-ingress-canary/ingress-canary-nf6c8"
Sep 18 19:14:33.217236 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.217166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx5gt\" (UniqueName: \"kubernetes.io/projected/63e24fba-9743-4bbf-9613-c0b0e126d7ba-kube-api-access-zx5gt\") pod \"ingress-canary-nf6c8\" (UID: \"63e24fba-9743-4bbf-9613-c0b0e126d7ba\") " pod="openshift-ingress-canary/ingress-canary-nf6c8"
Sep 18 19:14:33.217236 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.217211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fptc6\" (UniqueName: \"kubernetes.io/projected/646e7537-ad0c-4b98-85a3-7da9f26d66e9-kube-api-access-fptc6\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.217461 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.217439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/646e7537-ad0c-4b98-85a3-7da9f26d66e9-tmp-dir\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.217501 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:33.217455    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:14:33.217540 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:33.217529    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls podName:646e7537-ad0c-4b98-85a3-7da9f26d66e9 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:33.717510761 +0000 UTC m=+37.362266059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls") pod "dns-default-rzqsw" (UID: "646e7537-ad0c-4b98-85a3-7da9f26d66e9") : secret "dns-default-metrics-tls" not found
Sep 18 19:14:33.217647 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.217630    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/646e7537-ad0c-4b98-85a3-7da9f26d66e9-config-volume\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.219117 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.219102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63e24fba-9743-4bbf-9613-c0b0e126d7ba-cert\") pod \"ingress-canary-nf6c8\" (UID: \"63e24fba-9743-4bbf-9613-c0b0e126d7ba\") " pod="openshift-ingress-canary/ingress-canary-nf6c8"
Sep 18 19:14:33.249087 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.249064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx5gt\" (UniqueName: \"kubernetes.io/projected/63e24fba-9743-4bbf-9613-c0b0e126d7ba-kube-api-access-zx5gt\") pod \"ingress-canary-nf6c8\" (UID: \"63e24fba-9743-4bbf-9613-c0b0e126d7ba\") " pod="openshift-ingress-canary/ingress-canary-nf6c8"
Sep 18 19:14:33.259911 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.259893    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nf6c8"
Sep 18 19:14:33.328027 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.327853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fptc6\" (UniqueName: \"kubernetes.io/projected/646e7537-ad0c-4b98-85a3-7da9f26d66e9-kube-api-access-fptc6\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.403279 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.403248    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wfc56_a07cc7e5-d5f1-44e3-affc-88808fec404e/konnectivity-agent/0.log" limit=1024
Sep 18 19:14:33.517695 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.517605    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wfc56_a07cc7e5-d5f1-44e3-affc-88808fec404e/konnectivity-agent/0.log" limit=1024
Sep 18 19:14:33.568604 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.568580    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nf6c8"]
Sep 18 19:14:33.572047 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:14:33.572019    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e24fba_9743_4bbf_9613_c0b0e126d7ba.slice/crio-45bf0fa36643a2522c42bc7575ba0e1c5854f90c815375d5b025edd0ffa25064 WatchSource:0}: Error finding container 45bf0fa36643a2522c42bc7575ba0e1c5854f90c815375d5b025edd0ffa25064: Status 404 returned error can't find the container with id 45bf0fa36643a2522c42bc7575ba0e1c5854f90c815375d5b025edd0ffa25064
Sep 18 19:14:33.582571 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.582542    2580 generic.go:356] "Generic (PLEG): container finished" podID="ddf53171-d25a-4e1b-8aa4-00e664f2f2d3" containerID="a5236607c9156d1be219e8b06f03137a9695c11fe9bb0b9b2fa928b504d598ca" exitCode=0
Sep 18 19:14:33.582681 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.582620    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52rk4" event={"ID":"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3","Type":"ContainerDied","Data":"a5236607c9156d1be219e8b06f03137a9695c11fe9bb0b9b2fa928b504d598ca"}
Sep 18 19:14:33.583809 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.583792    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nf6c8" event={"ID":"63e24fba-9743-4bbf-9613-c0b0e126d7ba","Type":"ContainerStarted","Data":"45bf0fa36643a2522c42bc7575ba0e1c5854f90c815375d5b025edd0ffa25064"}
Sep 18 19:14:33.620424 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.620392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:33.620542 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:33.620522    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:14:33.620600 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:33.620546    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78886b55c6-pkb2r: secret "image-registry-tls" not found
Sep 18 19:14:33.620660 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:33.620601    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls podName:ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:34.620584811 +0000 UTC m=+38.265340109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls") pod "image-registry-78886b55c6-pkb2r" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4") : secret "image-registry-tls" not found
Sep 18 19:14:33.721747 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:33.721718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:33.721894 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:33.721873    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:14:33.721950 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:33.721940    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls podName:646e7537-ad0c-4b98-85a3-7da9f26d66e9 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:34.721919594 +0000 UTC m=+38.366674907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls") pod "dns-default-rzqsw" (UID: "646e7537-ad0c-4b98-85a3-7da9f26d66e9") : secret "dns-default-metrics-tls" not found
Sep 18 19:14:34.370144 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.369715    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:14:34.370144 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.369719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:14:34.370144 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.369868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:14:34.381926 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.381908    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 19:14:34.383116 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.383095    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 19:14:34.383231 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.383141    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 19:14:34.383231 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.383193    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w2qlj\""
Sep 18 19:14:34.383231 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.383194    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5n7ds\""
Sep 18 19:14:34.383399 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.383241    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 19:14:34.589407 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.589371    2580 generic.go:356] "Generic (PLEG): container finished" podID="ddf53171-d25a-4e1b-8aa4-00e664f2f2d3" containerID="1c4159b4d0cc6dd821bcf60d87d8516ed2d02fb8c59968b6a48e64874e927449" exitCode=0
Sep 18 19:14:34.589558 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.589422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52rk4" event={"ID":"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3","Type":"ContainerDied","Data":"1c4159b4d0cc6dd821bcf60d87d8516ed2d02fb8c59968b6a48e64874e927449"}
Sep 18 19:14:34.629311 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.629252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:34.629421 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:34.629406    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:14:34.629460 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:34.629425    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78886b55c6-pkb2r: secret "image-registry-tls" not found
Sep 18 19:14:34.629499 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:34.629476    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls podName:ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:36.629458218 +0000 UTC m=+40.274213521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls") pod "image-registry-78886b55c6-pkb2r" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4") : secret "image-registry-tls" not found
Sep 18 19:14:34.730614 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:34.730591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:34.730756 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:34.730736    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:14:34.730813 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:34.730796    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls podName:646e7537-ad0c-4b98-85a3-7da9f26d66e9 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:36.730780421 +0000 UTC m=+40.375535718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls") pod "dns-default-rzqsw" (UID: "646e7537-ad0c-4b98-85a3-7da9f26d66e9") : secret "dns-default-metrics-tls" not found
Sep 18 19:14:35.596665 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:35.596628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52rk4" event={"ID":"ddf53171-d25a-4e1b-8aa4-00e664f2f2d3","Type":"ContainerStarted","Data":"4be82b789aa955684d41875f0b80aedf378ca8f5942db1dfb027c269620e134c"}
Sep 18 19:14:35.818420 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:35.818385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wfc56_a07cc7e5-d5f1-44e3-affc-88808fec404e/konnectivity-agent/0.log" limit=1024
Sep 18 19:14:35.936154 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:35.936120    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wfc56_a07cc7e5-d5f1-44e3-affc-88808fec404e/konnectivity-agent/0.log" limit=1024
Sep 18 19:14:36.600946 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:36.600910    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nf6c8" event={"ID":"63e24fba-9743-4bbf-9613-c0b0e126d7ba","Type":"ContainerStarted","Data":"ad0681dc0704b6c87dc332a7a4ca969601dae9a0ce0d8fa62ee32919f24d9f58"}
Sep 18 19:14:36.645006 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:36.644939    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-52rk4" podStartSLOduration=10.399580176 podStartE2EDuration="38.644924607s" totalImagesPullingTime="28.245344431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:35.637157526 +0000 UTC m=+39.281912865" watchObservedRunningTime="2026-09-18 19:14:36.644924607 +0000 UTC m=+40.289679967"
Sep 18 19:14:36.647787 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:36.647767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:36.647899 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:36.647882    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:14:36.647963 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:36.647904    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78886b55c6-pkb2r: secret "image-registry-tls" not found
Sep 18 19:14:36.648047 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:36.647964    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls podName:ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:40.647946556 +0000 UTC m=+44.292701870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls") pod "image-registry-78886b55c6-pkb2r" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4") : secret "image-registry-tls" not found
Sep 18 19:14:36.748886 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:36.748850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:36.749082 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:36.749059    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:14:36.749165 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:36.749151    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls podName:646e7537-ad0c-4b98-85a3-7da9f26d66e9 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:40.74912935 +0000 UTC m=+44.393884667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls") pod "dns-default-rzqsw" (UID: "646e7537-ad0c-4b98-85a3-7da9f26d66e9") : secret "dns-default-metrics-tls" not found
Sep 18 19:14:36.778728 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:36.778705    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wfc56_a07cc7e5-d5f1-44e3-affc-88808fec404e/konnectivity-agent/0.log" limit=1024
Sep 18 19:14:36.885478 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:36.885419    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wfc56_a07cc7e5-d5f1-44e3-affc-88808fec404e/konnectivity-agent/0.log" limit=1024
Sep 18 19:14:40.674990 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:40.674936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:40.675452 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:40.675088    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:14:40.675452 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:40.675104    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78886b55c6-pkb2r: secret "image-registry-tls" not found
Sep 18 19:14:40.675452 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:40.675164    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls podName:ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:48.675144463 +0000 UTC m=+52.319899793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls") pod "image-registry-78886b55c6-pkb2r" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4") : secret "image-registry-tls" not found
Sep 18 19:14:40.775484 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:40.775454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:40.775582 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:40.775572    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:14:40.775628 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:40.775618    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls podName:646e7537-ad0c-4b98-85a3-7da9f26d66e9 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:48.775607036 +0000 UTC m=+52.420362334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls") pod "dns-default-rzqsw" (UID: "646e7537-ad0c-4b98-85a3-7da9f26d66e9") : secret "dns-default-metrics-tls" not found
Sep 18 19:14:48.727742 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:48.727696    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:14:48.728215 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:48.727835    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:14:48.728215 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:48.727847    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78886b55c6-pkb2r: secret "image-registry-tls" not found
Sep 18 19:14:48.728215 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:48.727902    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls podName:ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:04.727885629 +0000 UTC m=+68.372640946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls") pod "image-registry-78886b55c6-pkb2r" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4") : secret "image-registry-tls" not found
Sep 18 19:14:48.828821 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:48.828788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:14:48.828948 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:48.828893    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:14:48.828948 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:14:48.828944    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls podName:646e7537-ad0c-4b98-85a3-7da9f26d66e9 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:04.828929354 +0000 UTC m=+68.473684653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls") pod "dns-default-rzqsw" (UID: "646e7537-ad0c-4b98-85a3-7da9f26d66e9") : secret "dns-default-metrics-tls" not found
Sep 18 19:14:57.577258 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:57.577223    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx96p"
Sep 18 19:14:57.623190 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:14:57.623144    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nf6c8" podStartSLOduration=23.388072862 podStartE2EDuration="25.623128355s" totalImagesPullingTime="2.235055493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:36.644564852 +0000 UTC m=+40.289320172" watchObservedRunningTime="2026-09-18 19:14:57.623128355 +0000 UTC m=+61.267883674"
Sep 18 19:15:04.027963 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.027921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:15:04.031770 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.031748    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 19:15:04.038652 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:04.038631    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 19:15:04.038703 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:04.038688    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs podName:d3082557-8a7a-424f-b6af-d746972e7352 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:08.038671673 +0000 UTC m=+131.683426971 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs") pod "network-metrics-daemon-r7bpt" (UID: "d3082557-8a7a-424f-b6af-d746972e7352") : secret "metrics-daemon-secret" not found
Sep 18 19:15:04.128417 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.128390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:15:04.131706 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.131688    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 19:15:04.143428 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.143400    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b82e3dd9-8c44-49cc-861b-69e0b21d16ec-original-pull-secret\") pod \"global-pull-secret-syncer-p2742\" (UID: \"b82e3dd9-8c44-49cc-861b-69e0b21d16ec\") " pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:15:04.228908 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.228881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtg64\" (UniqueName: \"kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64\") pod \"network-check-target-n9gqp\" (UID: \"7dee6d26-e153-4f04-84f1-5b6e0cb288e7\") " pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:15:04.232068 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.232050    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 19:15:04.246467 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.246446    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 19:15:04.252368 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.252348    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtg64\" (UniqueName: \"kubernetes.io/projected/7dee6d26-e153-4f04-84f1-5b6e0cb288e7-kube-api-access-vtg64\") pod \"network-check-target-n9gqp\" (UID: \"7dee6d26-e153-4f04-84f1-5b6e0cb288e7\") " pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:15:04.386080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.386059    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5n7ds\""
Sep 18 19:15:04.392981 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.392954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:15:04.395269 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.395250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p2742"
Sep 18 19:15:04.677135 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.677109    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p2742"]
Sep 18 19:15:04.677743 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.677722    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9gqp"]
Sep 18 19:15:04.678737 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:15:04.678715    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82e3dd9_8c44_49cc_861b_69e0b21d16ec.slice/crio-109ab1a151c024356f57b1a18cea6cbaff51516c21917529f9ec3b8690a9957f WatchSource:0}: Error finding container 109ab1a151c024356f57b1a18cea6cbaff51516c21917529f9ec3b8690a9957f: Status 404 returned error can't find the container with id 109ab1a151c024356f57b1a18cea6cbaff51516c21917529f9ec3b8690a9957f
Sep 18 19:15:04.679182 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:15:04.679098    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dee6d26_e153_4f04_84f1_5b6e0cb288e7.slice/crio-ad7a64562bbe3f306eaf76ea54057f7485518171693c0f35675c099e4a1ba7d2 WatchSource:0}: Error finding container ad7a64562bbe3f306eaf76ea54057f7485518171693c0f35675c099e4a1ba7d2: Status 404 returned error can't find the container with id ad7a64562bbe3f306eaf76ea54057f7485518171693c0f35675c099e4a1ba7d2
Sep 18 19:15:04.733538 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.733511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:15:04.733633 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:04.733622    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:15:04.733673 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:04.733635    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78886b55c6-pkb2r: secret "image-registry-tls" not found
Sep 18 19:15:04.733706 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:04.733674    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls podName:ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:36.733662242 +0000 UTC m=+100.378417554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls") pod "image-registry-78886b55c6-pkb2r" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4") : secret "image-registry-tls" not found
Sep 18 19:15:04.834167 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:04.834141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:15:04.834261 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:04.834249    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:15:04.834303 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:04.834298    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls podName:646e7537-ad0c-4b98-85a3-7da9f26d66e9 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:36.834282753 +0000 UTC m=+100.479038051 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls") pod "dns-default-rzqsw" (UID: "646e7537-ad0c-4b98-85a3-7da9f26d66e9") : secret "dns-default-metrics-tls" not found
Sep 18 19:15:05.672622 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:05.672573    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9gqp" event={"ID":"7dee6d26-e153-4f04-84f1-5b6e0cb288e7","Type":"ContainerStarted","Data":"ad7a64562bbe3f306eaf76ea54057f7485518171693c0f35675c099e4a1ba7d2"}
Sep 18 19:15:05.674073 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:05.674038    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p2742" event={"ID":"b82e3dd9-8c44-49cc-861b-69e0b21d16ec","Type":"ContainerStarted","Data":"109ab1a151c024356f57b1a18cea6cbaff51516c21917529f9ec3b8690a9957f"}
Sep 18 19:15:09.686947 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:09.686903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9gqp" event={"ID":"7dee6d26-e153-4f04-84f1-5b6e0cb288e7","Type":"ContainerStarted","Data":"fd0457a97c8a41c5919fe94750232ee13fadc58d86a6a842ea7580ddb9bd1c81"}
Sep 18 19:15:09.687433 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:09.687108    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:15:09.688605 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:09.688582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p2742" event={"ID":"b82e3dd9-8c44-49cc-861b-69e0b21d16ec","Type":"ContainerStarted","Data":"ad62f881d69cf0d5ec7587bd1c7ff8299838b94185a2fb28aa4979acb4f3392b"}
Sep 18 19:15:09.706899 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:09.706853    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n9gqp" podStartSLOduration=67.337725133 podStartE2EDuration="1m11.706839361s" totalImagesPullingTime="4.369114228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:09.706359014 +0000 UTC m=+73.351114334" watchObservedRunningTime="2026-09-18 19:15:09.706839361 +0000 UTC m=+73.351594730"
Sep 18 19:15:09.723086 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:09.723040    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p2742" podStartSLOduration=67.349450915 podStartE2EDuration="1m11.723023984s" totalImagesPullingTime="4.373573069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:09.722829476 +0000 UTC m=+73.367584795" watchObservedRunningTime="2026-09-18 19:15:09.723023984 +0000 UTC m=+73.367779305"
Sep 18 19:15:36.735552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:36.735510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:15:36.736044 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:36.735645    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:15:36.736044 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:36.735658    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78886b55c6-pkb2r: secret "image-registry-tls" not found
Sep 18 19:15:36.736044 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:36.735724    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls podName:ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:40.735702918 +0000 UTC m=+164.380458219 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls") pod "image-registry-78886b55c6-pkb2r" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4") : secret "image-registry-tls" not found
Sep 18 19:15:36.836218 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:36.836179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:15:36.836384 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:36.836300    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:15:36.836384 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:15:36.836363    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls podName:646e7537-ad0c-4b98-85a3-7da9f26d66e9 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:40.836349845 +0000 UTC m=+164.481105143 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls") pod "dns-default-rzqsw" (UID: "646e7537-ad0c-4b98-85a3-7da9f26d66e9") : secret "dns-default-metrics-tls" not found
Sep 18 19:15:40.692994 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:15:40.692947    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n9gqp"
Sep 18 19:16:08.045666 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:08.045615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:16:08.046225 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:08.045772    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 19:16:08.046225 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:08.045863    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs podName:d3082557-8a7a-424f-b6af-d746972e7352 nodeName:}" failed. No retries permitted until 2026-09-18 19:18:10.045844988 +0000 UTC m=+253.690600286 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs") pod "network-metrics-daemon-r7bpt" (UID: "d3082557-8a7a-424f-b6af-d746972e7352") : secret "metrics-daemon-secret" not found
Sep 18 19:16:09.912248 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.912210    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq"]
Sep 18 19:16:09.915129 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.915110    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq"
Sep 18 19:16:09.920831 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.920802    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 18 19:16:09.922312 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.922233    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 18 19:16:09.922638 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.922618    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-h9tbl\""
Sep 18 19:16:09.922724 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.922700    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 18 19:16:09.922764 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.922624    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 18 19:16:09.958814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.958789    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"]
Sep 18 19:16:09.961805 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.961784    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq"]
Sep 18 19:16:09.961940 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.961879    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"
Sep 18 19:16:09.978798 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.978760    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 18 19:16:09.979180 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.979149    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 18 19:16:09.979349 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.979329    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7wrjp\""
Sep 18 19:16:09.979650 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.979632    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:16:09.987712 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.987693    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 18 19:16:09.996098 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:09.996076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"]
Sep 18 19:16:10.056913 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.056890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpd98\" (UniqueName: \"kubernetes.io/projected/63716f9e-c352-4d9c-91a4-ede4d11977cc-kube-api-access-vpd98\") pod \"kube-storage-version-migrator-operator-55889f7b47-swxbm\" (UID: \"63716f9e-c352-4d9c-91a4-ede4d11977cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"
Sep 18 19:16:10.057042 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.056926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63716f9e-c352-4d9c-91a4-ede4d11977cc-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-swxbm\" (UID: \"63716f9e-c352-4d9c-91a4-ede4d11977cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"
Sep 18 19:16:10.057042 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.056957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63716f9e-c352-4d9c-91a4-ede4d11977cc-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-swxbm\" (UID: \"63716f9e-c352-4d9c-91a4-ede4d11977cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"
Sep 18 19:16:10.057141 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.057028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7gxb\" (UniqueName: \"kubernetes.io/projected/35927fca-b704-4a2e-ad17-9a20e3502bfb-kube-api-access-s7gxb\") pod \"managed-serviceaccount-addon-agent-55ff9f4d66-qktgq\" (UID: \"35927fca-b704-4a2e-ad17-9a20e3502bfb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq"
Sep 18 19:16:10.057141 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.057082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35927fca-b704-4a2e-ad17-9a20e3502bfb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55ff9f4d66-qktgq\" (UID: \"35927fca-b704-4a2e-ad17-9a20e3502bfb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq"
Sep 18 19:16:10.085382 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.085359    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"]
Sep 18 19:16:10.088099 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.088080    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"
Sep 18 19:16:10.111479 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.111454    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 18 19:16:10.111576 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.111457    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 18 19:16:10.111745 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.111729    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 18 19:16:10.111821 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.111729    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:16:10.111876 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.111735    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ncq4w\""
Sep 18 19:16:10.122719 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.122698    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-tb4hf"]
Sep 18 19:16:10.125360 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.125344    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"]
Sep 18 19:16:10.125450 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.125419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.133202 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.133183    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 18 19:16:10.133433 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.133412    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 18 19:16:10.133802 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.133789    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:16:10.135076 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.135061    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 18 19:16:10.140260 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.140245    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mcth7\""
Sep 18 19:16:10.157744 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.157721    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 18 19:16:10.157833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.157814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63716f9e-c352-4d9c-91a4-ede4d11977cc-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-swxbm\" (UID: \"63716f9e-c352-4d9c-91a4-ede4d11977cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"
Sep 18 19:16:10.157883 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.157855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll2hh\" (UniqueName: \"kubernetes.io/projected/dae1362a-c516-483d-90a8-eeae270de469-kube-api-access-ll2hh\") pod \"service-ca-operator-57cdc4b768-xsmpw\" (UID: \"dae1362a-c516-483d-90a8-eeae270de469\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"
Sep 18 19:16:10.157925 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.157885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7gxb\" (UniqueName: \"kubernetes.io/projected/35927fca-b704-4a2e-ad17-9a20e3502bfb-kube-api-access-s7gxb\") pod \"managed-serviceaccount-addon-agent-55ff9f4d66-qktgq\" (UID: \"35927fca-b704-4a2e-ad17-9a20e3502bfb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq"
Sep 18 19:16:10.157961 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.157925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35927fca-b704-4a2e-ad17-9a20e3502bfb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55ff9f4d66-qktgq\" (UID: \"35927fca-b704-4a2e-ad17-9a20e3502bfb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq"
Sep 18 19:16:10.158031 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.157989    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dae1362a-c516-483d-90a8-eeae270de469-serving-cert\") pod \"service-ca-operator-57cdc4b768-xsmpw\" (UID: \"dae1362a-c516-483d-90a8-eeae270de469\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"
Sep 18 19:16:10.158083 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.158057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpd98\" (UniqueName: \"kubernetes.io/projected/63716f9e-c352-4d9c-91a4-ede4d11977cc-kube-api-access-vpd98\") pod \"kube-storage-version-migrator-operator-55889f7b47-swxbm\" (UID: \"63716f9e-c352-4d9c-91a4-ede4d11977cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"
Sep 18 19:16:10.158136 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.158092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63716f9e-c352-4d9c-91a4-ede4d11977cc-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-swxbm\" (UID: \"63716f9e-c352-4d9c-91a4-ede4d11977cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"
Sep 18 19:16:10.158136 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.158123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dae1362a-c516-483d-90a8-eeae270de469-config\") pod \"service-ca-operator-57cdc4b768-xsmpw\" (UID: \"dae1362a-c516-483d-90a8-eeae270de469\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"
Sep 18 19:16:10.158388 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.158361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63716f9e-c352-4d9c-91a4-ede4d11977cc-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-swxbm\" (UID: \"63716f9e-c352-4d9c-91a4-ede4d11977cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"
Sep 18 19:16:10.160153 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.160134    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-tb4hf"]
Sep 18 19:16:10.160659 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.160629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63716f9e-c352-4d9c-91a4-ede4d11977cc-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-swxbm\" (UID: \"63716f9e-c352-4d9c-91a4-ede4d11977cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"
Sep 18 19:16:10.161071 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.161051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35927fca-b704-4a2e-ad17-9a20e3502bfb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55ff9f4d66-qktgq\" (UID: \"35927fca-b704-4a2e-ad17-9a20e3502bfb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq"
Sep 18 19:16:10.184183 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.184136    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7gxb\" (UniqueName: \"kubernetes.io/projected/35927fca-b704-4a2e-ad17-9a20e3502bfb-kube-api-access-s7gxb\") pod \"managed-serviceaccount-addon-agent-55ff9f4d66-qktgq\" (UID: \"35927fca-b704-4a2e-ad17-9a20e3502bfb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq"
Sep 18 19:16:10.185710 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.185691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpd98\" (UniqueName: \"kubernetes.io/projected/63716f9e-c352-4d9c-91a4-ede4d11977cc-kube-api-access-vpd98\") pod \"kube-storage-version-migrator-operator-55889f7b47-swxbm\" (UID: \"63716f9e-c352-4d9c-91a4-ede4d11977cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"
Sep 18 19:16:10.237127 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.237102    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq"
Sep 18 19:16:10.259243 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.259222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dae1362a-c516-483d-90a8-eeae270de469-serving-cert\") pod \"service-ca-operator-57cdc4b768-xsmpw\" (UID: \"dae1362a-c516-483d-90a8-eeae270de469\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"
Sep 18 19:16:10.259363 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.259269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppndb\" (UniqueName: \"kubernetes.io/projected/e8b7818b-cec4-4406-8a2a-e3c212cab8af-kube-api-access-ppndb\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.259363 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.259293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dae1362a-c516-483d-90a8-eeae270de469-config\") pod \"service-ca-operator-57cdc4b768-xsmpw\" (UID: \"dae1362a-c516-483d-90a8-eeae270de469\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"
Sep 18 19:16:10.259460 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.259410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8b7818b-cec4-4406-8a2a-e3c212cab8af-serving-cert\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.259460 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.259439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8b7818b-cec4-4406-8a2a-e3c212cab8af-trusted-ca\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.259565 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.259512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll2hh\" (UniqueName: \"kubernetes.io/projected/dae1362a-c516-483d-90a8-eeae270de469-kube-api-access-ll2hh\") pod \"service-ca-operator-57cdc4b768-xsmpw\" (UID: \"dae1362a-c516-483d-90a8-eeae270de469\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"
Sep 18 19:16:10.259649 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.259621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8b7818b-cec4-4406-8a2a-e3c212cab8af-config\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.259804 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.259785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dae1362a-c516-483d-90a8-eeae270de469-config\") pod \"service-ca-operator-57cdc4b768-xsmpw\" (UID: \"dae1362a-c516-483d-90a8-eeae270de469\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"
Sep 18 19:16:10.261406 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.261385    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dae1362a-c516-483d-90a8-eeae270de469-serving-cert\") pod \"service-ca-operator-57cdc4b768-xsmpw\" (UID: \"dae1362a-c516-483d-90a8-eeae270de469\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"
Sep 18 19:16:10.270451 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.270429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"
Sep 18 19:16:10.277179 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.277157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll2hh\" (UniqueName: \"kubernetes.io/projected/dae1362a-c516-483d-90a8-eeae270de469-kube-api-access-ll2hh\") pod \"service-ca-operator-57cdc4b768-xsmpw\" (UID: \"dae1362a-c516-483d-90a8-eeae270de469\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"
Sep 18 19:16:10.360477 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.360452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppndb\" (UniqueName: \"kubernetes.io/projected/e8b7818b-cec4-4406-8a2a-e3c212cab8af-kube-api-access-ppndb\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.360593 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.360486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8b7818b-cec4-4406-8a2a-e3c212cab8af-serving-cert\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.360593 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.360502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8b7818b-cec4-4406-8a2a-e3c212cab8af-trusted-ca\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.360698 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.360678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8b7818b-cec4-4406-8a2a-e3c212cab8af-config\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.361329 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.361307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8b7818b-cec4-4406-8a2a-e3c212cab8af-config\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.361593 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.361577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8b7818b-cec4-4406-8a2a-e3c212cab8af-trusted-ca\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.362573 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.362553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8b7818b-cec4-4406-8a2a-e3c212cab8af-serving-cert\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.378270 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.378249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppndb\" (UniqueName: \"kubernetes.io/projected/e8b7818b-cec4-4406-8a2a-e3c212cab8af-kube-api-access-ppndb\") pod \"console-operator-fd4bb46c-tb4hf\" (UID: \"e8b7818b-cec4-4406-8a2a-e3c212cab8af\") " pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.396201 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.396174    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"
Sep 18 19:16:10.433537 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.433505    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:10.514649 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.514623    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq"]
Sep 18 19:16:10.517744 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:16:10.517720    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35927fca_b704_4a2e_ad17_9a20e3502bfb.slice/crio-526d455abb9d45ea491a2c0c74a4a58e7f6f5a02ec021b6b1ac32937c1e741a0 WatchSource:0}: Error finding container 526d455abb9d45ea491a2c0c74a4a58e7f6f5a02ec021b6b1ac32937c1e741a0: Status 404 returned error can't find the container with id 526d455abb9d45ea491a2c0c74a4a58e7f6f5a02ec021b6b1ac32937c1e741a0
Sep 18 19:16:10.548330 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.548273    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm"]
Sep 18 19:16:10.549859 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:16:10.549835    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63716f9e_c352_4d9c_91a4_ede4d11977cc.slice/crio-087770d74d7d6d35ba287593339f03f227752963e4ae6d9af907be8a444df230 WatchSource:0}: Error finding container 087770d74d7d6d35ba287593339f03f227752963e4ae6d9af907be8a444df230: Status 404 returned error can't find the container with id 087770d74d7d6d35ba287593339f03f227752963e4ae6d9af907be8a444df230
Sep 18 19:16:10.669294 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.669274    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw"]
Sep 18 19:16:10.671534 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:16:10.671512    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae1362a_c516_483d_90a8_eeae270de469.slice/crio-602a7053bcb0306ff115201170f909ed45d951c9897a5983abd71ef8b8c07aa7 WatchSource:0}: Error finding container 602a7053bcb0306ff115201170f909ed45d951c9897a5983abd71ef8b8c07aa7: Status 404 returned error can't find the container with id 602a7053bcb0306ff115201170f909ed45d951c9897a5983abd71ef8b8c07aa7
Sep 18 19:16:10.711499 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.711446    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-tb4hf"]
Sep 18 19:16:10.714463 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:16:10.714443    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b7818b_cec4_4406_8a2a_e3c212cab8af.slice/crio-05dcc5ceca794140144ad584d9e9674e8ec02b2acd2a86dfb0b419829e615b5d WatchSource:0}: Error finding container 05dcc5ceca794140144ad584d9e9674e8ec02b2acd2a86dfb0b419829e615b5d: Status 404 returned error can't find the container with id 05dcc5ceca794140144ad584d9e9674e8ec02b2acd2a86dfb0b419829e615b5d
Sep 18 19:16:10.832529 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.832505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw" event={"ID":"dae1362a-c516-483d-90a8-eeae270de469","Type":"ContainerStarted","Data":"602a7053bcb0306ff115201170f909ed45d951c9897a5983abd71ef8b8c07aa7"}
Sep 18 19:16:10.833690 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.833666    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq" event={"ID":"35927fca-b704-4a2e-ad17-9a20e3502bfb","Type":"ContainerStarted","Data":"526d455abb9d45ea491a2c0c74a4a58e7f6f5a02ec021b6b1ac32937c1e741a0"}
Sep 18 19:16:10.834730 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.834710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf" event={"ID":"e8b7818b-cec4-4406-8a2a-e3c212cab8af","Type":"ContainerStarted","Data":"05dcc5ceca794140144ad584d9e9674e8ec02b2acd2a86dfb0b419829e615b5d"}
Sep 18 19:16:10.835717 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:10.835697    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm" event={"ID":"63716f9e-c352-4d9c-91a4-ede4d11977cc","Type":"ContainerStarted","Data":"087770d74d7d6d35ba287593339f03f227752963e4ae6d9af907be8a444df230"}
Sep 18 19:16:14.849484 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:14.849447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw" event={"ID":"dae1362a-c516-483d-90a8-eeae270de469","Type":"ContainerStarted","Data":"9e6b10c888a81d5861a5252cda79dd8cf570026c956f3aeb060f22ed6b7c0892"}
Sep 18 19:16:14.851869 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:14.851823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq" event={"ID":"35927fca-b704-4a2e-ad17-9a20e3502bfb","Type":"ContainerStarted","Data":"d6b5611108d00992092d502dc373cb346512594f9cc217996b78387a4e636334"}
Sep 18 19:16:14.853604 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:14.853582    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/0.log"
Sep 18 19:16:14.853809 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:14.853622    2580 generic.go:356] "Generic (PLEG): container finished" podID="e8b7818b-cec4-4406-8a2a-e3c212cab8af" containerID="60238ee6bccdccb5840773303679e96a92517c6926e8bb5af7794a93c589ac2c" exitCode=255
Sep 18 19:16:14.853809 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:14.853705    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf" event={"ID":"e8b7818b-cec4-4406-8a2a-e3c212cab8af","Type":"ContainerDied","Data":"60238ee6bccdccb5840773303679e96a92517c6926e8bb5af7794a93c589ac2c"}
Sep 18 19:16:14.853908 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:14.853850    2580 scope.go:117] "RemoveContainer" containerID="60238ee6bccdccb5840773303679e96a92517c6926e8bb5af7794a93c589ac2c"
Sep 18 19:16:14.855365 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:14.855325    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm" event={"ID":"63716f9e-c352-4d9c-91a4-ede4d11977cc","Type":"ContainerStarted","Data":"60583b86111e81f9dff57cab774a7ba907cc85427bc41b08f7aac07af2e0281c"}
Sep 18 19:16:14.891161 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:14.891113    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw" podStartSLOduration=1.885110435 podStartE2EDuration="5.891095957s" totalImagesPullingTime="4.005985522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:14.88054737 +0000 UTC m=+138.525302710" watchObservedRunningTime="2026-09-18 19:16:14.891095957 +0000 UTC m=+138.535851278"
Sep 18 19:16:14.964483 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:14.964434    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55ff9f4d66-qktgq" podStartSLOduration=1.8098537609999998 podStartE2EDuration="5.964413864s" totalImagesPullingTime="4.154560103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:14.963068588 +0000 UTC m=+138.607823913" watchObservedRunningTime="2026-09-18 19:16:14.964413864 +0000 UTC m=+138.609169185"
Sep 18 19:16:15.070346 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.070304    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm" podStartSLOduration=1.9486255350000001 podStartE2EDuration="6.070290055s" totalImagesPullingTime="4.12166452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:15.013314311 +0000 UTC m=+138.658069636" watchObservedRunningTime="2026-09-18 19:16:15.070290055 +0000 UTC m=+138.715045374"
Sep 18 19:16:15.464891 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.464862    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-shm2b"]
Sep 18 19:16:15.468037 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.468015    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.486483 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.486465    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 19:16:15.486568 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.486469    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 19:16:15.486762 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.486746    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 19:16:15.487739 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.487721    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-npv6k\""
Sep 18 19:16:15.487844 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.487732    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 19:16:15.501693 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.501674    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shm2b"]
Sep 18 19:16:15.607152 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.607127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbz7x\" (UniqueName: \"kubernetes.io/projected/b963ed37-bec8-4b85-a755-387803d45330-kube-api-access-nbz7x\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.607248 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.607156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.607248 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.607176    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b963ed37-bec8-4b85-a755-387803d45330-crio-socket\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.607361 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.607337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b963ed37-bec8-4b85-a755-387803d45330-data-volume\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.607406 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.607376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.708583 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.708563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbz7x\" (UniqueName: \"kubernetes.io/projected/b963ed37-bec8-4b85-a755-387803d45330-kube-api-access-nbz7x\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.708680 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.708592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.708680 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.708608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b963ed37-bec8-4b85-a755-387803d45330-crio-socket\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.708789 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.708677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b963ed37-bec8-4b85-a755-387803d45330-data-volume\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.708789 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.708716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b963ed37-bec8-4b85-a755-387803d45330-crio-socket\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.708789 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.708718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.708789 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:15.708766    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:15.708789 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:15.708774    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:16:15.709000 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:15.708833    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls podName:b963ed37-bec8-4b85-a755-387803d45330 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:16.208813534 +0000 UTC m=+139.853568848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shm2b" (UID: "b963ed37-bec8-4b85-a755-387803d45330") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:15.709000 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:15.708851    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm podName:b963ed37-bec8-4b85-a755-387803d45330 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:16.208841614 +0000 UTC m=+139.853596915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shm2b" (UID: "b963ed37-bec8-4b85-a755-387803d45330") : configmap "kube-rbac-proxy" not found
Sep 18 19:16:15.709090 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.709007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b963ed37-bec8-4b85-a755-387803d45330-data-volume\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.725818 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.725768    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbz7x\" (UniqueName: \"kubernetes.io/projected/b963ed37-bec8-4b85-a755-387803d45330-kube-api-access-nbz7x\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:15.864631 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.864608    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:16:15.865106 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.865088    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/0.log"
Sep 18 19:16:15.865160 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.865131    2580 generic.go:356] "Generic (PLEG): container finished" podID="e8b7818b-cec4-4406-8a2a-e3c212cab8af" containerID="876c18e6e889c816f874368edcd21c58c9de6561a34e5ad3718bc1dc7dbbdaa9" exitCode=255
Sep 18 19:16:15.865249 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.865227    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf" event={"ID":"e8b7818b-cec4-4406-8a2a-e3c212cab8af","Type":"ContainerDied","Data":"876c18e6e889c816f874368edcd21c58c9de6561a34e5ad3718bc1dc7dbbdaa9"}
Sep 18 19:16:15.865338 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.865324    2580 scope.go:117] "RemoveContainer" containerID="60238ee6bccdccb5840773303679e96a92517c6926e8bb5af7794a93c589ac2c"
Sep 18 19:16:15.865537 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:15.865509    2580 scope.go:117] "RemoveContainer" containerID="876c18e6e889c816f874368edcd21c58c9de6561a34e5ad3718bc1dc7dbbdaa9"
Sep 18 19:16:15.865689 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:15.865665    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-tb4hf_openshift-console-operator(e8b7818b-cec4-4406-8a2a-e3c212cab8af)\"" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf" podUID="e8b7818b-cec4-4406-8a2a-e3c212cab8af"
Sep 18 19:16:16.211695 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:16.211659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:16.211849 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:16.211721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:16.211849 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:16.211781    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:16.211849 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:16.211797    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:16:16.211943 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:16.211856    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm podName:b963ed37-bec8-4b85-a755-387803d45330 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:17.211841118 +0000 UTC m=+140.856596415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shm2b" (UID: "b963ed37-bec8-4b85-a755-387803d45330") : configmap "kube-rbac-proxy" not found
Sep 18 19:16:16.211943 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:16.211868    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls podName:b963ed37-bec8-4b85-a755-387803d45330 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:17.211861975 +0000 UTC m=+140.856617273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shm2b" (UID: "b963ed37-bec8-4b85-a755-387803d45330") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:16.869606 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:16.869578    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:16:16.869968 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:16.869903    2580 scope.go:117] "RemoveContainer" containerID="876c18e6e889c816f874368edcd21c58c9de6561a34e5ad3718bc1dc7dbbdaa9"
Sep 18 19:16:16.870105 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:16.870082    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-tb4hf_openshift-console-operator(e8b7818b-cec4-4406-8a2a-e3c212cab8af)\"" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf" podUID="e8b7818b-cec4-4406-8a2a-e3c212cab8af"
Sep 18 19:16:17.219395 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.219313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:17.219395 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.219374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:17.219617 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:17.219439    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:16:17.219617 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:17.219477    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:17.219617 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:17.219489    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm podName:b963ed37-bec8-4b85-a755-387803d45330 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:19.219475236 +0000 UTC m=+142.864230535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shm2b" (UID: "b963ed37-bec8-4b85-a755-387803d45330") : configmap "kube-rbac-proxy" not found
Sep 18 19:16:17.219617 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:17.219560    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls podName:b963ed37-bec8-4b85-a755-387803d45330 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:19.219541694 +0000 UTC m=+142.864296996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shm2b" (UID: "b963ed37-bec8-4b85-a755-387803d45330") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:17.286073 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.286049    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cmpvg_373c0994-3612-49aa-80f4-37ed02681856/dns-node-resolver/0.log"
Sep 18 19:16:17.357533 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.357506    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm"]
Sep 18 19:16:17.361607 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.361591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm"
Sep 18 19:16:17.367723 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.367702    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 18 19:16:17.370351 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.370331    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-728cd\""
Sep 18 19:16:17.370785 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.370768    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 18 19:16:17.380549 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.380530    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm"]
Sep 18 19:16:17.521786 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.521736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c58c4\" (UniqueName: \"kubernetes.io/projected/a7a2bad5-8cc6-46d0-a7d8-227bd9607cd8-kube-api-access-c58c4\") pod \"migrator-76794cbd6c-qj4tm\" (UID: \"a7a2bad5-8cc6-46d0-a7d8-227bd9607cd8\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm"
Sep 18 19:16:17.622433 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.622406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c58c4\" (UniqueName: \"kubernetes.io/projected/a7a2bad5-8cc6-46d0-a7d8-227bd9607cd8-kube-api-access-c58c4\") pod \"migrator-76794cbd6c-qj4tm\" (UID: \"a7a2bad5-8cc6-46d0-a7d8-227bd9607cd8\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm"
Sep 18 19:16:17.644796 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.644772    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c58c4\" (UniqueName: \"kubernetes.io/projected/a7a2bad5-8cc6-46d0-a7d8-227bd9607cd8-kube-api-access-c58c4\") pod \"migrator-76794cbd6c-qj4tm\" (UID: \"a7a2bad5-8cc6-46d0-a7d8-227bd9607cd8\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm"
Sep 18 19:16:17.670657 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.670630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm"
Sep 18 19:16:17.967967 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:17.967942    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm"]
Sep 18 19:16:17.970696 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:16:17.970670    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a2bad5_8cc6_46d0_a7d8_227bd9607cd8.slice/crio-4ca80e19f2d57de07a2716fb9bb12320ba23313b1293ea01801d97fd1e565232 WatchSource:0}: Error finding container 4ca80e19f2d57de07a2716fb9bb12320ba23313b1293ea01801d97fd1e565232: Status 404 returned error can't find the container with id 4ca80e19f2d57de07a2716fb9bb12320ba23313b1293ea01801d97fd1e565232
Sep 18 19:16:18.447465 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:18.447441    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mchl7_7a6186c8-e5b6-4b5c-827f-0702f4786c68/node-ca/0.log"
Sep 18 19:16:18.876842 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:18.876806    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm" event={"ID":"a7a2bad5-8cc6-46d0-a7d8-227bd9607cd8","Type":"ContainerStarted","Data":"4ca80e19f2d57de07a2716fb9bb12320ba23313b1293ea01801d97fd1e565232"}
Sep 18 19:16:19.048718 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:19.048694    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nf6c8_63e24fba-9743-4bbf-9613-c0b0e126d7ba/serve-healthcheck-canary/0.log"
Sep 18 19:16:19.246403 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:19.246353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:19.246484 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:19.246410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:19.246520 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:19.246489    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:16:19.246520 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:19.246499    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:19.246581 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:19.246540    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm podName:b963ed37-bec8-4b85-a755-387803d45330 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:23.246527896 +0000 UTC m=+146.891283194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shm2b" (UID: "b963ed37-bec8-4b85-a755-387803d45330") : configmap "kube-rbac-proxy" not found
Sep 18 19:16:19.246581 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:19.246552    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls podName:b963ed37-bec8-4b85-a755-387803d45330 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:23.246546399 +0000 UTC m=+146.891301696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shm2b" (UID: "b963ed37-bec8-4b85-a755-387803d45330") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:19.882584 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:19.882546    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm" event={"ID":"a7a2bad5-8cc6-46d0-a7d8-227bd9607cd8","Type":"ContainerStarted","Data":"6f7d9cbbcef89ccf9e804a5469d3e97a0f25791b1161e9adcd1756bbc66cd046"}
Sep 18 19:16:19.882722 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:19.882624    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm" event={"ID":"a7a2bad5-8cc6-46d0-a7d8-227bd9607cd8","Type":"ContainerStarted","Data":"1f6585fe7aee146a898e8d3ff89cf0a03eb4918ed61bee31710ca9549d38587e"}
Sep 18 19:16:20.434438 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:20.434413    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:20.434755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:20.434460    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:20.434755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:20.434733    2580 scope.go:117] "RemoveContainer" containerID="876c18e6e889c816f874368edcd21c58c9de6561a34e5ad3718bc1dc7dbbdaa9"
Sep 18 19:16:20.434874 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:20.434855    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-tb4hf_openshift-console-operator(e8b7818b-cec4-4406-8a2a-e3c212cab8af)\"" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf" podUID="e8b7818b-cec4-4406-8a2a-e3c212cab8af"
Sep 18 19:16:23.274779 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:23.274738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:23.275228 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:23.274810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:23.275228 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:23.274860    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:16:23.275228 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:23.274907    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:23.275228 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:23.274926    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm podName:b963ed37-bec8-4b85-a755-387803d45330 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:31.274908338 +0000 UTC m=+154.919663653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shm2b" (UID: "b963ed37-bec8-4b85-a755-387803d45330") : configmap "kube-rbac-proxy" not found
Sep 18 19:16:23.275228 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:23.274988    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls podName:b963ed37-bec8-4b85-a755-387803d45330 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:31.274953814 +0000 UTC m=+154.919709117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shm2b" (UID: "b963ed37-bec8-4b85-a755-387803d45330") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:31.334190 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:31.334149    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:31.334640 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:31.334210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:31.334640 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:31.334370    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:31.334640 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:31.334433    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls podName:b963ed37-bec8-4b85-a755-387803d45330 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:47.334415095 +0000 UTC m=+170.979170414 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shm2b" (UID: "b963ed37-bec8-4b85-a755-387803d45330") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:16:31.334781 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:31.334739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b963ed37-bec8-4b85-a755-387803d45330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:31.370261 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:31.370235    2580 scope.go:117] "RemoveContainer" containerID="876c18e6e889c816f874368edcd21c58c9de6561a34e5ad3718bc1dc7dbbdaa9"
Sep 18 19:16:31.923593 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:31.923565    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:16:31.923757 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:31.923621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf" event={"ID":"e8b7818b-cec4-4406-8a2a-e3c212cab8af","Type":"ContainerStarted","Data":"c11518c4645968bd743991a30b0216319c5e7cabe19b8f89036bf91596ae8df7"}
Sep 18 19:16:31.924052 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:31.924028    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:31.945048 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:31.945006    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qj4tm" podStartSLOduration=13.909904109 podStartE2EDuration="14.944989456s" totalImagesPullingTime="1.035085347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:19.928162869 +0000 UTC m=+143.572918189" watchObservedRunningTime="2026-09-18 19:16:31.944989456 +0000 UTC m=+155.589744767"
Sep 18 19:16:31.945491 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:31.945467    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf" podStartSLOduration=18.985880334 podStartE2EDuration="22.945460678s" totalImagesPullingTime="3.959580344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:31.943505795 +0000 UTC m=+155.588261133" watchObservedRunningTime="2026-09-18 19:16:31.945460678 +0000 UTC m=+155.590215997"
Sep 18 19:16:31.957160 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:31.957131    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-tb4hf"
Sep 18 19:16:35.903894 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:35.903853    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r" podUID="ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4"
Sep 18 19:16:35.937642 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:35.937611    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:16:35.989399 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:35.989338    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rzqsw" podUID="646e7537-ad0c-4b98-85a3-7da9f26d66e9"
Sep 18 19:16:36.941049 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:36.941017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:16:37.319201 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.319135    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-ldgqv"]
Sep 18 19:16:37.322058 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.322039    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-ldgqv"
Sep 18 19:16:37.325325 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.325306    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 19:16:37.325488 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.325469    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9xn8v\""
Sep 18 19:16:37.325548 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.325472    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 19:16:37.334620 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.334597    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-ldgqv"]
Sep 18 19:16:37.377513 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.377491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nsrh\" (UniqueName: \"kubernetes.io/projected/7948f1f6-7263-4173-bc81-16ce21ae65ed-kube-api-access-6nsrh\") pod \"downloads-6594f4c75-ldgqv\" (UID: \"7948f1f6-7263-4173-bc81-16ce21ae65ed\") " pod="openshift-console/downloads-6594f4c75-ldgqv"
Sep 18 19:16:37.388606 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:16:37.388583    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-r7bpt" podUID="d3082557-8a7a-424f-b6af-d746972e7352"
Sep 18 19:16:37.478328 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.478305    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nsrh\" (UniqueName: \"kubernetes.io/projected/7948f1f6-7263-4173-bc81-16ce21ae65ed-kube-api-access-6nsrh\") pod \"downloads-6594f4c75-ldgqv\" (UID: \"7948f1f6-7263-4173-bc81-16ce21ae65ed\") " pod="openshift-console/downloads-6594f4c75-ldgqv"
Sep 18 19:16:37.495645 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.495620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nsrh\" (UniqueName: \"kubernetes.io/projected/7948f1f6-7263-4173-bc81-16ce21ae65ed-kube-api-access-6nsrh\") pod \"downloads-6594f4c75-ldgqv\" (UID: \"7948f1f6-7263-4173-bc81-16ce21ae65ed\") " pod="openshift-console/downloads-6594f4c75-ldgqv"
Sep 18 19:16:37.631496 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.631460    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-ldgqv"
Sep 18 19:16:37.921631 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.921565    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-ldgqv"]
Sep 18 19:16:37.924277 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:16:37.924253    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7948f1f6_7263_4173_bc81_16ce21ae65ed.slice/crio-15d1f041911ce186dc3ee83f7941c70dd7d3253f8fa2c49c4335d3b4a528748c WatchSource:0}: Error finding container 15d1f041911ce186dc3ee83f7941c70dd7d3253f8fa2c49c4335d3b4a528748c: Status 404 returned error can't find the container with id 15d1f041911ce186dc3ee83f7941c70dd7d3253f8fa2c49c4335d3b4a528748c
Sep 18 19:16:37.945176 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:37.945153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-ldgqv" event={"ID":"7948f1f6-7263-4173-bc81-16ce21ae65ed","Type":"ContainerStarted","Data":"15d1f041911ce186dc3ee83f7941c70dd7d3253f8fa2c49c4335d3b4a528748c"}
Sep 18 19:16:40.801701 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:40.801599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:16:40.804661 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:40.804634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"image-registry-78886b55c6-pkb2r\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") " pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:16:40.902378 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:40.902345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:16:40.904945 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:40.904920    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646e7537-ad0c-4b98-85a3-7da9f26d66e9-metrics-tls\") pod \"dns-default-rzqsw\" (UID: \"646e7537-ad0c-4b98-85a3-7da9f26d66e9\") " pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:16:41.042105 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:41.042078    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qbqcn\""
Sep 18 19:16:41.049695 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:41.049670    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:16:41.145535 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:41.145507    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7n8q\""
Sep 18 19:16:41.152470 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:41.152448    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:16:41.336400 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:41.336368    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78886b55c6-pkb2r"]
Sep 18 19:16:41.341597 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:16:41.341567    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3e13de_49a5_4ba9_8b06_4e7ea48b6fe4.slice/crio-35b585ac6b7c32de43015ba55c1e5ab01e5e7b6d4e32cb664f3d6fc6ee5b92e5 WatchSource:0}: Error finding container 35b585ac6b7c32de43015ba55c1e5ab01e5e7b6d4e32cb664f3d6fc6ee5b92e5: Status 404 returned error can't find the container with id 35b585ac6b7c32de43015ba55c1e5ab01e5e7b6d4e32cb664f3d6fc6ee5b92e5
Sep 18 19:16:41.435431 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:41.435402    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rzqsw"]
Sep 18 19:16:41.439287 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:16:41.439263    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646e7537_ad0c_4b98_85a3_7da9f26d66e9.slice/crio-5080c59114d6e96258c13928b9a9ed48fb908022a364eaae05b477b78c3d48cb WatchSource:0}: Error finding container 5080c59114d6e96258c13928b9a9ed48fb908022a364eaae05b477b78c3d48cb: Status 404 returned error can't find the container with id 5080c59114d6e96258c13928b9a9ed48fb908022a364eaae05b477b78c3d48cb
Sep 18 19:16:41.963505 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:41.963459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzqsw" event={"ID":"646e7537-ad0c-4b98-85a3-7da9f26d66e9","Type":"ContainerStarted","Data":"5080c59114d6e96258c13928b9a9ed48fb908022a364eaae05b477b78c3d48cb"}
Sep 18 19:16:41.965653 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:41.965618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r" event={"ID":"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4","Type":"ContainerStarted","Data":"825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e"}
Sep 18 19:16:41.965792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:41.965667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r" event={"ID":"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4","Type":"ContainerStarted","Data":"35b585ac6b7c32de43015ba55c1e5ab01e5e7b6d4e32cb664f3d6fc6ee5b92e5"}
Sep 18 19:16:41.965919 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:41.965894    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:16:41.998939 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:41.998889    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r" podStartSLOduration=163.998869223 podStartE2EDuration="2m43.998869223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:41.99633763 +0000 UTC m=+165.641092974" watchObservedRunningTime="2026-09-18 19:16:41.998869223 +0000 UTC m=+165.643624547"
Sep 18 19:16:43.974857 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:43.974815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzqsw" event={"ID":"646e7537-ad0c-4b98-85a3-7da9f26d66e9","Type":"ContainerStarted","Data":"72d59a1ec91ed5e609d0aa53a20d083e79995dcdd00154e653bfe4ca15c1bbf4"}
Sep 18 19:16:43.975285 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:43.974876    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzqsw" event={"ID":"646e7537-ad0c-4b98-85a3-7da9f26d66e9","Type":"ContainerStarted","Data":"91df60fe6124eaed8517c2b27162865030737dab4c7273b30fbf5cbfeb7dde92"}
Sep 18 19:16:43.975285 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:43.974927    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:16:44.005151 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:44.005103    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rzqsw" podStartSLOduration=129.992638587 podStartE2EDuration="2m12.005086835s" totalImagesPullingTime="2.012448248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:44.004142861 +0000 UTC m=+167.648898208" watchObservedRunningTime="2026-09-18 19:16:44.005086835 +0000 UTC m=+167.649842154"
Sep 18 19:16:47.355693 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:47.355656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:47.358352 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:47.358320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b963ed37-bec8-4b85-a755-387803d45330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shm2b\" (UID: \"b963ed37-bec8-4b85-a755-387803d45330\") " pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:47.576193 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:47.576162    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shm2b"
Sep 18 19:16:47.938421 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:47.938355    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shm2b"]
Sep 18 19:16:49.558801 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.558770    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c5f59b9c4-5wdzb"]
Sep 18 19:16:49.588636 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.588612    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5f59b9c4-5wdzb"]
Sep 18 19:16:49.588775 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.588722    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.594269 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.594250    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 19:16:49.594526 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.594505    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 19:16:49.594598 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.594548    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 19:16:49.594802 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.594785    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 19:16:49.595611 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.595455    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 19:16:49.599834 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.599661    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jjztf\""
Sep 18 19:16:49.602319 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.602302    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 19:16:49.671900 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.671859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-trusted-ca-bundle\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.672050 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.671936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-oauth-serving-cert\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.672050 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.672009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-serving-cert\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.672050 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.672028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-console-config\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.672050 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.672049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sg5t\" (UniqueName: \"kubernetes.io/projected/648f0876-4e7c-4abd-bc76-783f55b676c7-kube-api-access-9sg5t\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.672224 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.672076    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-oauth-config\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.672224 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.672112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-service-ca\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.773269 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.773231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-oauth-serving-cert\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.773408 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.773281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-serving-cert\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.773408 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.773308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-console-config\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.773408 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.773337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sg5t\" (UniqueName: \"kubernetes.io/projected/648f0876-4e7c-4abd-bc76-783f55b676c7-kube-api-access-9sg5t\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.773408 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.773369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-oauth-config\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.773408 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.773396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-service-ca\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.773660 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.773439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-trusted-ca-bundle\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.774131 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.774105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-oauth-serving-cert\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.774352 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.774329    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-service-ca\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.774402 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.774338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-trusted-ca-bundle\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.774402 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.774371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-console-config\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.776184 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.776164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-serving-cert\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.776491 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.776467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-oauth-config\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.802840 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.802811    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sg5t\" (UniqueName: \"kubernetes.io/projected/648f0876-4e7c-4abd-bc76-783f55b676c7-kube-api-access-9sg5t\") pod \"console-7c5f59b9c4-5wdzb\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") " pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:49.899814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:49.899785    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:16:52.369664 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:52.369625    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:16:53.981066 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:53.981038    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rzqsw"
Sep 18 19:16:54.776397 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:16:54.776355    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb963ed37_bec8_4b85_a755_387803d45330.slice/crio-65a689f5d6b04993d5b2254f85faa3947d7a8a68c2a912da6cc2aac32b4be42b WatchSource:0}: Error finding container 65a689f5d6b04993d5b2254f85faa3947d7a8a68c2a912da6cc2aac32b4be42b: Status 404 returned error can't find the container with id 65a689f5d6b04993d5b2254f85faa3947d7a8a68c2a912da6cc2aac32b4be42b
Sep 18 19:16:55.015297 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.015267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shm2b" event={"ID":"b963ed37-bec8-4b85-a755-387803d45330","Type":"ContainerStarted","Data":"0826dd4d0a885e983cd116fbed9aed1cca5794841959517e7f8824e30675cb3e"}
Sep 18 19:16:55.015654 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.015326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shm2b" event={"ID":"b963ed37-bec8-4b85-a755-387803d45330","Type":"ContainerStarted","Data":"65a689f5d6b04993d5b2254f85faa3947d7a8a68c2a912da6cc2aac32b4be42b"}
Sep 18 19:16:55.016824 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.016801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-ldgqv" event={"ID":"7948f1f6-7263-4173-bc81-16ce21ae65ed","Type":"ContainerStarted","Data":"bf5c61f6b7e2da21d72d38b452143c3d042b8b4e69e7f515e3ac2a01ce8ec5d7"}
Sep 18 19:16:55.017019 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.017003    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-ldgqv"
Sep 18 19:16:55.018271 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.018242    2580 patch_prober.go:28] interesting pod/downloads-6594f4c75-ldgqv container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.15:8080/\": dial tcp 10.132.0.15:8080: connect: connection refused" start-of-body=
Sep 18 19:16:55.018352 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.018296    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6594f4c75-ldgqv" podUID="7948f1f6-7263-4173-bc81-16ce21ae65ed" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.15:8080/\": dial tcp 10.132.0.15:8080: connect: connection refused"
Sep 18 19:16:55.055253 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.051654    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-ldgqv" podStartSLOduration=1.096692888 podStartE2EDuration="18.051635658s" totalImagesPullingTime="16.95494277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:55.045626924 +0000 UTC m=+178.690382244" watchObservedRunningTime="2026-09-18 19:16:55.051635658 +0000 UTC m=+178.696390979"
Sep 18 19:16:55.055253 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.052878    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5f59b9c4-5wdzb"]
Sep 18 19:16:55.058619 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:16:55.058592    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648f0876_4e7c_4abd_bc76_783f55b676c7.slice/crio-1e4b2246fcaeddff9af312d924f1a227ddb318605c6620d0707fe4bb0dc59961 WatchSource:0}: Error finding container 1e4b2246fcaeddff9af312d924f1a227ddb318605c6620d0707fe4bb0dc59961: Status 404 returned error can't find the container with id 1e4b2246fcaeddff9af312d924f1a227ddb318605c6620d0707fe4bb0dc59961
Sep 18 19:16:55.617001 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.616719    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"]
Sep 18 19:16:55.621715 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.620717    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.632457 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.632411    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 18 19:16:55.635650 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.635398    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 19:16:55.637146 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.636184    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 19:16:55.637146 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.636400    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 18 19:16:55.637146 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.636654    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 19:16:55.637146 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.636966    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 18 19:16:55.639909 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.639629    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-md6h9\""
Sep 18 19:16:55.648193 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.646769    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dpzts"]
Sep 18 19:16:55.652223 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.651133    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"]
Sep 18 19:16:55.652223 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.651266    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.657341 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.657298    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 19:16:55.657565 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.657548    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 19:16:55.657663 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.657636    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 19:16:55.661494 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.661319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nzvgt\""
Sep 18 19:16:55.721037 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.720947    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/60f01d14-922a-4b69-a575-74908eaca8f4-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.721037 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.721261 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f01d14-922a-4b69-a575-74908eaca8f4-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.721261 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb0302d-70f3-4e02-bd86-1969585c4954-sys\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.721261 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721114    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/60f01d14-922a-4b69-a575-74908eaca8f4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.721261 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-textfile\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.721261 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721160    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsksv\" (UniqueName: \"kubernetes.io/projected/cfb0302d-70f3-4e02-bd86-1969585c4954-kube-api-access-gsksv\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.721261 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60f01d14-922a-4b69-a575-74908eaca8f4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.721261 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721252    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.721604 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60f01d14-922a-4b69-a575-74908eaca8f4-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.721604 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cfb0302d-70f3-4e02-bd86-1969585c4954-root\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.721604 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-tls\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.721604 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb0302d-70f3-4e02-bd86-1969585c4954-metrics-client-ca\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.721604 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721456    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh669\" (UniqueName: \"kubernetes.io/projected/60f01d14-922a-4b69-a575-74908eaca8f4-kube-api-access-gh669\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.721604 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.721486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-wtmp\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60f01d14-922a-4b69-a575-74908eaca8f4-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cfb0302d-70f3-4e02-bd86-1969585c4954-root\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-tls\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb0302d-70f3-4e02-bd86-1969585c4954-metrics-client-ca\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh669\" (UniqueName: \"kubernetes.io/projected/60f01d14-922a-4b69-a575-74908eaca8f4-kube-api-access-gh669\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-wtmp\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823662    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/60f01d14-922a-4b69-a575-74908eaca8f4-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f01d14-922a-4b69-a575-74908eaca8f4-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb0302d-70f3-4e02-bd86-1969585c4954-sys\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823801    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/60f01d14-922a-4b69-a575-74908eaca8f4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-textfile\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsksv\" (UniqueName: \"kubernetes.io/projected/cfb0302d-70f3-4e02-bd86-1969585c4954-kube-api-access-gsksv\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823879    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60f01d14-922a-4b69-a575-74908eaca8f4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.824439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.823910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.826868 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.826279    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/60f01d14-922a-4b69-a575-74908eaca8f4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.826868 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.826456    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60f01d14-922a-4b69-a575-74908eaca8f4-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.826868 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.826520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cfb0302d-70f3-4e02-bd86-1969585c4954-root\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.826868 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.826795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.827852 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.827017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb0302d-70f3-4e02-bd86-1969585c4954-sys\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.827852 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.827403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/60f01d14-922a-4b69-a575-74908eaca8f4-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.827852 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.827512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-textfile\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.827852 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.827660    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-wtmp\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.827852 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.827848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb0302d-70f3-4e02-bd86-1969585c4954-metrics-client-ca\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.833489 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.833445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-tls\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.833711 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.833680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60f01d14-922a-4b69-a575-74908eaca8f4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.834503 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.834466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f01d14-922a-4b69-a575-74908eaca8f4-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.837350 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.837326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfb0302d-70f3-4e02-bd86-1969585c4954-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.849124 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.849073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsksv\" (UniqueName: \"kubernetes.io/projected/cfb0302d-70f3-4e02-bd86-1969585c4954-kube-api-access-gsksv\") pod \"node-exporter-dpzts\" (UID: \"cfb0302d-70f3-4e02-bd86-1969585c4954\") " pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.851884 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.851860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh669\" (UniqueName: \"kubernetes.io/projected/60f01d14-922a-4b69-a575-74908eaca8f4-kube-api-access-gh669\") pod \"kube-state-metrics-84c885658c-n8bfn\" (UID: \"60f01d14-922a-4b69-a575-74908eaca8f4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.937358 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.937084    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"
Sep 18 19:16:55.967302 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:55.967274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dpzts"
Sep 18 19:16:55.985617 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:16:55.985163    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb0302d_70f3_4e02_bd86_1969585c4954.slice/crio-36d2ee0eefd47651169d622236c281db7912400fc6244e306966f20bd4c3273c WatchSource:0}: Error finding container 36d2ee0eefd47651169d622236c281db7912400fc6244e306966f20bd4c3273c: Status 404 returned error can't find the container with id 36d2ee0eefd47651169d622236c281db7912400fc6244e306966f20bd4c3273c
Sep 18 19:16:56.040839 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:56.040801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpzts" event={"ID":"cfb0302d-70f3-4e02-bd86-1969585c4954","Type":"ContainerStarted","Data":"36d2ee0eefd47651169d622236c281db7912400fc6244e306966f20bd4c3273c"}
Sep 18 19:16:56.042940 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:56.042908    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5f59b9c4-5wdzb" event={"ID":"648f0876-4e7c-4abd-bc76-783f55b676c7","Type":"ContainerStarted","Data":"1e4b2246fcaeddff9af312d924f1a227ddb318605c6620d0707fe4bb0dc59961"}
Sep 18 19:16:56.046683 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:56.046621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shm2b" event={"ID":"b963ed37-bec8-4b85-a755-387803d45330","Type":"ContainerStarted","Data":"5041ee29189aff8526a754e9942117b96dae92ec6f39f1798c7e99911b45a1c1"}
Sep 18 19:16:56.066534 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:56.066265    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-ldgqv"
Sep 18 19:16:56.263504 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:56.263406    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-n8bfn"]
Sep 18 19:16:57.057148 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.057064    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn" event={"ID":"60f01d14-922a-4b69-a575-74908eaca8f4","Type":"ContainerStarted","Data":"1843368bb11469641449634c860a3fde5c3b18c9262eaa063d892a726dc9264a"}
Sep 18 19:16:57.087109 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.086944    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:16:57.114094 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.113902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.119407 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.119212    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pvxhp\""
Sep 18 19:16:57.122634 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.122046    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 18 19:16:57.122634 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.122269    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 18 19:16:57.122634 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.122467    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 18 19:16:57.127160 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.126673    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 18 19:16:57.127160 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.126747    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 18 19:16:57.127160 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.126879    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 18 19:16:57.127160 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.127036    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 18 19:16:57.127854 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.127834    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 18 19:16:57.139854 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.139824    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 18 19:16:57.161370 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.161338    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:16:57.247707 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.247671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.247847 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.247748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm4vc\" (UniqueName: \"kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-kube-api-access-zm4vc\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.247847 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.247800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.247847 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.247831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-web-config\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.247993 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.247875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.247993 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.247908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.247993 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.247941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.248282 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.248259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.248367 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.248308    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.248418 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.248402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-out\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.248468 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.248443    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.248520 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.248494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.248568 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.248550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.350350 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.350738 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.350738 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-out\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.350738 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.350738 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.350738 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.350738 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.350738 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm4vc\" (UniqueName: \"kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-kube-api-access-zm4vc\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.350738 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.350738 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-web-config\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.351389 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.351389 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.351389 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.350807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.352033 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.351611    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.352731 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.352699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.353821 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.353497    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.357586 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.357563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-web-config\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.359794 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.359742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.366152 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.366108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.368348 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.368294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.371784 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.371741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.380891 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.380808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm4vc\" (UniqueName: \"kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-kube-api-access-zm4vc\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.384147 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.384091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.384707 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.384661    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.388215 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.388172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.388804 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.388763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-out\") pod \"alertmanager-main-0\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:57.432111 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:57.432065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:16:59.258315 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:59.257426    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78886b55c6-pkb2r"]
Sep 18 19:16:59.264868 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:59.264763    2580 patch_prober.go:28] interesting pod/image-registry-78886b55c6-pkb2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 19:16:59.264868 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:16:59.264807    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r" podUID="ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:17:00.294442 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.294412    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5897564487-s5ffz"]
Sep 18 19:17:00.320525 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.320493    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5897564487-s5ffz"]
Sep 18 19:17:00.320682 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.320590    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.332302 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.332275    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 18 19:17:00.332804 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.332784    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 18 19:17:00.333177 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.333148    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 18 19:17:00.333433 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.333414    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b2m30cpet5iod\""
Sep 18 19:17:00.337263 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.337240    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 18 19:17:00.337489 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.337471    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lnc9g\""
Sep 18 19:17:00.479283 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.479248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-secret-metrics-server-tls\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.479556 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.479317    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-secret-metrics-server-client-certs\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.479556 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.479359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.479556 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.479410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cr9g\" (UniqueName: \"kubernetes.io/projected/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-kube-api-access-2cr9g\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.479556 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.479454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-metrics-server-audit-profiles\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.479556 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.479471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-client-ca-bundle\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.479556 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.479524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-audit-log\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.580127 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.580069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-secret-metrics-server-tls\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.580308 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.580156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-secret-metrics-server-client-certs\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.580308 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.580203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.580308 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.580229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cr9g\" (UniqueName: \"kubernetes.io/projected/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-kube-api-access-2cr9g\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.580308 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.580266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-metrics-server-audit-profiles\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.580308 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.580290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-client-ca-bundle\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.580553 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.580346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-audit-log\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.580754 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.580725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-audit-log\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.580961 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.580910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.581293 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.581267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-metrics-server-audit-profiles\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.583555 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.583529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-secret-metrics-server-tls\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.583889 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.583867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-secret-metrics-server-client-certs\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.584092 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.584073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-client-ca-bundle\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.605577 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.605551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cr9g\" (UniqueName: \"kubernetes.io/projected/4e1ff0bd-c692-4ade-ad46-7a2a8d797c70-kube-api-access-2cr9g\") pod \"metrics-server-5897564487-s5ffz\" (UID: \"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70\") " pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:00.632559 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:00.632522    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:03.540033 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:03.540003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5897564487-s5ffz"]
Sep 18 19:17:03.551367 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:03.551342    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:17:04.088939 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.088900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5897564487-s5ffz" event={"ID":"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70","Type":"ContainerStarted","Data":"773d21d024ef5984443cb45f9c442426a52b344577e34f64eb1cff7418c7cdeb"}
Sep 18 19:17:04.090276 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.090242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerStarted","Data":"e70d77ac11cec3d7161f788a2fd252d43f1b2cf587d768f1521a00c185248d8b"}
Sep 18 19:17:04.091820 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.091797    2580 generic.go:356] "Generic (PLEG): container finished" podID="cfb0302d-70f3-4e02-bd86-1969585c4954" containerID="f45ffd404b7b4228cd4bc34b57f3c19d5e7451217ce270f31d92fe42363166ee" exitCode=0
Sep 18 19:17:04.091920 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.091867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpzts" event={"ID":"cfb0302d-70f3-4e02-bd86-1969585c4954","Type":"ContainerDied","Data":"f45ffd404b7b4228cd4bc34b57f3c19d5e7451217ce270f31d92fe42363166ee"}
Sep 18 19:17:04.093480 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.093454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5f59b9c4-5wdzb" event={"ID":"648f0876-4e7c-4abd-bc76-783f55b676c7","Type":"ContainerStarted","Data":"e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2"}
Sep 18 19:17:04.099942 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.099916    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn" event={"ID":"60f01d14-922a-4b69-a575-74908eaca8f4","Type":"ContainerStarted","Data":"9154d7babb28c87eadafd90a24efb488b6a578b514cc7211365f4added3f3e1e"}
Sep 18 19:17:04.100079 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.100040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn" event={"ID":"60f01d14-922a-4b69-a575-74908eaca8f4","Type":"ContainerStarted","Data":"472c33041099941e1a627fe44b1c406c9751ce4901b32e24cbf4204e2b11cf6d"}
Sep 18 19:17:04.100079 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.100075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn" event={"ID":"60f01d14-922a-4b69-a575-74908eaca8f4","Type":"ContainerStarted","Data":"8790ec44502d0f9ac1ecbf26e54a8d0c59f3b16262f6bf68cf281e2c022eeea9"}
Sep 18 19:17:04.102067 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.102046    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shm2b" event={"ID":"b963ed37-bec8-4b85-a755-387803d45330","Type":"ContainerStarted","Data":"6f328265c1407412970dd46bb85f0ea8179ba574f8bc78d92bfc7b5b9ebf6531"}
Sep 18 19:17:04.143522 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.143479    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-n8bfn" podStartSLOduration=2.170174022 podStartE2EDuration="9.143462893s" totalImagesPullingTime="6.973288871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:17:04.142682848 +0000 UTC m=+187.787438169" watchObservedRunningTime="2026-09-18 19:17:04.143462893 +0000 UTC m=+187.788218213"
Sep 18 19:17:04.169902 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.169714    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-shm2b" podStartSLOduration=40.866373753 podStartE2EDuration="49.169697001s" totalImagesPullingTime="8.303323248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:16:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:17:04.16926121 +0000 UTC m=+187.814016556" watchObservedRunningTime="2026-09-18 19:17:04.169697001 +0000 UTC m=+187.814452322"
Sep 18 19:17:04.190538 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:04.190453    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c5f59b9c4-5wdzb" podStartSLOduration=6.560575416 podStartE2EDuration="15.190437036s" totalImagesPullingTime="8.62986162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:17:04.189222672 +0000 UTC m=+187.833978013" watchObservedRunningTime="2026-09-18 19:17:04.190437036 +0000 UTC m=+187.835192351"
Sep 18 19:17:05.108112 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:05.108068    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpzts" event={"ID":"cfb0302d-70f3-4e02-bd86-1969585c4954","Type":"ContainerStarted","Data":"79004e63c757d3a6068c27dd391fb552e792f7462a017b1a75c0536ece68dffe"}
Sep 18 19:17:05.108515 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:05.108134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpzts" event={"ID":"cfb0302d-70f3-4e02-bd86-1969585c4954","Type":"ContainerStarted","Data":"3ad1e78ff390c4229e13131258ca0ec3d5d62c09ced4592b1969c6978de88c9b"}
Sep 18 19:17:05.136601 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:05.136549    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dpzts" podStartSLOduration=2.783407973 podStartE2EDuration="10.136535283s" totalImagesPullingTime="7.247326884s" totalInitContainerRuntime="105.800426ms" isStatefulPod=true podCreationTimestamp="2026-09-18 19:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:17:05.13390783 +0000 UTC m=+188.778663168" watchObservedRunningTime="2026-09-18 19:17:05.136535283 +0000 UTC m=+188.781290602"
Sep 18 19:17:06.114002 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:06.113920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5897564487-s5ffz" event={"ID":"4e1ff0bd-c692-4ade-ad46-7a2a8d797c70","Type":"ContainerStarted","Data":"ee1d65ebb79afcd7cc741809f09c87ef5f5cd2b987fc0d2d9106d8b8d537ec1d"}
Sep 18 19:17:06.115541 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:06.115514    2580 generic.go:356] "Generic (PLEG): container finished" podID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerID="a1dd2ba95acbb18132e840419a2fc37dc233e6b0df286fcefe44e895e6a6fa03" exitCode=0
Sep 18 19:17:06.115654 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:06.115598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerDied","Data":"a1dd2ba95acbb18132e840419a2fc37dc233e6b0df286fcefe44e895e6a6fa03"}
Sep 18 19:17:06.141893 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:06.141844    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5897564487-s5ffz" podStartSLOduration=3.922900449 podStartE2EDuration="6.141827046s" totalImagesPullingTime="2.218926597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:17:06.141099411 +0000 UTC m=+189.785854732" watchObservedRunningTime="2026-09-18 19:17:06.141827046 +0000 UTC m=+189.786582363"
Sep 18 19:17:08.126542 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:08.126516    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerStarted","Data":"b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb"}
Sep 18 19:17:09.132907 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:09.132879    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerStarted","Data":"891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87"}
Sep 18 19:17:09.133326 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:09.132945    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerStarted","Data":"a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a"}
Sep 18 19:17:09.133326 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:09.132995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerStarted","Data":"337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31"}
Sep 18 19:17:09.133326 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:09.133024    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerStarted","Data":"c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0"}
Sep 18 19:17:09.263239 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:09.263212    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:17:09.900855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:09.900824    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:17:09.900991 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:09.900893    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:17:09.905944 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:09.905926    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:17:10.139942 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:10.139911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerStarted","Data":"0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9"}
Sep 18 19:17:10.143711 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:10.143688    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:17:10.174116 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:10.174078    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.941461329 podStartE2EDuration="14.174064576s" totalImagesPullingTime="5.205740267s" totalInitContainerRuntime="26.86298ms" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:17:10.172237045 +0000 UTC m=+193.816992373" watchObservedRunningTime="2026-09-18 19:17:10.174064576 +0000 UTC m=+193.818819946"
Sep 18 19:17:14.218288 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:14.218257    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c5f59b9c4-5wdzb"]
Sep 18 19:17:20.633014 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:20.632959    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:20.633470 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:20.633033    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:24.282755 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.282694    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r" podUID="ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" containerName="registry" containerID="cri-o://825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e" gracePeriod=30
Sep 18 19:17:24.528268 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.528245    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:17:24.578257 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578194    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-certificates\") pod \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") "
Sep 18 19:17:24.578390 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578253    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-trusted-ca\") pod \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") "
Sep 18 19:17:24.578390 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578299    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-ca-trust-extracted\") pod \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") "
Sep 18 19:17:24.578390 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578327    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") pod \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") "
Sep 18 19:17:24.578390 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578358    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-installation-pull-secrets\") pod \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") "
Sep 18 19:17:24.578589 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578404    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbwtd\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-kube-api-access-pbwtd\") pod \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") "
Sep 18 19:17:24.578589 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578471    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-bound-sa-token\") pod \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") "
Sep 18 19:17:24.578589 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578496    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-image-registry-private-configuration\") pod \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\" (UID: \"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4\") "
Sep 18 19:17:24.578589 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578559    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:17:24.578779 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578669    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:17:24.578779 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578761    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-trusted-ca\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:24.578884 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.578778    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-certificates\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:24.581422 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.581256    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:17:24.581723 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.581697    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:17:24.581933 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.581905    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:17:24.586551 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.586527    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:17:24.587227 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.587159    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-kube-api-access-pbwtd" (OuterVolumeSpecName: "kube-api-access-pbwtd") pod "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4"). InnerVolumeSpecName "kube-api-access-pbwtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:17:24.591955 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.591931    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" (UID: "ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:17:24.679555 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.679531    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-bound-sa-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:24.679555 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.679551    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-image-registry-private-configuration\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:24.679716 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.679561    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-ca-trust-extracted\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:24.679716 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.679570    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-registry-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:24.679716 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.679578    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-installation-pull-secrets\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:24.679716 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:24.679586    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbwtd\" (UniqueName: \"kubernetes.io/projected/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4-kube-api-access-pbwtd\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:25.201857 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:25.201809    2580 generic.go:356] "Generic (PLEG): container finished" podID="ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" containerID="825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e" exitCode=0
Sep 18 19:17:25.202012 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:25.201873    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r"
Sep 18 19:17:25.202012 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:25.201902    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r" event={"ID":"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4","Type":"ContainerDied","Data":"825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e"}
Sep 18 19:17:25.202012 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:25.201999    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78886b55c6-pkb2r" event={"ID":"ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4","Type":"ContainerDied","Data":"35b585ac6b7c32de43015ba55c1e5ab01e5e7b6d4e32cb664f3d6fc6ee5b92e5"}
Sep 18 19:17:25.202149 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:25.202027    2580 scope.go:117] "RemoveContainer" containerID="825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e"
Sep 18 19:17:25.212152 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:25.212134    2580 scope.go:117] "RemoveContainer" containerID="825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e"
Sep 18 19:17:25.212441 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:17:25.212412    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e\": container with ID starting with 825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e not found: ID does not exist" containerID="825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e"
Sep 18 19:17:25.212499 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:25.212449    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e"} err="failed to get container status \"825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e\": rpc error: code = NotFound desc = could not find container \"825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e\": container with ID starting with 825391ff0af330586f538606f3a21806f507b5591930a22f8c97fb179a7c958e not found: ID does not exist"
Sep 18 19:17:25.229232 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:25.229208    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78886b55c6-pkb2r"]
Sep 18 19:17:25.232814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:25.232790    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78886b55c6-pkb2r"]
Sep 18 19:17:26.069448 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:26.069420    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nf6c8_63e24fba-9743-4bbf-9613-c0b0e126d7ba/serve-healthcheck-canary/0.log"
Sep 18 19:17:26.208387 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:26.208356    2580 generic.go:356] "Generic (PLEG): container finished" podID="dae1362a-c516-483d-90a8-eeae270de469" containerID="9e6b10c888a81d5861a5252cda79dd8cf570026c956f3aeb060f22ed6b7c0892" exitCode=0
Sep 18 19:17:26.208523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:26.208400    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw" event={"ID":"dae1362a-c516-483d-90a8-eeae270de469","Type":"ContainerDied","Data":"9e6b10c888a81d5861a5252cda79dd8cf570026c956f3aeb060f22ed6b7c0892"}
Sep 18 19:17:26.208704 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:26.208689    2580 scope.go:117] "RemoveContainer" containerID="9e6b10c888a81d5861a5252cda79dd8cf570026c956f3aeb060f22ed6b7c0892"
Sep 18 19:17:26.374683 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:26.374657    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" path="/var/lib/kubelet/pods/ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4/volumes"
Sep 18 19:17:27.214207 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:27.214181    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xsmpw" event={"ID":"dae1362a-c516-483d-90a8-eeae270de469","Type":"ContainerStarted","Data":"6ac9052484bedb2465442ec3ef435c8770b88def17e829cc88f81ddb0ed186f0"}
Sep 18 19:17:39.239132 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.239073    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c5f59b9c4-5wdzb" podUID="648f0876-4e7c-4abd-bc76-783f55b676c7" containerName="console" containerID="cri-o://e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2" gracePeriod=15
Sep 18 19:17:39.515629 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.515573    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:17:39.599281 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599254    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-oauth-config\") pod \"648f0876-4e7c-4abd-bc76-783f55b676c7\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") "
Sep 18 19:17:39.599395 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599289    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-serving-cert\") pod \"648f0876-4e7c-4abd-bc76-783f55b676c7\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") "
Sep 18 19:17:39.599395 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599317    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-trusted-ca-bundle\") pod \"648f0876-4e7c-4abd-bc76-783f55b676c7\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") "
Sep 18 19:17:39.599480 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599442    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-service-ca\") pod \"648f0876-4e7c-4abd-bc76-783f55b676c7\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") "
Sep 18 19:17:39.599529 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599505    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-oauth-serving-cert\") pod \"648f0876-4e7c-4abd-bc76-783f55b676c7\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") "
Sep 18 19:17:39.599588 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599545    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-console-config\") pod \"648f0876-4e7c-4abd-bc76-783f55b676c7\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") "
Sep 18 19:17:39.599641 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599599    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sg5t\" (UniqueName: \"kubernetes.io/projected/648f0876-4e7c-4abd-bc76-783f55b676c7-kube-api-access-9sg5t\") pod \"648f0876-4e7c-4abd-bc76-783f55b676c7\" (UID: \"648f0876-4e7c-4abd-bc76-783f55b676c7\") "
Sep 18 19:17:39.599756 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599732    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "648f0876-4e7c-4abd-bc76-783f55b676c7" (UID: "648f0876-4e7c-4abd-bc76-783f55b676c7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:17:39.599874 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599824    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "648f0876-4e7c-4abd-bc76-783f55b676c7" (UID: "648f0876-4e7c-4abd-bc76-783f55b676c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:17:39.599874 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599847    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-trusted-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:39.599874 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599856    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "648f0876-4e7c-4abd-bc76-783f55b676c7" (UID: "648f0876-4e7c-4abd-bc76-783f55b676c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:17:39.600122 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.599935    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-console-config" (OuterVolumeSpecName: "console-config") pod "648f0876-4e7c-4abd-bc76-783f55b676c7" (UID: "648f0876-4e7c-4abd-bc76-783f55b676c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:17:39.601752 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.601723    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "648f0876-4e7c-4abd-bc76-783f55b676c7" (UID: "648f0876-4e7c-4abd-bc76-783f55b676c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:17:39.601836 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.601769    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "648f0876-4e7c-4abd-bc76-783f55b676c7" (UID: "648f0876-4e7c-4abd-bc76-783f55b676c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:17:39.601836 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.601809    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/648f0876-4e7c-4abd-bc76-783f55b676c7-kube-api-access-9sg5t" (OuterVolumeSpecName: "kube-api-access-9sg5t") pod "648f0876-4e7c-4abd-bc76-783f55b676c7" (UID: "648f0876-4e7c-4abd-bc76-783f55b676c7"). InnerVolumeSpecName "kube-api-access-9sg5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:17:39.700758 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.700721    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-service-ca\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:39.700758 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.700758    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-oauth-serving-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:39.700905 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.700776    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/648f0876-4e7c-4abd-bc76-783f55b676c7-console-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:39.700905 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.700792    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sg5t\" (UniqueName: \"kubernetes.io/projected/648f0876-4e7c-4abd-bc76-783f55b676c7-kube-api-access-9sg5t\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:39.700905 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.700806    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-oauth-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:39.700905 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:39.700819    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/648f0876-4e7c-4abd-bc76-783f55b676c7-console-serving-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:17:40.267351 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.267313    2580 generic.go:356] "Generic (PLEG): container finished" podID="648f0876-4e7c-4abd-bc76-783f55b676c7" containerID="e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2" exitCode=0
Sep 18 19:17:40.267762 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.267367    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5f59b9c4-5wdzb"
Sep 18 19:17:40.267762 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.267384    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5f59b9c4-5wdzb" event={"ID":"648f0876-4e7c-4abd-bc76-783f55b676c7","Type":"ContainerDied","Data":"e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2"}
Sep 18 19:17:40.267762 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.267435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5f59b9c4-5wdzb" event={"ID":"648f0876-4e7c-4abd-bc76-783f55b676c7","Type":"ContainerDied","Data":"1e4b2246fcaeddff9af312d924f1a227ddb318605c6620d0707fe4bb0dc59961"}
Sep 18 19:17:40.267762 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.267463    2580 scope.go:117] "RemoveContainer" containerID="e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2"
Sep 18 19:17:40.277231 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.277209    2580 scope.go:117] "RemoveContainer" containerID="e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2"
Sep 18 19:17:40.277536 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:17:40.277520    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2\": container with ID starting with e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2 not found: ID does not exist" containerID="e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2"
Sep 18 19:17:40.277588 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.277543    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2"} err="failed to get container status \"e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2\": rpc error: code = NotFound desc = could not find container \"e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2\": container with ID starting with e18d98fcfb1754156c916a5013eacb52e55975a163fec2e84ee8e9e108c215f2 not found: ID does not exist"
Sep 18 19:17:40.303291 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.303260    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c5f59b9c4-5wdzb"]
Sep 18 19:17:40.309287 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.309266    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c5f59b9c4-5wdzb"]
Sep 18 19:17:40.374379 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.374356    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="648f0876-4e7c-4abd-bc76-783f55b676c7" path="/var/lib/kubelet/pods/648f0876-4e7c-4abd-bc76-783f55b676c7/volumes"
Sep 18 19:17:40.638210 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.638188    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:40.642107 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:40.642086    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5897564487-s5ffz"
Sep 18 19:17:46.293829 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:46.293789    2580 generic.go:356] "Generic (PLEG): container finished" podID="63716f9e-c352-4d9c-91a4-ede4d11977cc" containerID="60583b86111e81f9dff57cab774a7ba907cc85427bc41b08f7aac07af2e0281c" exitCode=0
Sep 18 19:17:46.294275 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:46.293843    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm" event={"ID":"63716f9e-c352-4d9c-91a4-ede4d11977cc","Type":"ContainerDied","Data":"60583b86111e81f9dff57cab774a7ba907cc85427bc41b08f7aac07af2e0281c"}
Sep 18 19:17:46.294275 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:46.294213    2580 scope.go:117] "RemoveContainer" containerID="60583b86111e81f9dff57cab774a7ba907cc85427bc41b08f7aac07af2e0281c"
Sep 18 19:17:47.301989 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:17:47.301938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-swxbm" event={"ID":"63716f9e-c352-4d9c-91a4-ede4d11977cc","Type":"ContainerStarted","Data":"6ed3d497ed49cc8f7063c60c67d88f7322df532aac14c51e89d0c80c4942e1dc"}
Sep 18 19:18:10.117553 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:10.117458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:18:10.120214 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:10.120191    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3082557-8a7a-424f-b6af-d746972e7352-metrics-certs\") pod \"network-metrics-daemon-r7bpt\" (UID: \"d3082557-8a7a-424f-b6af-d746972e7352\") " pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:18:10.373268 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:10.373195    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w2qlj\""
Sep 18 19:18:10.381008 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:10.380963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7bpt"
Sep 18 19:18:10.657705 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:10.657684    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r7bpt"]
Sep 18 19:18:10.659747 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:18:10.659723    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3082557_8a7a_424f_b6af_d746972e7352.slice/crio-f0705c3b5f0842e3bd9405cce7fde9edfed4f00c3b48b703382b57e4e0b3bde7 WatchSource:0}: Error finding container f0705c3b5f0842e3bd9405cce7fde9edfed4f00c3b48b703382b57e4e0b3bde7: Status 404 returned error can't find the container with id f0705c3b5f0842e3bd9405cce7fde9edfed4f00c3b48b703382b57e4e0b3bde7
Sep 18 19:18:11.395791 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:11.395758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r7bpt" event={"ID":"d3082557-8a7a-424f-b6af-d746972e7352","Type":"ContainerStarted","Data":"f0705c3b5f0842e3bd9405cce7fde9edfed4f00c3b48b703382b57e4e0b3bde7"}
Sep 18 19:18:13.405446 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:13.405411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r7bpt" event={"ID":"d3082557-8a7a-424f-b6af-d746972e7352","Type":"ContainerStarted","Data":"f3127914f33d5420714d338f44a148dfc4ddb0580358fd45dadb88e49d8172eb"}
Sep 18 19:18:13.405832 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:13.405468    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r7bpt" event={"ID":"d3082557-8a7a-424f-b6af-d746972e7352","Type":"ContainerStarted","Data":"2f381df66bbf6c9e9083a1a301d6713300f30d5d96af3de88f896a31d7eaaf9c"}
Sep 18 19:18:13.445572 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:13.445519    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r7bpt" podStartSLOduration=253.533041619 podStartE2EDuration="4m15.445498385s" totalImagesPullingTime="1.912456766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:18:13.444320934 +0000 UTC m=+257.089076269" watchObservedRunningTime="2026-09-18 19:18:13.445498385 +0000 UTC m=+257.090253705"
Sep 18 19:18:16.799783 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:16.799745    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:18:16.800442 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:16.800099    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="alertmanager" containerID="cri-o://b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb" gracePeriod=120
Sep 18 19:18:16.800442 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:16.800175    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy-metric" containerID="cri-o://891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87" gracePeriod=120
Sep 18 19:18:16.800442 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:16.800215    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy-web" containerID="cri-o://337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31" gracePeriod=120
Sep 18 19:18:16.800442 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:16.800264    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="prom-label-proxy" containerID="cri-o://0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9" gracePeriod=120
Sep 18 19:18:16.800442 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:16.800264    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="config-reloader" containerID="cri-o://c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0" gracePeriod=120
Sep 18 19:18:16.800442 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:16.800209    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy" containerID="cri-o://a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a" gracePeriod=120
Sep 18 19:18:17.427774 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:17.427745    2580 generic.go:356] "Generic (PLEG): container finished" podID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerID="0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9" exitCode=0
Sep 18 19:18:17.427774 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:17.427769    2580 generic.go:356] "Generic (PLEG): container finished" podID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerID="891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87" exitCode=0
Sep 18 19:18:17.427774 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:17.427776    2580 generic.go:356] "Generic (PLEG): container finished" podID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerID="a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a" exitCode=0
Sep 18 19:18:17.428080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:17.427783    2580 generic.go:356] "Generic (PLEG): container finished" podID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerID="c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0" exitCode=0
Sep 18 19:18:17.428080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:17.427788    2580 generic.go:356] "Generic (PLEG): container finished" podID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerID="b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb" exitCode=0
Sep 18 19:18:17.428080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:17.427823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerDied","Data":"0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9"}
Sep 18 19:18:17.428080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:17.427917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerDied","Data":"891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87"}
Sep 18 19:18:17.428080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:17.428026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerDied","Data":"a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a"}
Sep 18 19:18:17.428080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:17.428074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerDied","Data":"c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0"}
Sep 18 19:18:17.428305 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:17.428114    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerDied","Data":"b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb"}
Sep 18 19:18:18.057368 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.057340    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.170990 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.170910    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.170990 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.170941    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-out\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171192 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.170991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-main-tls\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171192 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171019    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-main-db\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171192 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171035    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-metrics-client-ca\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171192 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171055    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-cluster-tls-config\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171192 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171087    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-tls-assets\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171192 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171116    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm4vc\" (UniqueName: \"kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-kube-api-access-zm4vc\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171192 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171144    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-volume\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171192 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171178    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171625 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171212    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-web-config\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171625 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171245    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-web\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171625 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171271    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-trusted-ca-bundle\") pod \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\" (UID: \"5fba01b6-72ea-4daf-895e-40e9f4a607e3\") "
Sep 18 19:18:18.171625 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171378    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:18:18.171953 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.171722    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-main-db\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.172057 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.172029    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:18:18.172548 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.172318    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:18:18.174018 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.173872    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:18:18.174832 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.174577    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:18:18.175202 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.175168    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-out" (OuterVolumeSpecName: "config-out") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:18:18.175418 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.175382    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-kube-api-access-zm4vc" (OuterVolumeSpecName: "kube-api-access-zm4vc") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "kube-api-access-zm4vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:18:18.175954 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.175919    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:18:18.176102 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.176046    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-volume" (OuterVolumeSpecName: "config-volume") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:18:18.176309 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.176283    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:18:18.176855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.176838    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:18:18.180083 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.180046    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:18:18.185946 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.185925    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-web-config" (OuterVolumeSpecName: "web-config") pod "5fba01b6-72ea-4daf-895e-40e9f4a607e3" (UID: "5fba01b6-72ea-4daf-895e-40e9f4a607e3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:18:18.272673 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272651    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-main-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.272673 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272669    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-metrics-client-ca\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.272792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272680    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-cluster-tls-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.272792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272688    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-tls-assets\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.272792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272697    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm4vc\" (UniqueName: \"kubernetes.io/projected/5fba01b6-72ea-4daf-895e-40e9f4a607e3-kube-api-access-zm4vc\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.272792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272705    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-volume\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.272792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272714    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.272792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272723    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-web-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.272792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272733    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.272792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272741    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fba01b6-72ea-4daf-895e-40e9f4a607e3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.272792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272749    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fba01b6-72ea-4daf-895e-40e9f4a607e3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.272792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.272757    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fba01b6-72ea-4daf-895e-40e9f4a607e3-config-out\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:18:18.434678 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.434628    2580 generic.go:356] "Generic (PLEG): container finished" podID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerID="337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31" exitCode=0
Sep 18 19:18:18.434678 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.434663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerDied","Data":"337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31"}
Sep 18 19:18:18.434796 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.434716    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.434796 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.434729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fba01b6-72ea-4daf-895e-40e9f4a607e3","Type":"ContainerDied","Data":"e70d77ac11cec3d7161f788a2fd252d43f1b2cf587d768f1521a00c185248d8b"}
Sep 18 19:18:18.434796 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.434778    2580 scope.go:117] "RemoveContainer" containerID="0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9"
Sep 18 19:18:18.442203 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.442187    2580 scope.go:117] "RemoveContainer" containerID="891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87"
Sep 18 19:18:18.448843 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.448827    2580 scope.go:117] "RemoveContainer" containerID="a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a"
Sep 18 19:18:18.455495 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.455465    2580 scope.go:117] "RemoveContainer" containerID="337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31"
Sep 18 19:18:18.462108 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.462090    2580 scope.go:117] "RemoveContainer" containerID="c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0"
Sep 18 19:18:18.469825 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.469806    2580 scope.go:117] "RemoveContainer" containerID="b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb"
Sep 18 19:18:18.477066 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.476956    2580 scope.go:117] "RemoveContainer" containerID="a1dd2ba95acbb18132e840419a2fc37dc233e6b0df286fcefe44e895e6a6fa03"
Sep 18 19:18:18.477488 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.477466    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:18:18.483763 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.483739    2580 scope.go:117] "RemoveContainer" containerID="0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9"
Sep 18 19:18:18.484047 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:18:18.484030    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9\": container with ID starting with 0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9 not found: ID does not exist" containerID="0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9"
Sep 18 19:18:18.484093 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.484057    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9"} err="failed to get container status \"0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9\": rpc error: code = NotFound desc = could not find container \"0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9\": container with ID starting with 0ee7cfbb482e0e00309b9eb4b67f44b5ca0b0ea6864bd465782d5a6bea79e6b9 not found: ID does not exist"
Sep 18 19:18:18.484093 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.484076    2580 scope.go:117] "RemoveContainer" containerID="891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87"
Sep 18 19:18:18.484302 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:18:18.484287    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87\": container with ID starting with 891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87 not found: ID does not exist" containerID="891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87"
Sep 18 19:18:18.484335 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.484306    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87"} err="failed to get container status \"891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87\": rpc error: code = NotFound desc = could not find container \"891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87\": container with ID starting with 891404b3d741f0ca536e2952ca7c6d3e8df1b37a248f67dddb7ee5a2e7762a87 not found: ID does not exist"
Sep 18 19:18:18.484335 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.484318    2580 scope.go:117] "RemoveContainer" containerID="a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a"
Sep 18 19:18:18.484578 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:18:18.484559    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a\": container with ID starting with a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a not found: ID does not exist" containerID="a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a"
Sep 18 19:18:18.484649 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.484584    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a"} err="failed to get container status \"a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a\": rpc error: code = NotFound desc = could not find container \"a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a\": container with ID starting with a932bc1fbf7bd45e5a6705fef74b14965a2294351401ad9423b951943b9f8f4a not found: ID does not exist"
Sep 18 19:18:18.484649 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.484606    2580 scope.go:117] "RemoveContainer" containerID="337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31"
Sep 18 19:18:18.484869 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:18:18.484854    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31\": container with ID starting with 337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31 not found: ID does not exist" containerID="337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31"
Sep 18 19:18:18.484922 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.484872    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31"} err="failed to get container status \"337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31\": rpc error: code = NotFound desc = could not find container \"337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31\": container with ID starting with 337bead7cfcc14c490775b5fa63d0004e59b1acb716d9f54ca4817a13dd85c31 not found: ID does not exist"
Sep 18 19:18:18.484922 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.484885    2580 scope.go:117] "RemoveContainer" containerID="c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0"
Sep 18 19:18:18.485199 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:18:18.485180    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0\": container with ID starting with c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0 not found: ID does not exist" containerID="c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0"
Sep 18 19:18:18.485248 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.485203    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0"} err="failed to get container status \"c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0\": rpc error: code = NotFound desc = could not find container \"c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0\": container with ID starting with c59e9ffa0d99c198912a3fe473d4991f0c2672f12c6fc7b5069452e792fed5d0 not found: ID does not exist"
Sep 18 19:18:18.485248 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.485215    2580 scope.go:117] "RemoveContainer" containerID="b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb"
Sep 18 19:18:18.485448 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:18:18.485429    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb\": container with ID starting with b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb not found: ID does not exist" containerID="b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb"
Sep 18 19:18:18.485494 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.485451    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb"} err="failed to get container status \"b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb\": rpc error: code = NotFound desc = could not find container \"b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb\": container with ID starting with b8c4fdfe27581c8f73cbfbf3ee7b6025a4561fed45e63a4fb7b0bc46f2237acb not found: ID does not exist"
Sep 18 19:18:18.485494 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.485463    2580 scope.go:117] "RemoveContainer" containerID="a1dd2ba95acbb18132e840419a2fc37dc233e6b0df286fcefe44e895e6a6fa03"
Sep 18 19:18:18.490610 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:18:18.490587    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1dd2ba95acbb18132e840419a2fc37dc233e6b0df286fcefe44e895e6a6fa03\": container with ID starting with a1dd2ba95acbb18132e840419a2fc37dc233e6b0df286fcefe44e895e6a6fa03 not found: ID does not exist" containerID="a1dd2ba95acbb18132e840419a2fc37dc233e6b0df286fcefe44e895e6a6fa03"
Sep 18 19:18:18.490703 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.490617    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1dd2ba95acbb18132e840419a2fc37dc233e6b0df286fcefe44e895e6a6fa03"} err="failed to get container status \"a1dd2ba95acbb18132e840419a2fc37dc233e6b0df286fcefe44e895e6a6fa03\": rpc error: code = NotFound desc = could not find container \"a1dd2ba95acbb18132e840419a2fc37dc233e6b0df286fcefe44e895e6a6fa03\": container with ID starting with a1dd2ba95acbb18132e840419a2fc37dc233e6b0df286fcefe44e895e6a6fa03 not found: ID does not exist"
Sep 18 19:18:18.497383 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.497362    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:18:18.561254 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561234    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:18:18.561497 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561485    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="alertmanager"
Sep 18 19:18:18.561537 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561501    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="alertmanager"
Sep 18 19:18:18.561537 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561518    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="config-reloader"
Sep 18 19:18:18.561537 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561525    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="config-reloader"
Sep 18 19:18:18.561537 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561535    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" containerName="registry"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561541    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" containerName="registry"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561548    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648f0876-4e7c-4abd-bc76-783f55b676c7" containerName="console"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561553    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="648f0876-4e7c-4abd-bc76-783f55b676c7" containerName="console"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561560    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy-web"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561565    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy-web"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561570    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy-metric"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561574    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy-metric"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561587    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561595    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561601    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="prom-label-proxy"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561605    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="prom-label-proxy"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561613    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="init-config-reloader"
Sep 18 19:18:18.561651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561617    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="init-config-reloader"
Sep 18 19:18:18.562022 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561657    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="alertmanager"
Sep 18 19:18:18.562022 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561668    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae3e13de-49a5-4ba9-8b06-4e7ea48b6fe4" containerName="registry"
Sep 18 19:18:18.562022 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561676    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy"
Sep 18 19:18:18.562022 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561681    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="config-reloader"
Sep 18 19:18:18.562022 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561686    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="648f0876-4e7c-4abd-bc76-783f55b676c7" containerName="console"
Sep 18 19:18:18.562022 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561691    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy-web"
Sep 18 19:18:18.562022 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561696    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="prom-label-proxy"
Sep 18 19:18:18.562022 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.561702    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" containerName="kube-rbac-proxy-metric"
Sep 18 19:18:18.566603 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.566588    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.574989 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.574959    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 18 19:18:18.575082 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.574961    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 18 19:18:18.575166 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.575139    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 18 19:18:18.575166 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.575156    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 18 19:18:18.575374 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.575359    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 18 19:18:18.576416 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.576398    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pvxhp\""
Sep 18 19:18:18.576526 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.576418    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 18 19:18:18.580542 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.580527    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 18 19:18:18.584394 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.584378    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 18 19:18:18.593492 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.593475    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 18 19:18:18.674835 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.674811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c733224f-f71b-4617-932d-0382115f3244-config-out\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.674942 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.674846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c733224f-f71b-4617-932d-0382115f3244-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.674942 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.674877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c733224f-f71b-4617-932d-0382115f3244-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.674942 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.674927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c733224f-f71b-4617-932d-0382115f3244-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.675139 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.674996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c733224f-f71b-4617-932d-0382115f3244-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.675139 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.675049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-web-config\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.675139 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.675089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.675139 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.675113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.675284 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.675139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfsvm\" (UniqueName: \"kubernetes.io/projected/c733224f-f71b-4617-932d-0382115f3244-kube-api-access-gfsvm\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.675284 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.675172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-config-volume\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.675284 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.675206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.675284 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.675234    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.675284 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.675269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.692992 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.692909    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:18:18.776488 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.776592 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.776592 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfsvm\" (UniqueName: \"kubernetes.io/projected/c733224f-f71b-4617-932d-0382115f3244-kube-api-access-gfsvm\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.776592 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-config-volume\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.776592 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.776771 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.776771 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.776771 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c733224f-f71b-4617-932d-0382115f3244-config-out\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.776771 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c733224f-f71b-4617-932d-0382115f3244-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.776771 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c733224f-f71b-4617-932d-0382115f3244-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.776771 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c733224f-f71b-4617-932d-0382115f3244-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.776771 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c733224f-f71b-4617-932d-0382115f3244-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.777235 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.776810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-web-config\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.779366 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.779335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c733224f-f71b-4617-932d-0382115f3244-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.779890 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.779859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c733224f-f71b-4617-932d-0382115f3244-config-out\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.780016 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.779923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-config-volume\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.780087 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.780044    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.780087 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.780078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.780202 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.780079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c733224f-f71b-4617-932d-0382115f3244-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.780202 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.780137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c733224f-f71b-4617-932d-0382115f3244-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.780291 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.780270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-web-config\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.780505 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.780486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.780651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.780634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.780995 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.780951    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c733224f-f71b-4617-932d-0382115f3244-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.782078 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.782060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c733224f-f71b-4617-932d-0382115f3244-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.790260 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.790242    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfsvm\" (UniqueName: \"kubernetes.io/projected/c733224f-f71b-4617-932d-0382115f3244-kube-api-access-gfsvm\") pod \"alertmanager-main-0\" (UID: \"c733224f-f71b-4617-932d-0382115f3244\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:18.874637 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:18.874619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:18:19.172068 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:19.172041    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:18:19.175044 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:18:19.175017    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc733224f_f71b_4617_932d_0382115f3244.slice/crio-1e8de6bf809d35beb596862096f9f9174e7caeb1fe4c6cc5e200243efeb77f43 WatchSource:0}: Error finding container 1e8de6bf809d35beb596862096f9f9174e7caeb1fe4c6cc5e200243efeb77f43: Status 404 returned error can't find the container with id 1e8de6bf809d35beb596862096f9f9174e7caeb1fe4c6cc5e200243efeb77f43
Sep 18 19:18:19.441126 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:19.441063    2580 generic.go:356] "Generic (PLEG): container finished" podID="c733224f-f71b-4617-932d-0382115f3244" containerID="766db12979fc1a420df0ea14cb6ef2d27db447e33edb6bfafbeb35524696dfc9" exitCode=0
Sep 18 19:18:19.441217 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:19.441125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c733224f-f71b-4617-932d-0382115f3244","Type":"ContainerDied","Data":"766db12979fc1a420df0ea14cb6ef2d27db447e33edb6bfafbeb35524696dfc9"}
Sep 18 19:18:19.441217 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:19.441182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c733224f-f71b-4617-932d-0382115f3244","Type":"ContainerStarted","Data":"1e8de6bf809d35beb596862096f9f9174e7caeb1fe4c6cc5e200243efeb77f43"}
Sep 18 19:18:20.374903 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.374857    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fba01b6-72ea-4daf-895e-40e9f4a607e3" path="/var/lib/kubelet/pods/5fba01b6-72ea-4daf-895e-40e9f4a607e3/volumes"
Sep 18 19:18:20.449122 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.449093    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c733224f-f71b-4617-932d-0382115f3244","Type":"ContainerStarted","Data":"42a0e12eaf372004e3ff262ba3afd24f2d5235aa8a6a7d8080d574da1f7ebcec"}
Sep 18 19:18:20.449250 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.449152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c733224f-f71b-4617-932d-0382115f3244","Type":"ContainerStarted","Data":"e12b78a2d10ca648acaa6a82cccb689587877ea9f7dd1afe7d2333f15ab0a889"}
Sep 18 19:18:20.449250 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.449177    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c733224f-f71b-4617-932d-0382115f3244","Type":"ContainerStarted","Data":"8bb94c0618b9a1b2d34a16b8b89f2f6ac9218cb0fdac7574d31fbedd0362179d"}
Sep 18 19:18:20.449250 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.449206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c733224f-f71b-4617-932d-0382115f3244","Type":"ContainerStarted","Data":"3b1361e2389c90a48e790d2a075d8a68b8818feb83037c8d85c440e786bdd01e"}
Sep 18 19:18:20.449250 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.449231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c733224f-f71b-4617-932d-0382115f3244","Type":"ContainerStarted","Data":"bf9069b72426b671573fd1b462429216422a9cbc314b6550e071ad452167c831"}
Sep 18 19:18:20.449400 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.449256    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c733224f-f71b-4617-932d-0382115f3244","Type":"ContainerStarted","Data":"6c44e7f81f21c3dbb68f0407433ece54eb59e474629f08b5810e3ecb4e827324"}
Sep 18 19:18:20.544535 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.544484    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.529205172 podStartE2EDuration="2.544469334s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.264162ms" isStatefulPod=false podCreationTimestamp="2026-09-18 19:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:18:20.540220376 +0000 UTC m=+264.184975695" watchObservedRunningTime="2026-09-18 19:18:20.544469334 +0000 UTC m=+264.189224654"
Sep 18 19:18:20.933401 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.933367    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"]
Sep 18 19:18:20.937707 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.937690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:20.943215 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.943192    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vxsr2\""
Sep 18 19:18:20.943630 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.943613    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 18 19:18:20.943786 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.943766    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 18 19:18:20.944307 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.944227    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 18 19:18:20.944893 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.944870    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 18 19:18:20.944989 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.944954    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 18 19:18:20.956295 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.956277    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 18 19:18:20.973996 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:20.973953    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"]
Sep 18 19:18:21.091865 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.091839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.091949 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.091871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-serving-certs-ca-bundle\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.091949 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.091901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-telemeter-client-tls\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.091949 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.091923    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-metrics-client-ca\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.091949 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.091945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjvmx\" (UniqueName: \"kubernetes.io/projected/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-kube-api-access-hjvmx\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.092167 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.091960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.092167 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.092020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-federate-client-tls\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.092167 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.092042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-secret-telemeter-client\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.193126 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.193058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjvmx\" (UniqueName: \"kubernetes.io/projected/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-kube-api-access-hjvmx\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.193126 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.193096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.193280 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.193131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-federate-client-tls\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.193280 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.193162    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-secret-telemeter-client\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.193280 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.193223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.193280 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.193254    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-serving-certs-ca-bundle\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.193507 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.193283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-telemeter-client-tls\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.193507 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.193319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-metrics-client-ca\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.194036 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.194016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-serving-certs-ca-bundle\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.194407 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.194338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-metrics-client-ca\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.194407 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.194373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.195964 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.195935    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-secret-telemeter-client\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.195964 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.195945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-federate-client-tls\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.196109 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.196050    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.196282 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.196264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-telemeter-client-tls\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.208286 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.208267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjvmx\" (UniqueName: \"kubernetes.io/projected/d4c4ef1c-c4a7-413b-b293-6905fed1d4fb-kube-api-access-hjvmx\") pod \"telemeter-client-6c96b8b6b6-hxv6l\" (UID: \"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb\") " pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.247372 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.247350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"
Sep 18 19:18:21.556945 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:21.556873    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l"]
Sep 18 19:18:21.559502 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:18:21.559482    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c4ef1c_c4a7_413b_b293_6905fed1d4fb.slice/crio-2e9da994dc8fa04d3766d609f0735c63d5063964eb3897cf09d45c4304e593f3 WatchSource:0}: Error finding container 2e9da994dc8fa04d3766d609f0735c63d5063964eb3897cf09d45c4304e593f3: Status 404 returned error can't find the container with id 2e9da994dc8fa04d3766d609f0735c63d5063964eb3897cf09d45c4304e593f3
Sep 18 19:18:22.459462 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:22.459422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l" event={"ID":"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb","Type":"ContainerStarted","Data":"2e9da994dc8fa04d3766d609f0735c63d5063964eb3897cf09d45c4304e593f3"}
Sep 18 19:18:24.470138 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.470098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l" event={"ID":"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb","Type":"ContainerStarted","Data":"ac76d572094da1b5052057e95c7fbe01e908222a4528af5e99fc3ad82961d04a"}
Sep 18 19:18:24.470558 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.470161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l" event={"ID":"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb","Type":"ContainerStarted","Data":"42a08d7a5381eabcb8135a93a3913455dace9e8e51962b42fb834d0e0269bc80"}
Sep 18 19:18:24.470558 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.470181    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l" event={"ID":"d4c4ef1c-c4a7-413b-b293-6905fed1d4fb","Type":"ContainerStarted","Data":"556998765b911b9280429aeae75ebbbb5c62b78461d2eab4e5121ffea19c87ee"}
Sep 18 19:18:24.709491 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.709440    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c96b8b6b6-hxv6l" podStartSLOduration=2.829757613 podStartE2EDuration="4.709421387s" totalImagesPullingTime="1.879663774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:18:24.52693285 +0000 UTC m=+268.171688170" watchObservedRunningTime="2026-09-18 19:18:24.709421387 +0000 UTC m=+268.354176706"
Sep 18 19:18:24.709928 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.709915    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c658f84ff-gmvfq"]
Sep 18 19:18:24.713304 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.713278    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.731678 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.731621    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 19:18:24.731793 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.731733    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 19:18:24.731892 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.731835    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 19:18:24.733205 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.733188    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 19:18:24.733309 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.733214    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 19:18:24.733309 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.733278    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jjztf\""
Sep 18 19:18:24.750095 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.750071    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c658f84ff-gmvfq"]
Sep 18 19:18:24.754068 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.754053    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 19:18:24.820889 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.820862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-service-ca\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.821045 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.820914    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-trusted-ca-bundle\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.821045 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.821004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-serving-cert\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.821045 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.821028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z26v8\" (UniqueName: \"kubernetes.io/projected/2c85bd99-ed58-4c67-8753-2fc621753ffc-kube-api-access-z26v8\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.821208 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.821053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-oauth-serving-cert\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.821208 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.821125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-oauth-config\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.821208 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.821149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-config\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.921739 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.921708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-oauth-config\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.921850 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.921743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-config\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.921850 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.921767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-service-ca\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.921850 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.921794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-trusted-ca-bundle\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.921850 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.921817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-serving-cert\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.921850 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.921831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z26v8\" (UniqueName: \"kubernetes.io/projected/2c85bd99-ed58-4c67-8753-2fc621753ffc-kube-api-access-z26v8\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.921850 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.921847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-oauth-serving-cert\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.922768 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.922745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-oauth-serving-cert\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.922863 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.922750    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-trusted-ca-bundle\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.922957 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.922937    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-service-ca\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.923025 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.922966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-config\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.924389 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.924354    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-oauth-config\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.924534 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.924517    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-serving-cert\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:24.938553 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:24.938533    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z26v8\" (UniqueName: \"kubernetes.io/projected/2c85bd99-ed58-4c67-8753-2fc621753ffc-kube-api-access-z26v8\") pod \"console-5c658f84ff-gmvfq\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") " pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:25.021951 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:25.021893    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:25.304052 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:25.304028    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c658f84ff-gmvfq"]
Sep 18 19:18:25.305887 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:18:25.305866    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c85bd99_ed58_4c67_8753_2fc621753ffc.slice/crio-1176a1ffc8d6669fc5f8c7fc77843e15a2df47344659b45f0c91b2a8d55dd3b7 WatchSource:0}: Error finding container 1176a1ffc8d6669fc5f8c7fc77843e15a2df47344659b45f0c91b2a8d55dd3b7: Status 404 returned error can't find the container with id 1176a1ffc8d6669fc5f8c7fc77843e15a2df47344659b45f0c91b2a8d55dd3b7
Sep 18 19:18:25.475645 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:25.475605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c658f84ff-gmvfq" event={"ID":"2c85bd99-ed58-4c67-8753-2fc621753ffc","Type":"ContainerStarted","Data":"9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244"}
Sep 18 19:18:25.476028 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:25.475663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c658f84ff-gmvfq" event={"ID":"2c85bd99-ed58-4c67-8753-2fc621753ffc","Type":"ContainerStarted","Data":"1176a1ffc8d6669fc5f8c7fc77843e15a2df47344659b45f0c91b2a8d55dd3b7"}
Sep 18 19:18:25.509190 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:25.509136    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c658f84ff-gmvfq" podStartSLOduration=1.509121671 podStartE2EDuration="1.509121671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:18:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:18:25.508239318 +0000 UTC m=+269.152994662" watchObservedRunningTime="2026-09-18 19:18:25.509121671 +0000 UTC m=+269.153876991"
Sep 18 19:18:35.022641 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:35.022605    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:35.023066 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:35.022660    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:35.027618 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:35.027593    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:35.519096 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:35.519069    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:18:58.265815 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:58.265778    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:18:58.271511 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:58.271483    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:18:58.276256 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:58.276232    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:18:58.280419 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:58.280399    2580 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 19:18:58.282826 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:18:58.282806    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:19:32.358891 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.358856    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66f5d5995c-z8swt"]
Sep 18 19:19:32.363355 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.363338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.382625 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.382602    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f5d5995c-z8swt"]
Sep 18 19:19:32.487274 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.487248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-service-ca\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.487274 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.487283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-oauth-serving-cert\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.487469 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.487404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgcvb\" (UniqueName: \"kubernetes.io/projected/b818e4b1-8801-4426-b8ae-c3376f94599f-kube-api-access-cgcvb\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.487469 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.487434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-oauth-config\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.487549 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.487472    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-trusted-ca-bundle\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.487549 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.487522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-serving-cert\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.487627 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.487565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-console-config\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.587842 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.587816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-trusted-ca-bundle\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.587954 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.587845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-serving-cert\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.587954 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.587878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-console-config\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.587954 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.587939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-service-ca\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.588117 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.588007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-oauth-serving-cert\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.588117 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.588039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgcvb\" (UniqueName: \"kubernetes.io/projected/b818e4b1-8801-4426-b8ae-c3376f94599f-kube-api-access-cgcvb\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.588117 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.588063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-oauth-config\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.588760 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.588672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-service-ca\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.588760 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.588733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-oauth-serving-cert\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.588760 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.588736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-trusted-ca-bundle\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.589095 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.589079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-console-config\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.590475 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.590451    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-serving-cert\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.590580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.590560    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-oauth-config\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.599508 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.599484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgcvb\" (UniqueName: \"kubernetes.io/projected/b818e4b1-8801-4426-b8ae-c3376f94599f-kube-api-access-cgcvb\") pod \"console-66f5d5995c-z8swt\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") " pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.673332 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.673282    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:32.966834 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:32.966649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f5d5995c-z8swt"]
Sep 18 19:19:32.969382 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:19:32.969357    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb818e4b1_8801_4426_b8ae_c3376f94599f.slice/crio-3805c83b0401379403e6d25db49ad178e4ffeb0f3fb376f5cea9f260c7332047 WatchSource:0}: Error finding container 3805c83b0401379403e6d25db49ad178e4ffeb0f3fb376f5cea9f260c7332047: Status 404 returned error can't find the container with id 3805c83b0401379403e6d25db49ad178e4ffeb0f3fb376f5cea9f260c7332047
Sep 18 19:19:33.750467 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:33.750430    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f5d5995c-z8swt" event={"ID":"b818e4b1-8801-4426-b8ae-c3376f94599f","Type":"ContainerStarted","Data":"4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc"}
Sep 18 19:19:33.750855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:33.750479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f5d5995c-z8swt" event={"ID":"b818e4b1-8801-4426-b8ae-c3376f94599f","Type":"ContainerStarted","Data":"3805c83b0401379403e6d25db49ad178e4ffeb0f3fb376f5cea9f260c7332047"}
Sep 18 19:19:33.773340 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:33.773298    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66f5d5995c-z8swt" podStartSLOduration=1.773281795 podStartE2EDuration="1.773281795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:19:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:19:33.771481629 +0000 UTC m=+337.416236951" watchObservedRunningTime="2026-09-18 19:19:33.773281795 +0000 UTC m=+337.418037114"
Sep 18 19:19:42.674040 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:42.673916    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:42.674040 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:42.674010    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:42.678938 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:42.678912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:42.794151 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:42.794127    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:19:42.855478 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:19:42.855452    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c658f84ff-gmvfq"]
Sep 18 19:20:07.880069 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:07.880024    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c658f84ff-gmvfq" podUID="2c85bd99-ed58-4c67-8753-2fc621753ffc" containerName="console" containerID="cri-o://9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244" gracePeriod=15
Sep 18 19:20:08.118807 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.118785    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:20:08.252923 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.252835    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z26v8\" (UniqueName: \"kubernetes.io/projected/2c85bd99-ed58-4c67-8753-2fc621753ffc-kube-api-access-z26v8\") pod \"2c85bd99-ed58-4c67-8753-2fc621753ffc\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") "
Sep 18 19:20:08.252923 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.252894    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-oauth-serving-cert\") pod \"2c85bd99-ed58-4c67-8753-2fc621753ffc\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") "
Sep 18 19:20:08.253169 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.252934    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-service-ca\") pod \"2c85bd99-ed58-4c67-8753-2fc621753ffc\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") "
Sep 18 19:20:08.253169 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.252958    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-trusted-ca-bundle\") pod \"2c85bd99-ed58-4c67-8753-2fc621753ffc\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") "
Sep 18 19:20:08.253169 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.252996    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-oauth-config\") pod \"2c85bd99-ed58-4c67-8753-2fc621753ffc\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") "
Sep 18 19:20:08.253169 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.253026    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-serving-cert\") pod \"2c85bd99-ed58-4c67-8753-2fc621753ffc\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") "
Sep 18 19:20:08.253169 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.253093    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-config\") pod \"2c85bd99-ed58-4c67-8753-2fc621753ffc\" (UID: \"2c85bd99-ed58-4c67-8753-2fc621753ffc\") "
Sep 18 19:20:08.253655 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.253405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-service-ca" (OuterVolumeSpecName: "service-ca") pod "2c85bd99-ed58-4c67-8753-2fc621753ffc" (UID: "2c85bd99-ed58-4c67-8753-2fc621753ffc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:20:08.253655 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.253425    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2c85bd99-ed58-4c67-8753-2fc621753ffc" (UID: "2c85bd99-ed58-4c67-8753-2fc621753ffc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:20:08.253655 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.253414    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2c85bd99-ed58-4c67-8753-2fc621753ffc" (UID: "2c85bd99-ed58-4c67-8753-2fc621753ffc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:20:08.253775 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.253666    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-config" (OuterVolumeSpecName: "console-config") pod "2c85bd99-ed58-4c67-8753-2fc621753ffc" (UID: "2c85bd99-ed58-4c67-8753-2fc621753ffc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:20:08.255270 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.255247    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2c85bd99-ed58-4c67-8753-2fc621753ffc" (UID: "2c85bd99-ed58-4c67-8753-2fc621753ffc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:20:08.255769 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.255745    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c85bd99-ed58-4c67-8753-2fc621753ffc-kube-api-access-z26v8" (OuterVolumeSpecName: "kube-api-access-z26v8") pod "2c85bd99-ed58-4c67-8753-2fc621753ffc" (UID: "2c85bd99-ed58-4c67-8753-2fc621753ffc"). InnerVolumeSpecName "kube-api-access-z26v8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:20:08.255769 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.255751    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2c85bd99-ed58-4c67-8753-2fc621753ffc" (UID: "2c85bd99-ed58-4c67-8753-2fc621753ffc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:20:08.354036 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.354002    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z26v8\" (UniqueName: \"kubernetes.io/projected/2c85bd99-ed58-4c67-8753-2fc621753ffc-kube-api-access-z26v8\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:20:08.354036 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.354034    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-oauth-serving-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:20:08.354036 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.354043    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-service-ca\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:20:08.354197 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.354052    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-trusted-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:20:08.354197 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.354060    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-oauth-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:20:08.354197 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.354069    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-serving-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:20:08.354197 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.354077    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c85bd99-ed58-4c67-8753-2fc621753ffc-console-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:20:08.901063 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.901028    2580 generic.go:356] "Generic (PLEG): container finished" podID="2c85bd99-ed58-4c67-8753-2fc621753ffc" containerID="9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244" exitCode=0
Sep 18 19:20:08.901443 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.901079    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c658f84ff-gmvfq"
Sep 18 19:20:08.901443 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.901078    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c658f84ff-gmvfq" event={"ID":"2c85bd99-ed58-4c67-8753-2fc621753ffc","Type":"ContainerDied","Data":"9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244"}
Sep 18 19:20:08.901443 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.901131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c658f84ff-gmvfq" event={"ID":"2c85bd99-ed58-4c67-8753-2fc621753ffc","Type":"ContainerDied","Data":"1176a1ffc8d6669fc5f8c7fc77843e15a2df47344659b45f0c91b2a8d55dd3b7"}
Sep 18 19:20:08.901443 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.901158    2580 scope.go:117] "RemoveContainer" containerID="9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244"
Sep 18 19:20:08.912096 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.912072    2580 scope.go:117] "RemoveContainer" containerID="9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244"
Sep 18 19:20:08.912563 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:20:08.912543    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244\": container with ID starting with 9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244 not found: ID does not exist" containerID="9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244"
Sep 18 19:20:08.912638 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.912573    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244"} err="failed to get container status \"9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244\": rpc error: code = NotFound desc = could not find container \"9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244\": container with ID starting with 9d1089dc627c39290bafb7fe054534c27eaa809b93328c0852c2ffde9c5ae244 not found: ID does not exist"
Sep 18 19:20:08.927835 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.927811    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c658f84ff-gmvfq"]
Sep 18 19:20:08.944718 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:08.944697    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c658f84ff-gmvfq"]
Sep 18 19:20:10.375033 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:10.375002    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c85bd99-ed58-4c67-8753-2fc621753ffc" path="/var/lib/kubelet/pods/2c85bd99-ed58-4c67-8753-2fc621753ffc/volumes"
Sep 18 19:20:48.822637 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.822599    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"]
Sep 18 19:20:48.823156 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.822910    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c85bd99-ed58-4c67-8753-2fc621753ffc" containerName="console"
Sep 18 19:20:48.823156 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.822921    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c85bd99-ed58-4c67-8753-2fc621753ffc" containerName="console"
Sep 18 19:20:48.823156 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.822993    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c85bd99-ed58-4c67-8753-2fc621753ffc" containerName="console"
Sep 18 19:20:48.826157 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.826140    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:20:48.831334 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.831304    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 19:20:48.832526 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.832504    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-br8f7\""
Sep 18 19:20:48.832640 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.832507    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 19:20:48.852792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.852757    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"]
Sep 18 19:20:48.932473 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.932448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:20:48.932566 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.932493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:20:48.932566 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:48.932530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sss4d\" (UniqueName: \"kubernetes.io/projected/c09d318d-246b-4375-9ba9-1043abafb1ed-kube-api-access-sss4d\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:20:49.033649 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:49.033623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:20:49.033745 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:49.033669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:20:49.033745 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:49.033696    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sss4d\" (UniqueName: \"kubernetes.io/projected/c09d318d-246b-4375-9ba9-1043abafb1ed-kube-api-access-sss4d\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:20:49.034090 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:49.034069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:20:49.034090 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:49.034080    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:20:49.047667 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:49.047637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sss4d\" (UniqueName: \"kubernetes.io/projected/c09d318d-246b-4375-9ba9-1043abafb1ed-kube-api-access-sss4d\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:20:49.136243 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:49.136225    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:20:49.420213 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:49.420132    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"]
Sep 18 19:20:49.423305 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:20:49.423251    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09d318d_246b_4375_9ba9_1043abafb1ed.slice/crio-418e42c67d6c7426b7e476e53e0a3091e3716bca58d4e5fb79adc916127d44cd WatchSource:0}: Error finding container 418e42c67d6c7426b7e476e53e0a3091e3716bca58d4e5fb79adc916127d44cd: Status 404 returned error can't find the container with id 418e42c67d6c7426b7e476e53e0a3091e3716bca58d4e5fb79adc916127d44cd
Sep 18 19:20:49.428387 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:49.428366    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 19:20:50.063899 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:50.063871    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw" event={"ID":"c09d318d-246b-4375-9ba9-1043abafb1ed","Type":"ContainerStarted","Data":"418e42c67d6c7426b7e476e53e0a3091e3716bca58d4e5fb79adc916127d44cd"}
Sep 18 19:20:56.091208 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:56.091169    2580 generic.go:356] "Generic (PLEG): container finished" podID="c09d318d-246b-4375-9ba9-1043abafb1ed" containerID="cb5494a43d0c805e679f7f6ddb1adf24c560d451f7ee7b6a95f245436c3c8e6e" exitCode=0
Sep 18 19:20:56.091532 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:56.091252    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw" event={"ID":"c09d318d-246b-4375-9ba9-1043abafb1ed","Type":"ContainerDied","Data":"cb5494a43d0c805e679f7f6ddb1adf24c560d451f7ee7b6a95f245436c3c8e6e"}
Sep 18 19:20:58.102018 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:58.101963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw" event={"ID":"c09d318d-246b-4375-9ba9-1043abafb1ed","Type":"ContainerStarted","Data":"c0329137c83af5def2937f7d2aa6574071c02ae6dfd7c212c5ad4246af981927"}
Sep 18 19:20:59.111660 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:59.111613    2580 generic.go:356] "Generic (PLEG): container finished" podID="c09d318d-246b-4375-9ba9-1043abafb1ed" containerID="c0329137c83af5def2937f7d2aa6574071c02ae6dfd7c212c5ad4246af981927" exitCode=0
Sep 18 19:20:59.112195 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:20:59.111691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw" event={"ID":"c09d318d-246b-4375-9ba9-1043abafb1ed","Type":"ContainerDied","Data":"c0329137c83af5def2937f7d2aa6574071c02ae6dfd7c212c5ad4246af981927"}
Sep 18 19:21:07.147886 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:07.147842    2580 generic.go:356] "Generic (PLEG): container finished" podID="c09d318d-246b-4375-9ba9-1043abafb1ed" containerID="03d2b8ad2ab6bf5f90e7760af4fb98b8dc9bffe7ecf767e6d945f9190ce5f4a3" exitCode=0
Sep 18 19:21:07.148308 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:07.147931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw" event={"ID":"c09d318d-246b-4375-9ba9-1043abafb1ed","Type":"ContainerDied","Data":"03d2b8ad2ab6bf5f90e7760af4fb98b8dc9bffe7ecf767e6d945f9190ce5f4a3"}
Sep 18 19:21:08.283148 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:08.283122    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:21:08.381336 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:08.381307    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-bundle\") pod \"c09d318d-246b-4375-9ba9-1043abafb1ed\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") "
Sep 18 19:21:08.381480 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:08.381371    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-util\") pod \"c09d318d-246b-4375-9ba9-1043abafb1ed\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") "
Sep 18 19:21:08.381480 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:08.381401    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sss4d\" (UniqueName: \"kubernetes.io/projected/c09d318d-246b-4375-9ba9-1043abafb1ed-kube-api-access-sss4d\") pod \"c09d318d-246b-4375-9ba9-1043abafb1ed\" (UID: \"c09d318d-246b-4375-9ba9-1043abafb1ed\") "
Sep 18 19:21:08.382105 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:08.382080    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-bundle" (OuterVolumeSpecName: "bundle") pod "c09d318d-246b-4375-9ba9-1043abafb1ed" (UID: "c09d318d-246b-4375-9ba9-1043abafb1ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:21:08.383647 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:08.383621    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c09d318d-246b-4375-9ba9-1043abafb1ed-kube-api-access-sss4d" (OuterVolumeSpecName: "kube-api-access-sss4d") pod "c09d318d-246b-4375-9ba9-1043abafb1ed" (UID: "c09d318d-246b-4375-9ba9-1043abafb1ed"). InnerVolumeSpecName "kube-api-access-sss4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:21:08.385673 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:08.385652    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-util" (OuterVolumeSpecName: "util") pod "c09d318d-246b-4375-9ba9-1043abafb1ed" (UID: "c09d318d-246b-4375-9ba9-1043abafb1ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:21:08.482677 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:08.482595    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-util\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:21:08.482677 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:08.482628    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sss4d\" (UniqueName: \"kubernetes.io/projected/c09d318d-246b-4375-9ba9-1043abafb1ed-kube-api-access-sss4d\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:21:08.482677 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:08.482639    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c09d318d-246b-4375-9ba9-1043abafb1ed-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:21:09.158343 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:09.158314    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw" event={"ID":"c09d318d-246b-4375-9ba9-1043abafb1ed","Type":"ContainerDied","Data":"418e42c67d6c7426b7e476e53e0a3091e3716bca58d4e5fb79adc916127d44cd"}
Sep 18 19:21:09.158487 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:09.158377    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="418e42c67d6c7426b7e476e53e0a3091e3716bca58d4e5fb79adc916127d44cd"
Sep 18 19:21:09.158487 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:09.158327    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1asn5mw"
Sep 18 19:21:13.474276 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.474241    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"]
Sep 18 19:21:13.474677 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.474539    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c09d318d-246b-4375-9ba9-1043abafb1ed" containerName="extract"
Sep 18 19:21:13.474677 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.474551    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c09d318d-246b-4375-9ba9-1043abafb1ed" containerName="extract"
Sep 18 19:21:13.474677 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.474570    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c09d318d-246b-4375-9ba9-1043abafb1ed" containerName="util"
Sep 18 19:21:13.474677 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.474577    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c09d318d-246b-4375-9ba9-1043abafb1ed" containerName="util"
Sep 18 19:21:13.474677 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.474592    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c09d318d-246b-4375-9ba9-1043abafb1ed" containerName="pull"
Sep 18 19:21:13.474677 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.474598    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c09d318d-246b-4375-9ba9-1043abafb1ed" containerName="pull"
Sep 18 19:21:13.474677 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.474650    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c09d318d-246b-4375-9ba9-1043abafb1ed" containerName="extract"
Sep 18 19:21:13.531683 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.531654    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"]
Sep 18 19:21:13.531825 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.531737    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"
Sep 18 19:21:13.537428 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.537397    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Sep 18 19:21:13.537722 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.537701    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-9pcsb\""
Sep 18 19:21:13.537822 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.537804    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Sep 18 19:21:13.538323 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.538060    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Sep 18 19:21:13.619051 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.619022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/cf8ceb76-5046-46c4-9b53-d83926dd446b-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dbklf\" (UID: \"cf8ceb76-5046-46c4-9b53-d83926dd446b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"
Sep 18 19:21:13.619162 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.619102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb4t8\" (UniqueName: \"kubernetes.io/projected/cf8ceb76-5046-46c4-9b53-d83926dd446b-kube-api-access-cb4t8\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dbklf\" (UID: \"cf8ceb76-5046-46c4-9b53-d83926dd446b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"
Sep 18 19:21:13.719851 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.719820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb4t8\" (UniqueName: \"kubernetes.io/projected/cf8ceb76-5046-46c4-9b53-d83926dd446b-kube-api-access-cb4t8\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dbklf\" (UID: \"cf8ceb76-5046-46c4-9b53-d83926dd446b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"
Sep 18 19:21:13.720008 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.719862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/cf8ceb76-5046-46c4-9b53-d83926dd446b-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dbklf\" (UID: \"cf8ceb76-5046-46c4-9b53-d83926dd446b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"
Sep 18 19:21:13.722372 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.722349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/cf8ceb76-5046-46c4-9b53-d83926dd446b-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dbklf\" (UID: \"cf8ceb76-5046-46c4-9b53-d83926dd446b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"
Sep 18 19:21:13.734272 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.734216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb4t8\" (UniqueName: \"kubernetes.io/projected/cf8ceb76-5046-46c4-9b53-d83926dd446b-kube-api-access-cb4t8\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dbklf\" (UID: \"cf8ceb76-5046-46c4-9b53-d83926dd446b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"
Sep 18 19:21:13.842586 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:13.842555    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"
Sep 18 19:21:14.166201 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:14.166174    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"]
Sep 18 19:21:14.169952 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:21:14.169923    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8ceb76_5046_46c4_9b53_d83926dd446b.slice/crio-35962e97e04a3c5220e2e3b8b46370e992fa6e46e883fd9999674c10ab25dd49 WatchSource:0}: Error finding container 35962e97e04a3c5220e2e3b8b46370e992fa6e46e883fd9999674c10ab25dd49: Status 404 returned error can't find the container with id 35962e97e04a3c5220e2e3b8b46370e992fa6e46e883fd9999674c10ab25dd49
Sep 18 19:21:14.184300 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:14.184270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf" event={"ID":"cf8ceb76-5046-46c4-9b53-d83926dd446b","Type":"ContainerStarted","Data":"35962e97e04a3c5220e2e3b8b46370e992fa6e46e883fd9999674c10ab25dd49"}
Sep 18 19:21:18.168465 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.168421    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-sgsk2"]
Sep 18 19:21:18.171911 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.171889    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:18.174820 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.174801    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-lns52\""
Sep 18 19:21:18.174918 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.174827    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Sep 18 19:21:18.174918 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.174804    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Sep 18 19:21:18.181158 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.181139    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-sgsk2"]
Sep 18 19:21:18.204891 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.204861    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf" event={"ID":"cf8ceb76-5046-46c4-9b53-d83926dd446b","Type":"ContainerStarted","Data":"e3415bb38772958dc19e03bb40092cd1d78100b68fb7eb22b77d476339068f49"}
Sep 18 19:21:18.205023 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.205009    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"
Sep 18 19:21:18.229218 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.229176    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf" podStartSLOduration=2.024156368 podStartE2EDuration="5.229162807s" totalImagesPullingTime="3.205006439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:21:18.228026389 +0000 UTC m=+441.872781727" watchObservedRunningTime="2026-09-18 19:21:18.229162807 +0000 UTC m=+441.873918127"
Sep 18 19:21:18.254610 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.254591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ab6e4e78-989d-4e86-9d07-f45020094df9-certificates\") pod \"keda-operator-579c8958f7-sgsk2\" (UID: \"ab6e4e78-989d-4e86-9d07-f45020094df9\") " pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:18.254717 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.254615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/ab6e4e78-989d-4e86-9d07-f45020094df9-cabundle0\") pod \"keda-operator-579c8958f7-sgsk2\" (UID: \"ab6e4e78-989d-4e86-9d07-f45020094df9\") " pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:18.254717 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.254652    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4w9m\" (UniqueName: \"kubernetes.io/projected/ab6e4e78-989d-4e86-9d07-f45020094df9-kube-api-access-c4w9m\") pod \"keda-operator-579c8958f7-sgsk2\" (UID: \"ab6e4e78-989d-4e86-9d07-f45020094df9\") " pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:18.355920 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.355900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ab6e4e78-989d-4e86-9d07-f45020094df9-certificates\") pod \"keda-operator-579c8958f7-sgsk2\" (UID: \"ab6e4e78-989d-4e86-9d07-f45020094df9\") " pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:18.356046 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.355925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/ab6e4e78-989d-4e86-9d07-f45020094df9-cabundle0\") pod \"keda-operator-579c8958f7-sgsk2\" (UID: \"ab6e4e78-989d-4e86-9d07-f45020094df9\") " pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:18.356046 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.355994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4w9m\" (UniqueName: \"kubernetes.io/projected/ab6e4e78-989d-4e86-9d07-f45020094df9-kube-api-access-c4w9m\") pod \"keda-operator-579c8958f7-sgsk2\" (UID: \"ab6e4e78-989d-4e86-9d07-f45020094df9\") " pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:18.356128 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:21:18.356065    2580 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Sep 18 19:21:18.356128 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:21:18.356088    2580 secret.go:281] references non-existent secret key: ca.crt
Sep 18 19:21:18.356128 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:21:18.356099    2580 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Sep 18 19:21:18.356128 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:21:18.356113    2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-sgsk2: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Sep 18 19:21:18.356263 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:21:18.356182    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab6e4e78-989d-4e86-9d07-f45020094df9-certificates podName:ab6e4e78-989d-4e86-9d07-f45020094df9 nodeName:}" failed. No retries permitted until 2026-09-18 19:21:18.856164765 +0000 UTC m=+442.500920083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ab6e4e78-989d-4e86-9d07-f45020094df9-certificates") pod "keda-operator-579c8958f7-sgsk2" (UID: "ab6e4e78-989d-4e86-9d07-f45020094df9") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Sep 18 19:21:18.356651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.356636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/ab6e4e78-989d-4e86-9d07-f45020094df9-cabundle0\") pod \"keda-operator-579c8958f7-sgsk2\" (UID: \"ab6e4e78-989d-4e86-9d07-f45020094df9\") " pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:18.366154 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.366135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4w9m\" (UniqueName: \"kubernetes.io/projected/ab6e4e78-989d-4e86-9d07-f45020094df9-kube-api-access-c4w9m\") pod \"keda-operator-579c8958f7-sgsk2\" (UID: \"ab6e4e78-989d-4e86-9d07-f45020094df9\") " pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:18.383823 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.383800    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"]
Sep 18 19:21:18.389767 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.389749    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:18.392560 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.392541    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Sep 18 19:21:18.398583 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.398554    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"]
Sep 18 19:21:18.456391 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.456341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/58d644d3-cd1d-4748-9908-6997997bd5b2-certificates\") pod \"keda-metrics-apiserver-77857b7b98-8dk2c\" (UID: \"58d644d3-cd1d-4748-9908-6997997bd5b2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:18.456391 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.456387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/58d644d3-cd1d-4748-9908-6997997bd5b2-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-8dk2c\" (UID: \"58d644d3-cd1d-4748-9908-6997997bd5b2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:18.456509 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.456439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67hrg\" (UniqueName: \"kubernetes.io/projected/58d644d3-cd1d-4748-9908-6997997bd5b2-kube-api-access-67hrg\") pod \"keda-metrics-apiserver-77857b7b98-8dk2c\" (UID: \"58d644d3-cd1d-4748-9908-6997997bd5b2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:18.557561 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.557538    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/58d644d3-cd1d-4748-9908-6997997bd5b2-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-8dk2c\" (UID: \"58d644d3-cd1d-4748-9908-6997997bd5b2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:18.557650 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.557582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67hrg\" (UniqueName: \"kubernetes.io/projected/58d644d3-cd1d-4748-9908-6997997bd5b2-kube-api-access-67hrg\") pod \"keda-metrics-apiserver-77857b7b98-8dk2c\" (UID: \"58d644d3-cd1d-4748-9908-6997997bd5b2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:18.557650 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.557636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/58d644d3-cd1d-4748-9908-6997997bd5b2-certificates\") pod \"keda-metrics-apiserver-77857b7b98-8dk2c\" (UID: \"58d644d3-cd1d-4748-9908-6997997bd5b2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:18.557763 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:21:18.557749    2580 secret.go:281] references non-existent secret key: tls.crt
Sep 18 19:21:18.557798 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:21:18.557772    2580 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Sep 18 19:21:18.557798 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:21:18.557793    2580 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found
Sep 18 19:21:18.557860 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:21:18.557814    2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
Sep 18 19:21:18.557899 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:21:18.557868    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58d644d3-cd1d-4748-9908-6997997bd5b2-certificates podName:58d644d3-cd1d-4748-9908-6997997bd5b2 nodeName:}" failed. No retries permitted until 2026-09-18 19:21:19.057851846 +0000 UTC m=+442.702607147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/58d644d3-cd1d-4748-9908-6997997bd5b2-certificates") pod "keda-metrics-apiserver-77857b7b98-8dk2c" (UID: "58d644d3-cd1d-4748-9908-6997997bd5b2") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
Sep 18 19:21:18.557949 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.557917    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/58d644d3-cd1d-4748-9908-6997997bd5b2-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-8dk2c\" (UID: \"58d644d3-cd1d-4748-9908-6997997bd5b2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:18.577431 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.577407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67hrg\" (UniqueName: \"kubernetes.io/projected/58d644d3-cd1d-4748-9908-6997997bd5b2-kube-api-access-67hrg\") pod \"keda-metrics-apiserver-77857b7b98-8dk2c\" (UID: \"58d644d3-cd1d-4748-9908-6997997bd5b2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:18.860855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.860828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ab6e4e78-989d-4e86-9d07-f45020094df9-certificates\") pod \"keda-operator-579c8958f7-sgsk2\" (UID: \"ab6e4e78-989d-4e86-9d07-f45020094df9\") " pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:18.863195 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:18.863173    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ab6e4e78-989d-4e86-9d07-f45020094df9-certificates\") pod \"keda-operator-579c8958f7-sgsk2\" (UID: \"ab6e4e78-989d-4e86-9d07-f45020094df9\") " pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:19.061862 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:19.061838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/58d644d3-cd1d-4748-9908-6997997bd5b2-certificates\") pod \"keda-metrics-apiserver-77857b7b98-8dk2c\" (UID: \"58d644d3-cd1d-4748-9908-6997997bd5b2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:19.064299 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:19.064282    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/58d644d3-cd1d-4748-9908-6997997bd5b2-certificates\") pod \"keda-metrics-apiserver-77857b7b98-8dk2c\" (UID: \"58d644d3-cd1d-4748-9908-6997997bd5b2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:19.083061 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:19.083040    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:19.300914 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:19.300880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:19.366532 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:19.366511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-sgsk2"]
Sep 18 19:21:19.369037 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:21:19.369000    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6e4e78_989d_4e86_9d07_f45020094df9.slice/crio-459a830e8a1704d03cfbc3e0629bcdd3004f57d5398bd9fceeb595c10e7e18dc WatchSource:0}: Error finding container 459a830e8a1704d03cfbc3e0629bcdd3004f57d5398bd9fceeb595c10e7e18dc: Status 404 returned error can't find the container with id 459a830e8a1704d03cfbc3e0629bcdd3004f57d5398bd9fceeb595c10e7e18dc
Sep 18 19:21:19.641384 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:19.641363    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"]
Sep 18 19:21:19.643008 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:21:19.642966    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d644d3_cd1d_4748_9908_6997997bd5b2.slice/crio-9c36b6a7a4dd209e4d404df9c71f00fcbbc497240d6bb7f0a2bf49cba6ce3e02 WatchSource:0}: Error finding container 9c36b6a7a4dd209e4d404df9c71f00fcbbc497240d6bb7f0a2bf49cba6ce3e02: Status 404 returned error can't find the container with id 9c36b6a7a4dd209e4d404df9c71f00fcbbc497240d6bb7f0a2bf49cba6ce3e02
Sep 18 19:21:20.215525 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:20.215487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c" event={"ID":"58d644d3-cd1d-4748-9908-6997997bd5b2","Type":"ContainerStarted","Data":"9c36b6a7a4dd209e4d404df9c71f00fcbbc497240d6bb7f0a2bf49cba6ce3e02"}
Sep 18 19:21:20.216990 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:20.216938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-sgsk2" event={"ID":"ab6e4e78-989d-4e86-9d07-f45020094df9","Type":"ContainerStarted","Data":"459a830e8a1704d03cfbc3e0629bcdd3004f57d5398bd9fceeb595c10e7e18dc"}
Sep 18 19:21:24.236571 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:24.236536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c" event={"ID":"58d644d3-cd1d-4748-9908-6997997bd5b2","Type":"ContainerStarted","Data":"b38a221d5411c00676069293626e957c6bc2941df6e3362c261d4084a2511600"}
Sep 18 19:21:24.237036 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:24.236757    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:24.238402 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:24.238378    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-sgsk2" event={"ID":"ab6e4e78-989d-4e86-9d07-f45020094df9","Type":"ContainerStarted","Data":"adf38615e851fcc3ad9348cd79549ca4b4680885c2c980ed089c4f24c42c7dd2"}
Sep 18 19:21:24.238513 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:24.238467    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:21:24.271936 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:24.271896    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c" podStartSLOduration=2.677048244 podStartE2EDuration="6.271882344s" totalImagesPullingTime="3.5948341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:21:24.271171317 +0000 UTC m=+447.915926655" watchObservedRunningTime="2026-09-18 19:21:24.271882344 +0000 UTC m=+447.916637665"
Sep 18 19:21:24.318995 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:24.318908    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-sgsk2" podStartSLOduration=2.4444596020000002 podStartE2EDuration="6.318895392s" totalImagesPullingTime="3.87443579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:21:24.317333364 +0000 UTC m=+447.962088709" watchObservedRunningTime="2026-09-18 19:21:24.318895392 +0000 UTC m=+447.963650727"
Sep 18 19:21:35.248534 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:35.248507    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8dk2c"
Sep 18 19:21:39.211213 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:39.211185    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dbklf"
Sep 18 19:21:45.244671 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:21:45.244641    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-sgsk2"
Sep 18 19:22:09.246923 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:09.246887    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f5d5995c-z8swt"]
Sep 18 19:22:34.267375 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.267308    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66f5d5995c-z8swt" podUID="b818e4b1-8801-4426-b8ae-c3376f94599f" containerName="console" containerID="cri-o://4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc" gracePeriod=15
Sep 18 19:22:34.509713 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.509689    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:22:34.560931 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.560856    2580 generic.go:356] "Generic (PLEG): container finished" podID="b818e4b1-8801-4426-b8ae-c3376f94599f" containerID="4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc" exitCode=0
Sep 18 19:22:34.560931 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.560897    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f5d5995c-z8swt"
Sep 18 19:22:34.561102 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.560945    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f5d5995c-z8swt" event={"ID":"b818e4b1-8801-4426-b8ae-c3376f94599f","Type":"ContainerDied","Data":"4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc"}
Sep 18 19:22:34.561102 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.561017    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f5d5995c-z8swt" event={"ID":"b818e4b1-8801-4426-b8ae-c3376f94599f","Type":"ContainerDied","Data":"3805c83b0401379403e6d25db49ad178e4ffeb0f3fb376f5cea9f260c7332047"}
Sep 18 19:22:34.561102 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.561039    2580 scope.go:117] "RemoveContainer" containerID="4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc"
Sep 18 19:22:34.569888 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.569868    2580 scope.go:117] "RemoveContainer" containerID="4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc"
Sep 18 19:22:34.570556 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:22:34.570486    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc\": container with ID starting with 4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc not found: ID does not exist" containerID="4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc"
Sep 18 19:22:34.570556 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.570520    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc"} err="failed to get container status \"4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc\": rpc error: code = NotFound desc = could not find container \"4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc\": container with ID starting with 4fe7ae55e5b3b3955df2c4f18f555006e084c6011067cedb491021314e6793cc not found: ID does not exist"
Sep 18 19:22:34.701281 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.701260    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-trusted-ca-bundle\") pod \"b818e4b1-8801-4426-b8ae-c3376f94599f\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") "
Sep 18 19:22:34.701377 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.701314    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-service-ca\") pod \"b818e4b1-8801-4426-b8ae-c3376f94599f\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") "
Sep 18 19:22:34.701377 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.701334    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-oauth-config\") pod \"b818e4b1-8801-4426-b8ae-c3376f94599f\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") "
Sep 18 19:22:34.701377 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.701354    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-serving-cert\") pod \"b818e4b1-8801-4426-b8ae-c3376f94599f\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") "
Sep 18 19:22:34.701377 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.701375    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-console-config\") pod \"b818e4b1-8801-4426-b8ae-c3376f94599f\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") "
Sep 18 19:22:34.701576 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.701397    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-oauth-serving-cert\") pod \"b818e4b1-8801-4426-b8ae-c3376f94599f\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") "
Sep 18 19:22:34.701576 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.701415    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgcvb\" (UniqueName: \"kubernetes.io/projected/b818e4b1-8801-4426-b8ae-c3376f94599f-kube-api-access-cgcvb\") pod \"b818e4b1-8801-4426-b8ae-c3376f94599f\" (UID: \"b818e4b1-8801-4426-b8ae-c3376f94599f\") "
Sep 18 19:22:34.701735 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.701709    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-service-ca" (OuterVolumeSpecName: "service-ca") pod "b818e4b1-8801-4426-b8ae-c3376f94599f" (UID: "b818e4b1-8801-4426-b8ae-c3376f94599f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:22:34.701798 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.701742    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b818e4b1-8801-4426-b8ae-c3376f94599f" (UID: "b818e4b1-8801-4426-b8ae-c3376f94599f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:22:34.701798 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.701769    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-console-config" (OuterVolumeSpecName: "console-config") pod "b818e4b1-8801-4426-b8ae-c3376f94599f" (UID: "b818e4b1-8801-4426-b8ae-c3376f94599f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:22:34.701871 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.701809    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b818e4b1-8801-4426-b8ae-c3376f94599f" (UID: "b818e4b1-8801-4426-b8ae-c3376f94599f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:22:34.703586 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.703565    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b818e4b1-8801-4426-b8ae-c3376f94599f-kube-api-access-cgcvb" (OuterVolumeSpecName: "kube-api-access-cgcvb") pod "b818e4b1-8801-4426-b8ae-c3376f94599f" (UID: "b818e4b1-8801-4426-b8ae-c3376f94599f"). InnerVolumeSpecName "kube-api-access-cgcvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:22:34.703722 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.703698    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b818e4b1-8801-4426-b8ae-c3376f94599f" (UID: "b818e4b1-8801-4426-b8ae-c3376f94599f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:22:34.703811 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.703776    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b818e4b1-8801-4426-b8ae-c3376f94599f" (UID: "b818e4b1-8801-4426-b8ae-c3376f94599f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:22:34.802081 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.802057    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-service-ca\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:22:34.802081 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.802078    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-oauth-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:22:34.802197 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.802087    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b818e4b1-8801-4426-b8ae-c3376f94599f-console-serving-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:22:34.802197 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.802095    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-console-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:22:34.802197 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.802103    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-oauth-serving-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:22:34.802197 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.802110    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgcvb\" (UniqueName: \"kubernetes.io/projected/b818e4b1-8801-4426-b8ae-c3376f94599f-kube-api-access-cgcvb\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:22:34.802197 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.802121    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b818e4b1-8801-4426-b8ae-c3376f94599f-trusted-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:22:34.907019 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.906998    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f5d5995c-z8swt"]
Sep 18 19:22:34.917217 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:34.917198    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66f5d5995c-z8swt"]
Sep 18 19:22:36.376388 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:36.376352    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b818e4b1-8801-4426-b8ae-c3376f94599f" path="/var/lib/kubelet/pods/b818e4b1-8801-4426-b8ae-c3376f94599f/volumes"
Sep 18 19:22:46.161455 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.161368    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"]
Sep 18 19:22:46.162035 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.161813    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b818e4b1-8801-4426-b8ae-c3376f94599f" containerName="console"
Sep 18 19:22:46.162035 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.161831    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b818e4b1-8801-4426-b8ae-c3376f94599f" containerName="console"
Sep 18 19:22:46.162035 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.161930    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b818e4b1-8801-4426-b8ae-c3376f94599f" containerName="console"
Sep 18 19:22:46.164987 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.164951    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:22:46.168156 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.168128    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 18 19:22:46.168249 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.168169    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-r9hv8\""
Sep 18 19:22:46.168341 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.168320    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"]
Sep 18 19:22:46.168695 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.168664    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Sep 18 19:22:46.168808 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.168789    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 18 19:22:46.171484 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.171463    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"
Sep 18 19:22:46.173814 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.173794    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-48mkd\""
Sep 18 19:22:46.174847 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.174830    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Sep 18 19:22:46.181416 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.181390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3b67cd5-6d33-4c29-829d-0963c625ca4f-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-62r6c\" (UID: \"e3b67cd5-6d33-4c29-829d-0963c625ca4f\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"
Sep 18 19:22:46.181512 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.181429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xffp6\" (UniqueName: \"kubernetes.io/projected/a83cd822-00a1-49a7-b092-6cb10bf1ddce-kube-api-access-xffp6\") pod \"kserve-controller-manager-5ccfd4fdb4-jmc7r\" (UID: \"a83cd822-00a1-49a7-b092-6cb10bf1ddce\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:22:46.181512 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.181449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a83cd822-00a1-49a7-b092-6cb10bf1ddce-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-jmc7r\" (UID: \"a83cd822-00a1-49a7-b092-6cb10bf1ddce\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:22:46.181690 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.181517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqjr6\" (UniqueName: \"kubernetes.io/projected/e3b67cd5-6d33-4c29-829d-0963c625ca4f-kube-api-access-pqjr6\") pod \"llmisvc-controller-manager-645f9c8fd6-62r6c\" (UID: \"e3b67cd5-6d33-4c29-829d-0963c625ca4f\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"
Sep 18 19:22:46.187046 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.186952    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"]
Sep 18 19:22:46.188591 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.188572    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"]
Sep 18 19:22:46.282832 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.282806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3b67cd5-6d33-4c29-829d-0963c625ca4f-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-62r6c\" (UID: \"e3b67cd5-6d33-4c29-829d-0963c625ca4f\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"
Sep 18 19:22:46.282930 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.282840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xffp6\" (UniqueName: \"kubernetes.io/projected/a83cd822-00a1-49a7-b092-6cb10bf1ddce-kube-api-access-xffp6\") pod \"kserve-controller-manager-5ccfd4fdb4-jmc7r\" (UID: \"a83cd822-00a1-49a7-b092-6cb10bf1ddce\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:22:46.282930 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.282857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a83cd822-00a1-49a7-b092-6cb10bf1ddce-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-jmc7r\" (UID: \"a83cd822-00a1-49a7-b092-6cb10bf1ddce\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:22:46.282930 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.282889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqjr6\" (UniqueName: \"kubernetes.io/projected/e3b67cd5-6d33-4c29-829d-0963c625ca4f-kube-api-access-pqjr6\") pod \"llmisvc-controller-manager-645f9c8fd6-62r6c\" (UID: \"e3b67cd5-6d33-4c29-829d-0963c625ca4f\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"
Sep 18 19:22:46.283066 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:22:46.282959    2580 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 18 19:22:46.283066 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:22:46.283052    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b67cd5-6d33-4c29-829d-0963c625ca4f-cert podName:e3b67cd5-6d33-4c29-829d-0963c625ca4f nodeName:}" failed. No retries permitted until 2026-09-18 19:22:46.783037701 +0000 UTC m=+530.427793000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e3b67cd5-6d33-4c29-829d-0963c625ca4f-cert") pod "llmisvc-controller-manager-645f9c8fd6-62r6c" (UID: "e3b67cd5-6d33-4c29-829d-0963c625ca4f") : secret "llmisvc-webhook-server-cert" not found
Sep 18 19:22:46.283143 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:22:46.282964    2580 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 18 19:22:46.283143 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:22:46.283123    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a83cd822-00a1-49a7-b092-6cb10bf1ddce-cert podName:a83cd822-00a1-49a7-b092-6cb10bf1ddce nodeName:}" failed. No retries permitted until 2026-09-18 19:22:46.783104462 +0000 UTC m=+530.427859763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a83cd822-00a1-49a7-b092-6cb10bf1ddce-cert") pod "kserve-controller-manager-5ccfd4fdb4-jmc7r" (UID: "a83cd822-00a1-49a7-b092-6cb10bf1ddce") : secret "kserve-webhook-server-cert" not found
Sep 18 19:22:46.296419 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.296387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xffp6\" (UniqueName: \"kubernetes.io/projected/a83cd822-00a1-49a7-b092-6cb10bf1ddce-kube-api-access-xffp6\") pod \"kserve-controller-manager-5ccfd4fdb4-jmc7r\" (UID: \"a83cd822-00a1-49a7-b092-6cb10bf1ddce\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:22:46.297213 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.297191    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqjr6\" (UniqueName: \"kubernetes.io/projected/e3b67cd5-6d33-4c29-829d-0963c625ca4f-kube-api-access-pqjr6\") pod \"llmisvc-controller-manager-645f9c8fd6-62r6c\" (UID: \"e3b67cd5-6d33-4c29-829d-0963c625ca4f\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"
Sep 18 19:22:46.786697 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.786671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3b67cd5-6d33-4c29-829d-0963c625ca4f-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-62r6c\" (UID: \"e3b67cd5-6d33-4c29-829d-0963c625ca4f\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"
Sep 18 19:22:46.786829 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.786708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a83cd822-00a1-49a7-b092-6cb10bf1ddce-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-jmc7r\" (UID: \"a83cd822-00a1-49a7-b092-6cb10bf1ddce\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:22:46.789230 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.789204    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a83cd822-00a1-49a7-b092-6cb10bf1ddce-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-jmc7r\" (UID: \"a83cd822-00a1-49a7-b092-6cb10bf1ddce\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:22:46.789326 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:46.789281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3b67cd5-6d33-4c29-829d-0963c625ca4f-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-62r6c\" (UID: \"e3b67cd5-6d33-4c29-829d-0963c625ca4f\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"
Sep 18 19:22:47.076185 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:47.076130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:22:47.083250 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:47.083232    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"
Sep 18 19:22:47.365490 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:47.365465    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"]
Sep 18 19:22:47.367373 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:22:47.367348    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda83cd822_00a1_49a7_b092_6cb10bf1ddce.slice/crio-710d0803c33f8a40b74eb26d75d1d8a60d0b9360d94feaf1506d23127bc8ed68 WatchSource:0}: Error finding container 710d0803c33f8a40b74eb26d75d1d8a60d0b9360d94feaf1506d23127bc8ed68: Status 404 returned error can't find the container with id 710d0803c33f8a40b74eb26d75d1d8a60d0b9360d94feaf1506d23127bc8ed68
Sep 18 19:22:47.374914 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:47.374895    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"]
Sep 18 19:22:47.377459 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:22:47.377428    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode3b67cd5_6d33_4c29_829d_0963c625ca4f.slice/crio-16244d9d96802475234357c143e1ab8896ef14005e2dbb4e68b73b868623580f WatchSource:0}: Error finding container 16244d9d96802475234357c143e1ab8896ef14005e2dbb4e68b73b868623580f: Status 404 returned error can't find the container with id 16244d9d96802475234357c143e1ab8896ef14005e2dbb4e68b73b868623580f
Sep 18 19:22:47.628540 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:47.628466    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r" event={"ID":"a83cd822-00a1-49a7-b092-6cb10bf1ddce","Type":"ContainerStarted","Data":"710d0803c33f8a40b74eb26d75d1d8a60d0b9360d94feaf1506d23127bc8ed68"}
Sep 18 19:22:47.629731 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:47.629708    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c" event={"ID":"e3b67cd5-6d33-4c29-829d-0963c625ca4f","Type":"ContainerStarted","Data":"16244d9d96802475234357c143e1ab8896ef14005e2dbb4e68b73b868623580f"}
Sep 18 19:22:50.650947 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:50.650916    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r" event={"ID":"a83cd822-00a1-49a7-b092-6cb10bf1ddce","Type":"ContainerStarted","Data":"00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1"}
Sep 18 19:22:50.651254 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:50.651050    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:22:51.656518 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:51.656481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c" event={"ID":"e3b67cd5-6d33-4c29-829d-0963c625ca4f","Type":"ContainerStarted","Data":"d613e2457cd52e03b4b129a5518a633116a5135bc61f88ce7f95fdcb3ab8cd11"}
Sep 18 19:22:51.657013 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:51.656633    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"
Sep 18 19:22:51.675268 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:51.675217    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c" podStartSLOduration=2.50273884 podStartE2EDuration="5.675203955s" totalImagesPullingTime="3.172465115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:22:51.674358418 +0000 UTC m=+535.319113763" watchObservedRunningTime="2026-09-18 19:22:51.675203955 +0000 UTC m=+535.319959274"
Sep 18 19:22:51.675935 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:22:51.675883    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r" podStartSLOduration=2.4954207090000002 podStartE2EDuration="5.675869268s" totalImagesPullingTime="3.180448559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:22:50.669948574 +0000 UTC m=+534.314703891" watchObservedRunningTime="2026-09-18 19:22:51.675869268 +0000 UTC m=+535.320624632"
Sep 18 19:23:21.662004 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:21.661945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:23:22.663074 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:22.663039    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-62r6c"
Sep 18 19:23:33.269203 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.269159    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"]
Sep 18 19:23:33.269687 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.269363    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r" podUID="a83cd822-00a1-49a7-b092-6cb10bf1ddce" containerName="manager" containerID="cri-o://00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1" gracePeriod=10
Sep 18 19:23:33.297211 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.297181    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"]
Sep 18 19:23:33.300573 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.300547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"
Sep 18 19:23:33.318200 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.318140    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"]
Sep 18 19:23:33.418182 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.418150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7a5670a-ccf9-4ec8-9f92-5a51af13d981-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-fdqwf\" (UID: \"c7a5670a-ccf9-4ec8-9f92-5a51af13d981\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"
Sep 18 19:23:33.418330 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.418244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx68g\" (UniqueName: \"kubernetes.io/projected/c7a5670a-ccf9-4ec8-9f92-5a51af13d981-kube-api-access-bx68g\") pod \"kserve-controller-manager-5ccfd4fdb4-fdqwf\" (UID: \"c7a5670a-ccf9-4ec8-9f92-5a51af13d981\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"
Sep 18 19:23:33.515286 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.515265    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:23:33.519535 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.519495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7a5670a-ccf9-4ec8-9f92-5a51af13d981-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-fdqwf\" (UID: \"c7a5670a-ccf9-4ec8-9f92-5a51af13d981\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"
Sep 18 19:23:33.519597 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.519558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx68g\" (UniqueName: \"kubernetes.io/projected/c7a5670a-ccf9-4ec8-9f92-5a51af13d981-kube-api-access-bx68g\") pod \"kserve-controller-manager-5ccfd4fdb4-fdqwf\" (UID: \"c7a5670a-ccf9-4ec8-9f92-5a51af13d981\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"
Sep 18 19:23:33.521787 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.521761    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7a5670a-ccf9-4ec8-9f92-5a51af13d981-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-fdqwf\" (UID: \"c7a5670a-ccf9-4ec8-9f92-5a51af13d981\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"
Sep 18 19:23:33.530319 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.530301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx68g\" (UniqueName: \"kubernetes.io/projected/c7a5670a-ccf9-4ec8-9f92-5a51af13d981-kube-api-access-bx68g\") pod \"kserve-controller-manager-5ccfd4fdb4-fdqwf\" (UID: \"c7a5670a-ccf9-4ec8-9f92-5a51af13d981\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"
Sep 18 19:23:33.620111 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.620081    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xffp6\" (UniqueName: \"kubernetes.io/projected/a83cd822-00a1-49a7-b092-6cb10bf1ddce-kube-api-access-xffp6\") pod \"a83cd822-00a1-49a7-b092-6cb10bf1ddce\" (UID: \"a83cd822-00a1-49a7-b092-6cb10bf1ddce\") "
Sep 18 19:23:33.620249 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.620162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a83cd822-00a1-49a7-b092-6cb10bf1ddce-cert\") pod \"a83cd822-00a1-49a7-b092-6cb10bf1ddce\" (UID: \"a83cd822-00a1-49a7-b092-6cb10bf1ddce\") "
Sep 18 19:23:33.622183 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.622159    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a83cd822-00a1-49a7-b092-6cb10bf1ddce-cert" (OuterVolumeSpecName: "cert") pod "a83cd822-00a1-49a7-b092-6cb10bf1ddce" (UID: "a83cd822-00a1-49a7-b092-6cb10bf1ddce"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:23:33.622269 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.622211    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a83cd822-00a1-49a7-b092-6cb10bf1ddce-kube-api-access-xffp6" (OuterVolumeSpecName: "kube-api-access-xffp6") pod "a83cd822-00a1-49a7-b092-6cb10bf1ddce" (UID: "a83cd822-00a1-49a7-b092-6cb10bf1ddce"). InnerVolumeSpecName "kube-api-access-xffp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:23:33.643518 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.643496    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"
Sep 18 19:23:33.721599 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.721572    2580 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a83cd822-00a1-49a7-b092-6cb10bf1ddce-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:23:33.721599 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.721599    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xffp6\" (UniqueName: \"kubernetes.io/projected/a83cd822-00a1-49a7-b092-6cb10bf1ddce-kube-api-access-xffp6\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:23:33.840472 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.840440    2580 generic.go:356] "Generic (PLEG): container finished" podID="a83cd822-00a1-49a7-b092-6cb10bf1ddce" containerID="00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1" exitCode=0
Sep 18 19:23:33.840627 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.840490    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"
Sep 18 19:23:33.840627 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.840524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r" event={"ID":"a83cd822-00a1-49a7-b092-6cb10bf1ddce","Type":"ContainerDied","Data":"00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1"}
Sep 18 19:23:33.840627 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.840579    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r" event={"ID":"a83cd822-00a1-49a7-b092-6cb10bf1ddce","Type":"ContainerDied","Data":"710d0803c33f8a40b74eb26d75d1d8a60d0b9360d94feaf1506d23127bc8ed68"}
Sep 18 19:23:33.840627 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.840603    2580 scope.go:117] "RemoveContainer" containerID="00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1"
Sep 18 19:23:33.849206 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.849189    2580 scope.go:117] "RemoveContainer" containerID="00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1"
Sep 18 19:23:33.849486 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:23:33.849469    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1\": container with ID starting with 00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1 not found: ID does not exist" containerID="00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1"
Sep 18 19:23:33.849543 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.849496    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1"} err="failed to get container status \"00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1\": rpc error: code = NotFound desc = could not find container \"00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1\": container with ID starting with 00cade11721d7be86f84fd11d4c5cfd831eb0f4d91f8c33ebc635b33c82e0bf1 not found: ID does not exist"
Sep 18 19:23:33.870724 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.870704    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"]
Sep 18 19:23:33.875145 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.875123    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-jmc7r"]
Sep 18 19:23:33.930760 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:33.930743    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"]
Sep 18 19:23:33.933160 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:23:33.933138    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a5670a_ccf9_4ec8_9f92_5a51af13d981.slice/crio-739823c2cf8e904bd0cd2982e632ab208765d81a76c010bad7375e12370419db WatchSource:0}: Error finding container 739823c2cf8e904bd0cd2982e632ab208765d81a76c010bad7375e12370419db: Status 404 returned error can't find the container with id 739823c2cf8e904bd0cd2982e632ab208765d81a76c010bad7375e12370419db
Sep 18 19:23:34.377851 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:34.377826    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a83cd822-00a1-49a7-b092-6cb10bf1ddce" path="/var/lib/kubelet/pods/a83cd822-00a1-49a7-b092-6cb10bf1ddce/volumes"
Sep 18 19:23:34.846560 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:34.846527    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf" event={"ID":"c7a5670a-ccf9-4ec8-9f92-5a51af13d981","Type":"ContainerStarted","Data":"da6e517ff5b3e839e6d4550c7ec591e6ed74912e93f60d84651357c9f5cf979c"}
Sep 18 19:23:34.846720 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:34.846574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf" event={"ID":"c7a5670a-ccf9-4ec8-9f92-5a51af13d981","Type":"ContainerStarted","Data":"739823c2cf8e904bd0cd2982e632ab208765d81a76c010bad7375e12370419db"}
Sep 18 19:23:34.846720 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:34.846647    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"
Sep 18 19:23:34.869054 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:34.869010    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf" podStartSLOduration=1.432877625 podStartE2EDuration="1.8689956s" totalImagesPullingTime="436.117975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:23:34.866890666 +0000 UTC m=+578.511645985" watchObservedRunningTime="2026-09-18 19:23:34.8689956 +0000 UTC m=+578.513750914"
Sep 18 19:23:58.305264 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:58.305239    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:23:58.307605 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:58.307582    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:23:58.313371 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:58.313352    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:23:58.315916 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:23:58.315895    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:24:05.857237 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:24:05.857203    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5ccfd4fdb4-fdqwf"
Sep 18 19:25:56.729313 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.729281    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"]
Sep 18 19:25:56.729878 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.729771    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a83cd822-00a1-49a7-b092-6cb10bf1ddce" containerName="manager"
Sep 18 19:25:56.729878 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.729789    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a83cd822-00a1-49a7-b092-6cb10bf1ddce" containerName="manager"
Sep 18 19:25:56.729878 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.729873    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a83cd822-00a1-49a7-b092-6cb10bf1ddce" containerName="manager"
Sep 18 19:25:56.732911 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.732889    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:25:56.735770 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.735745    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-d6148-kube-rbac-proxy-sar-config\""
Sep 18 19:25:56.735770 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.735766    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 19:25:56.735920 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.735793    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 18 19:25:56.735920 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.735745    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-d6148-predictor-serving-cert\""
Sep 18 19:25:56.737100 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.737079    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-qfhnz\""
Sep 18 19:25:56.744284 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.744261    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"]
Sep 18 19:25:56.746468 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.746445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc49e088-978a-4879-96fe-6c964e3ef616-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") " pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:25:56.746552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.746487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-942w2\" (UniqueName: \"kubernetes.io/projected/bc49e088-978a-4879-96fe-6c964e3ef616-kube-api-access-942w2\") pod \"success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") " pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:25:56.746552 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.746513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc49e088-978a-4879-96fe-6c964e3ef616-proxy-tls\") pod \"success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") " pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:25:56.847706 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.847678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc49e088-978a-4879-96fe-6c964e3ef616-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") " pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:25:56.847832 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.847723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-942w2\" (UniqueName: \"kubernetes.io/projected/bc49e088-978a-4879-96fe-6c964e3ef616-kube-api-access-942w2\") pod \"success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") " pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:25:56.847883 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.847838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc49e088-978a-4879-96fe-6c964e3ef616-proxy-tls\") pod \"success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") " pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:25:56.848353 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.848325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc49e088-978a-4879-96fe-6c964e3ef616-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") " pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:25:56.850210 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.850185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc49e088-978a-4879-96fe-6c964e3ef616-proxy-tls\") pod \"success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") " pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:25:56.864235 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:56.864207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-942w2\" (UniqueName: \"kubernetes.io/projected/bc49e088-978a-4879-96fe-6c964e3ef616-kube-api-access-942w2\") pod \"success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") " pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:25:57.044033 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:57.043933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:25:57.319046 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:57.318958    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"]
Sep 18 19:25:57.322053 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:25:57.322021    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc49e088_978a_4879_96fe_6c964e3ef616.slice/crio-1bebc172b25fa3d970e93ad042549711c897a617baf636399213a0931833b190 WatchSource:0}: Error finding container 1bebc172b25fa3d970e93ad042549711c897a617baf636399213a0931833b190: Status 404 returned error can't find the container with id 1bebc172b25fa3d970e93ad042549711c897a617baf636399213a0931833b190
Sep 18 19:25:57.324516 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:57.324499    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 19:25:57.514579 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:25:57.514552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" event={"ID":"bc49e088-978a-4879-96fe-6c964e3ef616","Type":"ContainerStarted","Data":"1bebc172b25fa3d970e93ad042549711c897a617baf636399213a0931833b190"}
Sep 18 19:26:09.585525 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:09.585447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" event={"ID":"bc49e088-978a-4879-96fe-6c964e3ef616","Type":"ContainerStarted","Data":"cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e"}
Sep 18 19:26:11.596912 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:11.596871    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" event={"ID":"bc49e088-978a-4879-96fe-6c964e3ef616","Type":"ContainerStarted","Data":"e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d"}
Sep 18 19:26:11.597306 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:11.597160    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:26:11.597306 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:11.597209    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:26:11.598700 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:11.598668    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 18 19:26:11.619451 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:11.619406    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" podStartSLOduration=1.9206547390000002 podStartE2EDuration="15.619391971s" totalImagesPullingTime="13.698737232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:25:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:26:11.617169928 +0000 UTC m=+735.261925268" watchObservedRunningTime="2026-09-18 19:26:11.619391971 +0000 UTC m=+735.264147291"
Sep 18 19:26:12.601480 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:12.601433    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 18 19:26:17.606297 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:17.606270    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:26:17.606752 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:17.606724    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 18 19:26:27.607712 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:27.607663    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 18 19:26:37.606796 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:37.606758    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 18 19:26:47.607234 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:47.607197    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 18 19:26:57.607280 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:26:57.607247    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:27:20.132391 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.132356    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"]
Sep 18 19:27:20.135611 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.135593    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:20.138369 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.138351    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-d6148-kube-rbac-proxy-sar-config\""
Sep 18 19:27:20.138762 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.138745    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-d6148-serving-cert\""
Sep 18 19:27:20.147330 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.147310    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"]
Sep 18 19:27:20.187132 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.187108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc9145ec-6e55-42db-851c-f414c1d4d2f3-openshift-service-ca-bundle\") pod \"switch-graph-d6148-79d8966b74-b4fkt\" (UID: \"fc9145ec-6e55-42db-851c-f414c1d4d2f3\") " pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:20.187235 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.187143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc9145ec-6e55-42db-851c-f414c1d4d2f3-proxy-tls\") pod \"switch-graph-d6148-79d8966b74-b4fkt\" (UID: \"fc9145ec-6e55-42db-851c-f414c1d4d2f3\") " pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:20.288205 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.288183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc9145ec-6e55-42db-851c-f414c1d4d2f3-proxy-tls\") pod \"switch-graph-d6148-79d8966b74-b4fkt\" (UID: \"fc9145ec-6e55-42db-851c-f414c1d4d2f3\") " pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:20.288305 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.288252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc9145ec-6e55-42db-851c-f414c1d4d2f3-openshift-service-ca-bundle\") pod \"switch-graph-d6148-79d8966b74-b4fkt\" (UID: \"fc9145ec-6e55-42db-851c-f414c1d4d2f3\") " pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:20.288348 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:27:20.288326    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-d6148-serving-cert: secret "switch-graph-d6148-serving-cert" not found
Sep 18 19:27:20.288396 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:27:20.288387    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9145ec-6e55-42db-851c-f414c1d4d2f3-proxy-tls podName:fc9145ec-6e55-42db-851c-f414c1d4d2f3 nodeName:}" failed. No retries permitted until 2026-09-18 19:27:20.788373167 +0000 UTC m=+804.433128469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/fc9145ec-6e55-42db-851c-f414c1d4d2f3-proxy-tls") pod "switch-graph-d6148-79d8966b74-b4fkt" (UID: "fc9145ec-6e55-42db-851c-f414c1d4d2f3") : secret "switch-graph-d6148-serving-cert" not found
Sep 18 19:27:20.288820 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.288804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc9145ec-6e55-42db-851c-f414c1d4d2f3-openshift-service-ca-bundle\") pod \"switch-graph-d6148-79d8966b74-b4fkt\" (UID: \"fc9145ec-6e55-42db-851c-f414c1d4d2f3\") " pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:20.792539 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.792505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc9145ec-6e55-42db-851c-f414c1d4d2f3-proxy-tls\") pod \"switch-graph-d6148-79d8966b74-b4fkt\" (UID: \"fc9145ec-6e55-42db-851c-f414c1d4d2f3\") " pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:20.795107 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:20.795080    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc9145ec-6e55-42db-851c-f414c1d4d2f3-proxy-tls\") pod \"switch-graph-d6148-79d8966b74-b4fkt\" (UID: \"fc9145ec-6e55-42db-851c-f414c1d4d2f3\") " pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:21.046186 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:21.046120    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:21.325225 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:21.325202    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"]
Sep 18 19:27:21.327904 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:27:21.327876    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9145ec_6e55_42db_851c_f414c1d4d2f3.slice/crio-4215cc1eae18329ad9333892895a77f8df0ed5e71e2564cb261c50bfd0968bcb WatchSource:0}: Error finding container 4215cc1eae18329ad9333892895a77f8df0ed5e71e2564cb261c50bfd0968bcb: Status 404 returned error can't find the container with id 4215cc1eae18329ad9333892895a77f8df0ed5e71e2564cb261c50bfd0968bcb
Sep 18 19:27:21.906944 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:21.906905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" event={"ID":"fc9145ec-6e55-42db-851c-f414c1d4d2f3","Type":"ContainerStarted","Data":"4215cc1eae18329ad9333892895a77f8df0ed5e71e2564cb261c50bfd0968bcb"}
Sep 18 19:27:23.918156 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:23.918118    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" event={"ID":"fc9145ec-6e55-42db-851c-f414c1d4d2f3","Type":"ContainerStarted","Data":"18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310"}
Sep 18 19:27:23.918539 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:23.918266    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:23.942831 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:23.942790    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" podStartSLOduration=1.809359697 podStartE2EDuration="3.942776968s" totalImagesPullingTime="2.133417271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:27:23.939914438 +0000 UTC m=+807.584669781" watchObservedRunningTime="2026-09-18 19:27:23.942776968 +0000 UTC m=+807.587532320"
Sep 18 19:27:29.929599 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:29.929562    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:31.152478 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.152444    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"]
Sep 18 19:27:31.152833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.152651    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" podUID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" containerName="switch-graph-d6148" containerID="cri-o://18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310" gracePeriod=30
Sep 18 19:27:31.284825 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.284797    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"]
Sep 18 19:27:31.285062 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.285037    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kserve-container" containerID="cri-o://cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e" gracePeriod=30
Sep 18 19:27:31.285150 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.285077    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kube-rbac-proxy" containerID="cri-o://e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d" gracePeriod=30
Sep 18 19:27:31.371615 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.371582    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"]
Sep 18 19:27:31.375585 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.375565    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:31.378599 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.378580    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0c8e2-predictor-serving-cert\""
Sep 18 19:27:31.378716 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.378580    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0c8e2-kube-rbac-proxy-sar-config\""
Sep 18 19:27:31.386429 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.386407    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"]
Sep 18 19:27:31.473689 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.473660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") " pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:31.473825 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.473692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s2gd\" (UniqueName: \"kubernetes.io/projected/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-api-access-4s2gd\") pod \"success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") " pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:31.473825 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.473759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-proxy-tls\") pod \"success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") " pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:31.574725 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.574698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") " pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:31.574855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.574728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s2gd\" (UniqueName: \"kubernetes.io/projected/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-api-access-4s2gd\") pod \"success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") " pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:31.574855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.574750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-proxy-tls\") pod \"success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") " pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:31.574855 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:27:31.574847    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-serving-cert: secret "success-200-isvc-0c8e2-predictor-serving-cert" not found
Sep 18 19:27:31.575020 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:27:31.574900    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-proxy-tls podName:b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b nodeName:}" failed. No retries permitted until 2026-09-18 19:27:32.074886405 +0000 UTC m=+815.719641717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-proxy-tls") pod "success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" (UID: "b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b") : secret "success-200-isvc-0c8e2-predictor-serving-cert" not found
Sep 18 19:27:31.575343 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.575326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") " pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:31.586116 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.586089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s2gd\" (UniqueName: \"kubernetes.io/projected/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-api-access-4s2gd\") pod \"success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") " pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:31.956958 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.956925    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc49e088-978a-4879-96fe-6c964e3ef616" containerID="e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d" exitCode=2
Sep 18 19:27:31.957112 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:31.957001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" event={"ID":"bc49e088-978a-4879-96fe-6c964e3ef616","Type":"ContainerDied","Data":"e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d"}
Sep 18 19:27:32.078016 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.077988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-proxy-tls\") pod \"success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") " pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:32.080472 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.080445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-proxy-tls\") pod \"success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") " pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:32.286179 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.286095    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:32.563048 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.563024    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"]
Sep 18 19:27:32.564934 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:27:32.564906    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ac43eb_10ef_4ebe_a44d_5effdf16bc7b.slice/crio-ec52de6e92333811d51962198099c142b51529576c6f4c365b4bc2f4c488ef08 WatchSource:0}: Error finding container ec52de6e92333811d51962198099c142b51529576c6f4c365b4bc2f4c488ef08: Status 404 returned error can't find the container with id ec52de6e92333811d51962198099c142b51529576c6f4c365b4bc2f4c488ef08
Sep 18 19:27:32.602008 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.601952    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.31:8643/healthz\": dial tcp 10.132.0.31:8643: connect: connection refused"
Sep 18 19:27:32.963560 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.963530    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" event={"ID":"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b","Type":"ContainerStarted","Data":"fe2fe2fe75abc5d789d847f234ab95c3d8295aae929c0ca8caea67de75ec4266"}
Sep 18 19:27:32.963726 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.963586    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" event={"ID":"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b","Type":"ContainerStarted","Data":"9f98f0162f0ea0c7dd31009dd891614bd357bf1c789c7ef158687715d66f0ccd"}
Sep 18 19:27:32.963726 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.963617    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:32.963726 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.963637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" event={"ID":"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b","Type":"ContainerStarted","Data":"ec52de6e92333811d51962198099c142b51529576c6f4c365b4bc2f4c488ef08"}
Sep 18 19:27:32.963726 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.963656    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:32.965058 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.965035    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 18 19:27:32.983337 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:32.983296    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" podStartSLOduration=1.983283259 podStartE2EDuration="1.983283259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:27:32.982000799 +0000 UTC m=+816.626756147" watchObservedRunningTime="2026-09-18 19:27:32.983283259 +0000 UTC m=+816.628038579"
Sep 18 19:27:33.968562 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:33.968517    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 18 19:27:34.325819 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.325795    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:27:34.396940 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.396915    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc49e088-978a-4879-96fe-6c964e3ef616-proxy-tls\") pod \"bc49e088-978a-4879-96fe-6c964e3ef616\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") "
Sep 18 19:27:34.397086 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.396994    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc49e088-978a-4879-96fe-6c964e3ef616-kube-rbac-proxy-sar-config\") pod \"bc49e088-978a-4879-96fe-6c964e3ef616\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") "
Sep 18 19:27:34.397086 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.397023    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-942w2\" (UniqueName: \"kubernetes.io/projected/bc49e088-978a-4879-96fe-6c964e3ef616-kube-api-access-942w2\") pod \"bc49e088-978a-4879-96fe-6c964e3ef616\" (UID: \"bc49e088-978a-4879-96fe-6c964e3ef616\") "
Sep 18 19:27:34.397389 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.397355    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc49e088-978a-4879-96fe-6c964e3ef616-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "bc49e088-978a-4879-96fe-6c964e3ef616" (UID: "bc49e088-978a-4879-96fe-6c964e3ef616"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:27:34.399182 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.399159    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc49e088-978a-4879-96fe-6c964e3ef616-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bc49e088-978a-4879-96fe-6c964e3ef616" (UID: "bc49e088-978a-4879-96fe-6c964e3ef616"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:27:34.399272 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.399240    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc49e088-978a-4879-96fe-6c964e3ef616-kube-api-access-942w2" (OuterVolumeSpecName: "kube-api-access-942w2") pod "bc49e088-978a-4879-96fe-6c964e3ef616" (UID: "bc49e088-978a-4879-96fe-6c964e3ef616"). InnerVolumeSpecName "kube-api-access-942w2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:27:34.497473 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.497447    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc49e088-978a-4879-96fe-6c964e3ef616-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:27:34.497473 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.497469    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-942w2\" (UniqueName: \"kubernetes.io/projected/bc49e088-978a-4879-96fe-6c964e3ef616-kube-api-access-942w2\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:27:34.497641 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.497479    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc49e088-978a-4879-96fe-6c964e3ef616-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:27:34.927392 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.927362    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" podUID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" containerName="switch-graph-d6148" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:27:34.974643 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.974618    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc49e088-978a-4879-96fe-6c964e3ef616" containerID="cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e" exitCode=0
Sep 18 19:27:34.975009 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.974655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" event={"ID":"bc49e088-978a-4879-96fe-6c964e3ef616","Type":"ContainerDied","Data":"cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e"}
Sep 18 19:27:34.975009 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.974668    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"
Sep 18 19:27:34.975009 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.974709    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv" event={"ID":"bc49e088-978a-4879-96fe-6c964e3ef616","Type":"ContainerDied","Data":"1bebc172b25fa3d970e93ad042549711c897a617baf636399213a0931833b190"}
Sep 18 19:27:34.975009 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.974734    2580 scope.go:117] "RemoveContainer" containerID="e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d"
Sep 18 19:27:34.983298 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.983275    2580 scope.go:117] "RemoveContainer" containerID="cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e"
Sep 18 19:27:34.991043 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.991026    2580 scope.go:117] "RemoveContainer" containerID="e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d"
Sep 18 19:27:34.991311 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:27:34.991292    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d\": container with ID starting with e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d not found: ID does not exist" containerID="e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d"
Sep 18 19:27:34.991387 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.991316    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d"} err="failed to get container status \"e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d\": rpc error: code = NotFound desc = could not find container \"e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d\": container with ID starting with e6319ca872c8567ef98ee218929e05896a8fd2a2ef90ace3465ae60a4400998d not found: ID does not exist"
Sep 18 19:27:34.991387 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.991333    2580 scope.go:117] "RemoveContainer" containerID="cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e"
Sep 18 19:27:34.991600 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:27:34.991584    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e\": container with ID starting with cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e not found: ID does not exist" containerID="cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e"
Sep 18 19:27:34.991645 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.991607    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e"} err="failed to get container status \"cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e\": rpc error: code = NotFound desc = could not find container \"cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e\": container with ID starting with cf05299858be48ee56d7140fd7b9bc68d4d49e894a630133ebd8da904932098e not found: ID does not exist"
Sep 18 19:27:34.998015 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:34.997993    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"]
Sep 18 19:27:35.001756 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:35.001732    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d6148-predictor-7c749dc7cc-9vhlv"]
Sep 18 19:27:36.375548 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:36.375508    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" path="/var/lib/kubelet/pods/bc49e088-978a-4879-96fe-6c964e3ef616/volumes"
Sep 18 19:27:38.973074 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:38.973041    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:27:38.973565 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:38.973534    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 18 19:27:39.928157 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:39.928107    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" podUID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" containerName="switch-graph-d6148" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:27:44.927236 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:44.927192    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" podUID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" containerName="switch-graph-d6148" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:27:44.927727 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:44.927299    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:27:48.973636 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:48.973598    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 18 19:27:49.927735 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:49.927691    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" podUID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" containerName="switch-graph-d6148" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:27:54.927926 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:54.927884    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" podUID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" containerName="switch-graph-d6148" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:27:58.974022 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:58.973967    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 18 19:27:59.927745 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:27:59.927705    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" podUID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" containerName="switch-graph-d6148" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:28:01.791427 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:01.791405    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:28:01.898057 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:01.898035    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc9145ec-6e55-42db-851c-f414c1d4d2f3-proxy-tls\") pod \"fc9145ec-6e55-42db-851c-f414c1d4d2f3\" (UID: \"fc9145ec-6e55-42db-851c-f414c1d4d2f3\") "
Sep 18 19:28:01.898170 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:01.898145    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc9145ec-6e55-42db-851c-f414c1d4d2f3-openshift-service-ca-bundle\") pod \"fc9145ec-6e55-42db-851c-f414c1d4d2f3\" (UID: \"fc9145ec-6e55-42db-851c-f414c1d4d2f3\") "
Sep 18 19:28:01.898443 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:01.898417    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc9145ec-6e55-42db-851c-f414c1d4d2f3-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "fc9145ec-6e55-42db-851c-f414c1d4d2f3" (UID: "fc9145ec-6e55-42db-851c-f414c1d4d2f3"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:28:01.900250 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:01.900229    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc9145ec-6e55-42db-851c-f414c1d4d2f3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fc9145ec-6e55-42db-851c-f414c1d4d2f3" (UID: "fc9145ec-6e55-42db-851c-f414c1d4d2f3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:28:01.998768 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:01.998695    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc9145ec-6e55-42db-851c-f414c1d4d2f3-openshift-service-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:28:01.998768 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:01.998736    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc9145ec-6e55-42db-851c-f414c1d4d2f3-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:28:02.108046 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:02.108013    2580 generic.go:356] "Generic (PLEG): container finished" podID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" containerID="18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310" exitCode=0
Sep 18 19:28:02.108161 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:02.108067    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"
Sep 18 19:28:02.108161 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:02.108106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" event={"ID":"fc9145ec-6e55-42db-851c-f414c1d4d2f3","Type":"ContainerDied","Data":"18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310"}
Sep 18 19:28:02.108282 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:02.108161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt" event={"ID":"fc9145ec-6e55-42db-851c-f414c1d4d2f3","Type":"ContainerDied","Data":"4215cc1eae18329ad9333892895a77f8df0ed5e71e2564cb261c50bfd0968bcb"}
Sep 18 19:28:02.108282 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:02.108188    2580 scope.go:117] "RemoveContainer" containerID="18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310"
Sep 18 19:28:02.117033 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:02.117012    2580 scope.go:117] "RemoveContainer" containerID="18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310"
Sep 18 19:28:02.117288 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:28:02.117270    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310\": container with ID starting with 18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310 not found: ID does not exist" containerID="18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310"
Sep 18 19:28:02.117338 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:02.117296    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310"} err="failed to get container status \"18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310\": rpc error: code = NotFound desc = could not find container \"18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310\": container with ID starting with 18077e482f7511613a93c6cd24844d78122ff2d1ef7a6f1c62938f68dfdee310 not found: ID does not exist"
Sep 18 19:28:02.133591 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:02.133573    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"]
Sep 18 19:28:02.139715 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:02.139697    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d6148-79d8966b74-b4fkt"]
Sep 18 19:28:02.375124 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:02.375102    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" path="/var/lib/kubelet/pods/fc9145ec-6e55-42db-851c-f414c1d4d2f3/volumes"
Sep 18 19:28:08.974146 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:08.974109    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 18 19:28:10.103679 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.103649    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"]
Sep 18 19:28:10.104101 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.103997    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kserve-container"
Sep 18 19:28:10.104101 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.104010    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kserve-container"
Sep 18 19:28:10.104101 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.104025    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" containerName="switch-graph-d6148"
Sep 18 19:28:10.104101 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.104030    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" containerName="switch-graph-d6148"
Sep 18 19:28:10.104101 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.104041    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kube-rbac-proxy"
Sep 18 19:28:10.104101 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.104046    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kube-rbac-proxy"
Sep 18 19:28:10.104101 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.104096    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc9145ec-6e55-42db-851c-f414c1d4d2f3" containerName="switch-graph-d6148"
Sep 18 19:28:10.104101 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.104103    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kube-rbac-proxy"
Sep 18 19:28:10.104378 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.104111    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc49e088-978a-4879-96fe-6c964e3ef616" containerName="kserve-container"
Sep 18 19:28:10.108517 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.108499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:10.111615 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.111592    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Sep 18 19:28:10.111732 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.111715    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Sep 18 19:28:10.120289 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.120265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"]
Sep 18 19:28:10.261333 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.261261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36d95eb1-7483-43cc-b130-322258cf9e82-openshift-service-ca-bundle\") pod \"model-chainer-668c49d7c6-5v6f4\" (UID: \"36d95eb1-7483-43cc-b130-322258cf9e82\") " pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:10.261333 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.261297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36d95eb1-7483-43cc-b130-322258cf9e82-proxy-tls\") pod \"model-chainer-668c49d7c6-5v6f4\" (UID: \"36d95eb1-7483-43cc-b130-322258cf9e82\") " pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:10.362305 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.362273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36d95eb1-7483-43cc-b130-322258cf9e82-openshift-service-ca-bundle\") pod \"model-chainer-668c49d7c6-5v6f4\" (UID: \"36d95eb1-7483-43cc-b130-322258cf9e82\") " pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:10.362305 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.362311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36d95eb1-7483-43cc-b130-322258cf9e82-proxy-tls\") pod \"model-chainer-668c49d7c6-5v6f4\" (UID: \"36d95eb1-7483-43cc-b130-322258cf9e82\") " pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:10.363130 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.363099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36d95eb1-7483-43cc-b130-322258cf9e82-openshift-service-ca-bundle\") pod \"model-chainer-668c49d7c6-5v6f4\" (UID: \"36d95eb1-7483-43cc-b130-322258cf9e82\") " pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:10.364830 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.364801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36d95eb1-7483-43cc-b130-322258cf9e82-proxy-tls\") pod \"model-chainer-668c49d7c6-5v6f4\" (UID: \"36d95eb1-7483-43cc-b130-322258cf9e82\") " pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:10.418228 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.418199    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:10.692791 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:10.692767    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"]
Sep 18 19:28:10.695277 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:28:10.695248    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d95eb1_7483_43cc_b130_322258cf9e82.slice/crio-b01b91d3b5b1ace1d7fc9e5a156526135ac51cbbbda57f9cdf7fed3970e61a22 WatchSource:0}: Error finding container b01b91d3b5b1ace1d7fc9e5a156526135ac51cbbbda57f9cdf7fed3970e61a22: Status 404 returned error can't find the container with id b01b91d3b5b1ace1d7fc9e5a156526135ac51cbbbda57f9cdf7fed3970e61a22
Sep 18 19:28:11.156158 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:11.156120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" event={"ID":"36d95eb1-7483-43cc-b130-322258cf9e82","Type":"ContainerStarted","Data":"b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1"}
Sep 18 19:28:11.156531 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:11.156182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" event={"ID":"36d95eb1-7483-43cc-b130-322258cf9e82","Type":"ContainerStarted","Data":"b01b91d3b5b1ace1d7fc9e5a156526135ac51cbbbda57f9cdf7fed3970e61a22"}
Sep 18 19:28:11.156531 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:11.156293    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:11.176262 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:11.176216    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" podStartSLOduration=1.176202873 podStartE2EDuration="1.176202873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:28:11.175335982 +0000 UTC m=+854.820091324" watchObservedRunningTime="2026-09-18 19:28:11.176202873 +0000 UTC m=+854.820958192"
Sep 18 19:28:17.167437 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:17.167408    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:18.974697 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:18.974657    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:28:21.483110 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:21.483076    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"]
Sep 18 19:28:21.483588 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:21.483283    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" podUID="36d95eb1-7483-43cc-b130-322258cf9e82" containerName="model-chainer" containerID="cri-o://b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1" gracePeriod=30
Sep 18 19:28:21.790815 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:21.790742    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"]
Sep 18 19:28:21.794390 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:21.794374    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:21.797096 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:21.797066    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-eff75-predictor-serving-cert\""
Sep 18 19:28:21.797204 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:21.797149    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-eff75-kube-rbac-proxy-sar-config\""
Sep 18 19:28:21.804281 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:21.804260    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"]
Sep 18 19:28:21.947757 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:21.947720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mwjd\" (UniqueName: \"kubernetes.io/projected/38d5f291-3a1d-4450-a3c4-864192b33970-kube-api-access-8mwjd\") pod \"success-200-isvc-eff75-predictor-84d6cb4997-pv47c\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") " pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:21.947909 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:21.947790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/38d5f291-3a1d-4450-a3c4-864192b33970-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-eff75-predictor-84d6cb4997-pv47c\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") " pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:21.947909 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:21.947878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls\") pod \"success-200-isvc-eff75-predictor-84d6cb4997-pv47c\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") " pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:22.049107 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:22.049045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/38d5f291-3a1d-4450-a3c4-864192b33970-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-eff75-predictor-84d6cb4997-pv47c\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") " pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:22.049107 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:22.049098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls\") pod \"success-200-isvc-eff75-predictor-84d6cb4997-pv47c\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") " pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:22.049286 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:22.049124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mwjd\" (UniqueName: \"kubernetes.io/projected/38d5f291-3a1d-4450-a3c4-864192b33970-kube-api-access-8mwjd\") pod \"success-200-isvc-eff75-predictor-84d6cb4997-pv47c\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") " pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:22.049286 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:28:22.049262    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-eff75-predictor-serving-cert: secret "success-200-isvc-eff75-predictor-serving-cert" not found
Sep 18 19:28:22.049405 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:28:22.049341    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls podName:38d5f291-3a1d-4450-a3c4-864192b33970 nodeName:}" failed. No retries permitted until 2026-09-18 19:28:22.549320813 +0000 UTC m=+866.194076125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls") pod "success-200-isvc-eff75-predictor-84d6cb4997-pv47c" (UID: "38d5f291-3a1d-4450-a3c4-864192b33970") : secret "success-200-isvc-eff75-predictor-serving-cert" not found
Sep 18 19:28:22.049638 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:22.049619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/38d5f291-3a1d-4450-a3c4-864192b33970-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-eff75-predictor-84d6cb4997-pv47c\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") " pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:22.059530 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:22.059505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mwjd\" (UniqueName: \"kubernetes.io/projected/38d5f291-3a1d-4450-a3c4-864192b33970-kube-api-access-8mwjd\") pod \"success-200-isvc-eff75-predictor-84d6cb4997-pv47c\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") " pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:22.165117 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:22.165092    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" podUID="36d95eb1-7483-43cc-b130-322258cf9e82" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:28:22.551778 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:22.551753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls\") pod \"success-200-isvc-eff75-predictor-84d6cb4997-pv47c\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") " pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:22.552160 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:28:22.551863    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-eff75-predictor-serving-cert: secret "success-200-isvc-eff75-predictor-serving-cert" not found
Sep 18 19:28:22.552160 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:28:22.551909    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls podName:38d5f291-3a1d-4450-a3c4-864192b33970 nodeName:}" failed. No retries permitted until 2026-09-18 19:28:23.551897293 +0000 UTC m=+867.196652590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls") pod "success-200-isvc-eff75-predictor-84d6cb4997-pv47c" (UID: "38d5f291-3a1d-4450-a3c4-864192b33970") : secret "success-200-isvc-eff75-predictor-serving-cert" not found
Sep 18 19:28:23.559791 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:23.559755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls\") pod \"success-200-isvc-eff75-predictor-84d6cb4997-pv47c\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") " pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:23.562624 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:23.562599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls\") pod \"success-200-isvc-eff75-predictor-84d6cb4997-pv47c\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") " pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:23.604515 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:23.604487    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:23.885215 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:23.885158    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"]
Sep 18 19:28:23.890761 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:28:23.890732    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d5f291_3a1d_4450_a3c4_864192b33970.slice/crio-7e300f33b7d3235b2691dbf5fc03e0752e141accee2e89809c3a1983dfc1bb58 WatchSource:0}: Error finding container 7e300f33b7d3235b2691dbf5fc03e0752e141accee2e89809c3a1983dfc1bb58: Status 404 returned error can't find the container with id 7e300f33b7d3235b2691dbf5fc03e0752e141accee2e89809c3a1983dfc1bb58
Sep 18 19:28:24.220165 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:24.220080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" event={"ID":"38d5f291-3a1d-4450-a3c4-864192b33970","Type":"ContainerStarted","Data":"ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc"}
Sep 18 19:28:24.220165 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:24.220139    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" event={"ID":"38d5f291-3a1d-4450-a3c4-864192b33970","Type":"ContainerStarted","Data":"25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a"}
Sep 18 19:28:24.220165 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:24.220166    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:24.220430 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:24.220186    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:24.220430 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:24.220202    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" event={"ID":"38d5f291-3a1d-4450-a3c4-864192b33970","Type":"ContainerStarted","Data":"7e300f33b7d3235b2691dbf5fc03e0752e141accee2e89809c3a1983dfc1bb58"}
Sep 18 19:28:24.221386 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:24.221359    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 19:28:24.246725 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:24.246681    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" podStartSLOduration=3.246668593 podStartE2EDuration="3.246668593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:28:24.24562778 +0000 UTC m=+867.890383127" watchObservedRunningTime="2026-09-18 19:28:24.246668593 +0000 UTC m=+867.891423913"
Sep 18 19:28:25.224939 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:25.224889    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 19:28:27.165192 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:27.165146    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" podUID="36d95eb1-7483-43cc-b130-322258cf9e82" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:28:30.230114 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:30.230080    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:28:30.230567 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:30.230539    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 19:28:31.408076 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:31.408042    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"]
Sep 18 19:28:31.411535 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:31.411515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:28:31.412761 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:31.412738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d678a67b-4541-4e68-b33c-ac41d0f967f2-openshift-service-ca-bundle\") pod \"switch-graph-0c8e2-7c84fdbd88-m5wb8\" (UID: \"d678a67b-4541-4e68-b33c-ac41d0f967f2\") " pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:28:31.412846 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:31.412778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d678a67b-4541-4e68-b33c-ac41d0f967f2-proxy-tls\") pod \"switch-graph-0c8e2-7c84fdbd88-m5wb8\" (UID: \"d678a67b-4541-4e68-b33c-ac41d0f967f2\") " pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:28:31.414129 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:31.414109    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-0c8e2-serving-cert\""
Sep 18 19:28:31.414176 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:31.414109    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-0c8e2-kube-rbac-proxy-sar-config\""
Sep 18 19:28:31.420334 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:31.420309    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"]
Sep 18 19:28:31.514036 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:31.514006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d678a67b-4541-4e68-b33c-ac41d0f967f2-openshift-service-ca-bundle\") pod \"switch-graph-0c8e2-7c84fdbd88-m5wb8\" (UID: \"d678a67b-4541-4e68-b33c-ac41d0f967f2\") " pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:28:31.514177 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:31.514054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d678a67b-4541-4e68-b33c-ac41d0f967f2-proxy-tls\") pod \"switch-graph-0c8e2-7c84fdbd88-m5wb8\" (UID: \"d678a67b-4541-4e68-b33c-ac41d0f967f2\") " pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:28:31.514177 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:28:31.514165    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-0c8e2-serving-cert: secret "switch-graph-0c8e2-serving-cert" not found
Sep 18 19:28:31.514287 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:28:31.514234    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d678a67b-4541-4e68-b33c-ac41d0f967f2-proxy-tls podName:d678a67b-4541-4e68-b33c-ac41d0f967f2 nodeName:}" failed. No retries permitted until 2026-09-18 19:28:32.014214442 +0000 UTC m=+875.658969746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d678a67b-4541-4e68-b33c-ac41d0f967f2-proxy-tls") pod "switch-graph-0c8e2-7c84fdbd88-m5wb8" (UID: "d678a67b-4541-4e68-b33c-ac41d0f967f2") : secret "switch-graph-0c8e2-serving-cert" not found
Sep 18 19:28:31.514626 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:31.514604    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d678a67b-4541-4e68-b33c-ac41d0f967f2-openshift-service-ca-bundle\") pod \"switch-graph-0c8e2-7c84fdbd88-m5wb8\" (UID: \"d678a67b-4541-4e68-b33c-ac41d0f967f2\") " pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:28:32.017929 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:32.017900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d678a67b-4541-4e68-b33c-ac41d0f967f2-proxy-tls\") pod \"switch-graph-0c8e2-7c84fdbd88-m5wb8\" (UID: \"d678a67b-4541-4e68-b33c-ac41d0f967f2\") " pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:28:32.020580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:32.020557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d678a67b-4541-4e68-b33c-ac41d0f967f2-proxy-tls\") pod \"switch-graph-0c8e2-7c84fdbd88-m5wb8\" (UID: \"d678a67b-4541-4e68-b33c-ac41d0f967f2\") " pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:28:32.023396 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:32.023375    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:28:32.165387 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:32.165353    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" podUID="36d95eb1-7483-43cc-b130-322258cf9e82" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:28:32.165495 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:32.165453    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:32.296997 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:32.296956    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"]
Sep 18 19:28:32.299350 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:28:32.299326    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd678a67b_4541_4e68_b33c_ac41d0f967f2.slice/crio-ff44e6026c28c1a5bde9fc5b66eff331bbf8cd6727cd2a15c65ea4dd5246004d WatchSource:0}: Error finding container ff44e6026c28c1a5bde9fc5b66eff331bbf8cd6727cd2a15c65ea4dd5246004d: Status 404 returned error can't find the container with id ff44e6026c28c1a5bde9fc5b66eff331bbf8cd6727cd2a15c65ea4dd5246004d
Sep 18 19:28:33.264588 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:33.264554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" event={"ID":"d678a67b-4541-4e68-b33c-ac41d0f967f2","Type":"ContainerStarted","Data":"10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c"}
Sep 18 19:28:33.264966 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:33.264608    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" event={"ID":"d678a67b-4541-4e68-b33c-ac41d0f967f2","Type":"ContainerStarted","Data":"ff44e6026c28c1a5bde9fc5b66eff331bbf8cd6727cd2a15c65ea4dd5246004d"}
Sep 18 19:28:33.264966 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:33.264664    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:28:37.165341 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:37.165299    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" podUID="36d95eb1-7483-43cc-b130-322258cf9e82" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:28:39.274851 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:39.274780    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:28:39.294415 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:39.294365    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" podStartSLOduration=8.294351234 podStartE2EDuration="8.294351234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:28:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:28:33.284670257 +0000 UTC m=+876.929425619" watchObservedRunningTime="2026-09-18 19:28:39.294351234 +0000 UTC m=+882.939106596"
Sep 18 19:28:40.231522 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:40.231480    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 19:28:42.165826 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:42.165785    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" podUID="36d95eb1-7483-43cc-b130-322258cf9e82" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:28:47.164942 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:47.164897    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" podUID="36d95eb1-7483-43cc-b130-322258cf9e82" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:28:50.230988 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:50.230940    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 19:28:51.630205 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:51.630181    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:51.662060 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:51.662034    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36d95eb1-7483-43cc-b130-322258cf9e82-proxy-tls\") pod \"36d95eb1-7483-43cc-b130-322258cf9e82\" (UID: \"36d95eb1-7483-43cc-b130-322258cf9e82\") "
Sep 18 19:28:51.662184 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:51.662084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36d95eb1-7483-43cc-b130-322258cf9e82-openshift-service-ca-bundle\") pod \"36d95eb1-7483-43cc-b130-322258cf9e82\" (UID: \"36d95eb1-7483-43cc-b130-322258cf9e82\") "
Sep 18 19:28:51.662455 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:51.662428    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36d95eb1-7483-43cc-b130-322258cf9e82-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "36d95eb1-7483-43cc-b130-322258cf9e82" (UID: "36d95eb1-7483-43cc-b130-322258cf9e82"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:28:51.664173 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:51.664149    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d95eb1-7483-43cc-b130-322258cf9e82-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "36d95eb1-7483-43cc-b130-322258cf9e82" (UID: "36d95eb1-7483-43cc-b130-322258cf9e82"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:28:51.763495 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:51.763447    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36d95eb1-7483-43cc-b130-322258cf9e82-openshift-service-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:28:51.763495 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:51.763468    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36d95eb1-7483-43cc-b130-322258cf9e82-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:28:52.356550 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:52.356516    2580 generic.go:356] "Generic (PLEG): container finished" podID="36d95eb1-7483-43cc-b130-322258cf9e82" containerID="b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1" exitCode=137
Sep 18 19:28:52.356736 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:52.356565    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"
Sep 18 19:28:52.356736 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:52.356598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" event={"ID":"36d95eb1-7483-43cc-b130-322258cf9e82","Type":"ContainerDied","Data":"b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1"}
Sep 18 19:28:52.356736 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:52.356646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4" event={"ID":"36d95eb1-7483-43cc-b130-322258cf9e82","Type":"ContainerDied","Data":"b01b91d3b5b1ace1d7fc9e5a156526135ac51cbbbda57f9cdf7fed3970e61a22"}
Sep 18 19:28:52.356736 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:52.356671    2580 scope.go:117] "RemoveContainer" containerID="b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1"
Sep 18 19:28:52.365767 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:52.365752    2580 scope.go:117] "RemoveContainer" containerID="b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1"
Sep 18 19:28:52.366050 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:28:52.366033    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1\": container with ID starting with b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1 not found: ID does not exist" containerID="b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1"
Sep 18 19:28:52.366096 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:52.366060    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1"} err="failed to get container status \"b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1\": rpc error: code = NotFound desc = could not find container \"b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1\": container with ID starting with b0e7e5cfae59f1114e87a2fc67a0bf43c6868d0969c2bc3d503386fcd4cd5cb1 not found: ID does not exist"
Sep 18 19:28:52.379866 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:52.379840    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"]
Sep 18 19:28:52.382130 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:52.382112    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-668c49d7c6-5v6f4"]
Sep 18 19:28:54.374378 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:54.374349    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36d95eb1-7483-43cc-b130-322258cf9e82" path="/var/lib/kubelet/pods/36d95eb1-7483-43cc-b130-322258cf9e82/volumes"
Sep 18 19:28:58.336649 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:58.336620    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:28:58.338563 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:58.338540    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:28:58.344952 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:58.344934    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:28:58.346740 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:28:58.346719    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:29:00.230536 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:00.230493    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 19:29:10.232172 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:10.232090    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:29:21.706989 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.706949    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"]
Sep 18 19:29:21.707369 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.707321    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d95eb1-7483-43cc-b130-322258cf9e82" containerName="model-chainer"
Sep 18 19:29:21.707369 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.707333    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d95eb1-7483-43cc-b130-322258cf9e82" containerName="model-chainer"
Sep 18 19:29:21.707440 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.707383    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="36d95eb1-7483-43cc-b130-322258cf9e82" containerName="model-chainer"
Sep 18 19:29:21.710375 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.710355    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:29:21.713741 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.713718    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-eff75-kube-rbac-proxy-sar-config\""
Sep 18 19:29:21.713845 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.713778    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-eff75-serving-cert\""
Sep 18 19:29:21.720093 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.720071    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"]
Sep 18 19:29:21.768954 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.768928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b9ce6d1-e24c-4f05-b136-34e23d122d61-openshift-service-ca-bundle\") pod \"sequence-graph-eff75-5f6b6f9b5b-x6k9z\" (UID: \"5b9ce6d1-e24c-4f05-b136-34e23d122d61\") " pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:29:21.769073 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.768956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5b9ce6d1-e24c-4f05-b136-34e23d122d61-proxy-tls\") pod \"sequence-graph-eff75-5f6b6f9b5b-x6k9z\" (UID: \"5b9ce6d1-e24c-4f05-b136-34e23d122d61\") " pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:29:21.870112 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.870089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b9ce6d1-e24c-4f05-b136-34e23d122d61-openshift-service-ca-bundle\") pod \"sequence-graph-eff75-5f6b6f9b5b-x6k9z\" (UID: \"5b9ce6d1-e24c-4f05-b136-34e23d122d61\") " pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:29:21.870210 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.870115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5b9ce6d1-e24c-4f05-b136-34e23d122d61-proxy-tls\") pod \"sequence-graph-eff75-5f6b6f9b5b-x6k9z\" (UID: \"5b9ce6d1-e24c-4f05-b136-34e23d122d61\") " pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:29:21.870257 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:29:21.870210    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-eff75-serving-cert: secret "sequence-graph-eff75-serving-cert" not found
Sep 18 19:29:21.870302 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:29:21.870258    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9ce6d1-e24c-4f05-b136-34e23d122d61-proxy-tls podName:5b9ce6d1-e24c-4f05-b136-34e23d122d61 nodeName:}" failed. No retries permitted until 2026-09-18 19:29:22.370243897 +0000 UTC m=+926.014999195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/5b9ce6d1-e24c-4f05-b136-34e23d122d61-proxy-tls") pod "sequence-graph-eff75-5f6b6f9b5b-x6k9z" (UID: "5b9ce6d1-e24c-4f05-b136-34e23d122d61") : secret "sequence-graph-eff75-serving-cert" not found
Sep 18 19:29:21.870679 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:21.870662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b9ce6d1-e24c-4f05-b136-34e23d122d61-openshift-service-ca-bundle\") pod \"sequence-graph-eff75-5f6b6f9b5b-x6k9z\" (UID: \"5b9ce6d1-e24c-4f05-b136-34e23d122d61\") " pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:29:22.381155 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:22.381106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5b9ce6d1-e24c-4f05-b136-34e23d122d61-proxy-tls\") pod \"sequence-graph-eff75-5f6b6f9b5b-x6k9z\" (UID: \"5b9ce6d1-e24c-4f05-b136-34e23d122d61\") " pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:29:22.384041 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:22.384015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5b9ce6d1-e24c-4f05-b136-34e23d122d61-proxy-tls\") pod \"sequence-graph-eff75-5f6b6f9b5b-x6k9z\" (UID: \"5b9ce6d1-e24c-4f05-b136-34e23d122d61\") " pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:29:22.621925 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:22.621894    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:29:22.897556 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:22.897485    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"]
Sep 18 19:29:22.901499 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:29:22.901473    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9ce6d1_e24c_4f05_b136_34e23d122d61.slice/crio-74400c14e31e01afe49b0e82b786e1559ba6315ded58dbd0921897e2a65f916f WatchSource:0}: Error finding container 74400c14e31e01afe49b0e82b786e1559ba6315ded58dbd0921897e2a65f916f: Status 404 returned error can't find the container with id 74400c14e31e01afe49b0e82b786e1559ba6315ded58dbd0921897e2a65f916f
Sep 18 19:29:23.504280 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:23.504235    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" event={"ID":"5b9ce6d1-e24c-4f05-b136-34e23d122d61","Type":"ContainerStarted","Data":"10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c"}
Sep 18 19:29:23.504472 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:23.504301    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" event={"ID":"5b9ce6d1-e24c-4f05-b136-34e23d122d61","Type":"ContainerStarted","Data":"74400c14e31e01afe49b0e82b786e1559ba6315ded58dbd0921897e2a65f916f"}
Sep 18 19:29:23.504472 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:23.504394    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:29:23.526115 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:23.526064    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" podStartSLOduration=2.526047784 podStartE2EDuration="2.526047784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:29:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:29:23.525161027 +0000 UTC m=+927.169916361" watchObservedRunningTime="2026-09-18 19:29:23.526047784 +0000 UTC m=+927.170803145"
Sep 18 19:29:29.516997 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:29:29.516938    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:33:58.371422 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:33:58.371390    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:33:58.372013 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:33:58.371738    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:33:58.380793 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:33:58.380772    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:33:58.380913 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:33:58.380803    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:36:46.518626 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.518591    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"]
Sep 18 19:36:46.521221 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.518945    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" podUID="d678a67b-4541-4e68-b33c-ac41d0f967f2" containerName="switch-graph-0c8e2" containerID="cri-o://10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c" gracePeriod=30
Sep 18 19:36:46.661189 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.661159    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"]
Sep 18 19:36:46.661433 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.661383    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kserve-container" containerID="cri-o://9f98f0162f0ea0c7dd31009dd891614bd357bf1c789c7ef158687715d66f0ccd" gracePeriod=30
Sep 18 19:36:46.661539 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.661426    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kube-rbac-proxy" containerID="cri-o://fe2fe2fe75abc5d789d847f234ab95c3d8295aae929c0ca8caea67de75ec4266" gracePeriod=30
Sep 18 19:36:46.750425 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.750394    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"]
Sep 18 19:36:46.754643 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.754619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:46.757921 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.757896    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-e0eb2-predictor-serving-cert\""
Sep 18 19:36:46.758232 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.758209    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-e0eb2-kube-rbac-proxy-sar-config\""
Sep 18 19:36:46.767225 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.767154    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"]
Sep 18 19:36:46.913358 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.913324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8fqn\" (UniqueName: \"kubernetes.io/projected/41667039-c78d-4f53-9518-8e524c30d9b0-kube-api-access-t8fqn\") pod \"success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") " pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:46.913358 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.913363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/41667039-c78d-4f53-9518-8e524c30d9b0-proxy-tls\") pod \"success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") " pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:46.913551 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:46.913390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/41667039-c78d-4f53-9518-8e524c30d9b0-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") " pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:47.014563 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.014522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8fqn\" (UniqueName: \"kubernetes.io/projected/41667039-c78d-4f53-9518-8e524c30d9b0-kube-api-access-t8fqn\") pod \"success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") " pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:47.014563 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.014565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/41667039-c78d-4f53-9518-8e524c30d9b0-proxy-tls\") pod \"success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") " pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:47.014733 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.014608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/41667039-c78d-4f53-9518-8e524c30d9b0-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") " pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:47.015357 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.015296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/41667039-c78d-4f53-9518-8e524c30d9b0-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") " pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:47.017193 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.017171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/41667039-c78d-4f53-9518-8e524c30d9b0-proxy-tls\") pod \"success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") " pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:47.030504 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.030483    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8fqn\" (UniqueName: \"kubernetes.io/projected/41667039-c78d-4f53-9518-8e524c30d9b0-kube-api-access-t8fqn\") pod \"success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") " pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:47.069512 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.069465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:47.353152 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.353127    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"]
Sep 18 19:36:47.354476 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:36:47.354449    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41667039_c78d_4f53_9518_8e524c30d9b0.slice/crio-8057f85389851480b116e2b01f9fa0794cdd3ad45c5d7d7ccb339cf491dba128 WatchSource:0}: Error finding container 8057f85389851480b116e2b01f9fa0794cdd3ad45c5d7d7ccb339cf491dba128: Status 404 returned error can't find the container with id 8057f85389851480b116e2b01f9fa0794cdd3ad45c5d7d7ccb339cf491dba128
Sep 18 19:36:47.659795 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.659714    2580 generic.go:356] "Generic (PLEG): container finished" podID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerID="fe2fe2fe75abc5d789d847f234ab95c3d8295aae929c0ca8caea67de75ec4266" exitCode=2
Sep 18 19:36:47.660182 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.659788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" event={"ID":"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b","Type":"ContainerDied","Data":"fe2fe2fe75abc5d789d847f234ab95c3d8295aae929c0ca8caea67de75ec4266"}
Sep 18 19:36:47.661683 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.661656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" event={"ID":"41667039-c78d-4f53-9518-8e524c30d9b0","Type":"ContainerStarted","Data":"38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b"}
Sep 18 19:36:47.661807 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.661707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" event={"ID":"41667039-c78d-4f53-9518-8e524c30d9b0","Type":"ContainerStarted","Data":"6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a"}
Sep 18 19:36:47.661807 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.661728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" event={"ID":"41667039-c78d-4f53-9518-8e524c30d9b0","Type":"ContainerStarted","Data":"8057f85389851480b116e2b01f9fa0794cdd3ad45c5d7d7ccb339cf491dba128"}
Sep 18 19:36:47.661807 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.661771    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:47.698039 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:47.697964    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" podStartSLOduration=1.6979494370000001 podStartE2EDuration="1.697949437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:36:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:36:47.6978465 +0000 UTC m=+1371.342601821" watchObservedRunningTime="2026-09-18 19:36:47.697949437 +0000 UTC m=+1371.342704758"
Sep 18 19:36:48.666617 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:48.666584    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:48.667732 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:48.667698    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 18 19:36:48.969493 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:48.969404    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.33:8643/healthz\": dial tcp 10.132.0.33:8643: connect: connection refused"
Sep 18 19:36:48.973753 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:48.973732    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 18 19:36:49.273925 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.273827    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" podUID="d678a67b-4541-4e68-b33c-ac41d0f967f2" containerName="switch-graph-0c8e2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:36:49.673042 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.673014    2580 generic.go:356] "Generic (PLEG): container finished" podID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerID="9f98f0162f0ea0c7dd31009dd891614bd357bf1c789c7ef158687715d66f0ccd" exitCode=0
Sep 18 19:36:49.673383 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.673083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" event={"ID":"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b","Type":"ContainerDied","Data":"9f98f0162f0ea0c7dd31009dd891614bd357bf1c789c7ef158687715d66f0ccd"}
Sep 18 19:36:49.673383 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.673337    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 18 19:36:49.703104 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.703085    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:36:49.839459 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.839435    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-rbac-proxy-sar-config\") pod \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") "
Sep 18 19:36:49.839580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.839471    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s2gd\" (UniqueName: \"kubernetes.io/projected/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-api-access-4s2gd\") pod \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") "
Sep 18 19:36:49.839580 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.839489    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-proxy-tls\") pod \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\" (UID: \"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b\") "
Sep 18 19:36:49.839850 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.839825    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" (UID: "b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:36:49.841717 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.841697    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" (UID: "b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:36:49.841807 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.841792    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-api-access-4s2gd" (OuterVolumeSpecName: "kube-api-access-4s2gd") pod "b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" (UID: "b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b"). InnerVolumeSpecName "kube-api-access-4s2gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:36:49.940295 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.940270    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:36:49.940295 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.940292    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s2gd\" (UniqueName: \"kubernetes.io/projected/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-kube-api-access-4s2gd\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:36:49.940428 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:49.940301    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:36:50.684835 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:50.684768    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"
Sep 18 19:36:50.685272 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:50.684764    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl" event={"ID":"b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b","Type":"ContainerDied","Data":"ec52de6e92333811d51962198099c142b51529576c6f4c365b4bc2f4c488ef08"}
Sep 18 19:36:50.685272 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:50.684954    2580 scope.go:117] "RemoveContainer" containerID="fe2fe2fe75abc5d789d847f234ab95c3d8295aae929c0ca8caea67de75ec4266"
Sep 18 19:36:50.695922 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:50.695905    2580 scope.go:117] "RemoveContainer" containerID="9f98f0162f0ea0c7dd31009dd891614bd357bf1c789c7ef158687715d66f0ccd"
Sep 18 19:36:50.707105 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:50.707084    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"]
Sep 18 19:36:50.711155 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:50.711135    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0c8e2-predictor-7d8c788b9f-pxgcl"]
Sep 18 19:36:52.375466 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:52.375430    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" path="/var/lib/kubelet/pods/b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b/volumes"
Sep 18 19:36:54.273773 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:54.273734    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" podUID="d678a67b-4541-4e68-b33c-ac41d0f967f2" containerName="switch-graph-0c8e2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:36:54.677837 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:54.677813    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:36:54.678345 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:54.678318    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 18 19:36:59.273750 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:59.273714    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" podUID="d678a67b-4541-4e68-b33c-ac41d0f967f2" containerName="switch-graph-0c8e2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:36:59.274173 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:36:59.273813    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:37:04.274360 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:04.274320    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" podUID="d678a67b-4541-4e68-b33c-ac41d0f967f2" containerName="switch-graph-0c8e2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:37:04.678359 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:04.678320    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 18 19:37:09.273983 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:09.273929    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" podUID="d678a67b-4541-4e68-b33c-ac41d0f967f2" containerName="switch-graph-0c8e2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:37:14.273312 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:14.273275    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" podUID="d678a67b-4541-4e68-b33c-ac41d0f967f2" containerName="switch-graph-0c8e2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:37:14.678566 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:14.678530    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 18 19:37:16.658196 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.658162    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:37:16.810376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.810306    2580 generic.go:356] "Generic (PLEG): container finished" podID="d678a67b-4541-4e68-b33c-ac41d0f967f2" containerID="10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c" exitCode=0
Sep 18 19:37:16.810376 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.810351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" event={"ID":"d678a67b-4541-4e68-b33c-ac41d0f967f2","Type":"ContainerDied","Data":"10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c"}
Sep 18 19:37:16.810582 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.810416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8" event={"ID":"d678a67b-4541-4e68-b33c-ac41d0f967f2","Type":"ContainerDied","Data":"ff44e6026c28c1a5bde9fc5b66eff331bbf8cd6727cd2a15c65ea4dd5246004d"}
Sep 18 19:37:16.810582 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.810357    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"
Sep 18 19:37:16.810582 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.810451    2580 scope.go:117] "RemoveContainer" containerID="10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c"
Sep 18 19:37:16.819017 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.819001    2580 scope.go:117] "RemoveContainer" containerID="10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c"
Sep 18 19:37:16.819288 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:37:16.819270    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c\": container with ID starting with 10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c not found: ID does not exist" containerID="10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c"
Sep 18 19:37:16.819361 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.819301    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c"} err="failed to get container status \"10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c\": rpc error: code = NotFound desc = could not find container \"10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c\": container with ID starting with 10cfeaa27fc78d2ded4ffe516648a92f0e70740e630c787ddd7951d6c707327c not found: ID does not exist"
Sep 18 19:37:16.831571 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.831553    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d678a67b-4541-4e68-b33c-ac41d0f967f2-proxy-tls\") pod \"d678a67b-4541-4e68-b33c-ac41d0f967f2\" (UID: \"d678a67b-4541-4e68-b33c-ac41d0f967f2\") "
Sep 18 19:37:16.831658 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.831604    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d678a67b-4541-4e68-b33c-ac41d0f967f2-openshift-service-ca-bundle\") pod \"d678a67b-4541-4e68-b33c-ac41d0f967f2\" (UID: \"d678a67b-4541-4e68-b33c-ac41d0f967f2\") "
Sep 18 19:37:16.831960 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.831940    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d678a67b-4541-4e68-b33c-ac41d0f967f2-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "d678a67b-4541-4e68-b33c-ac41d0f967f2" (UID: "d678a67b-4541-4e68-b33c-ac41d0f967f2"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:37:16.833698 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.833675    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d678a67b-4541-4e68-b33c-ac41d0f967f2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d678a67b-4541-4e68-b33c-ac41d0f967f2" (UID: "d678a67b-4541-4e68-b33c-ac41d0f967f2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:37:16.932175 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.932155    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d678a67b-4541-4e68-b33c-ac41d0f967f2-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:37:16.932257 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:16.932177    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d678a67b-4541-4e68-b33c-ac41d0f967f2-openshift-service-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:37:17.136899 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:17.136870    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"]
Sep 18 19:37:17.139777 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:17.139750    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0c8e2-7c84fdbd88-m5wb8"]
Sep 18 19:37:18.375874 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:18.375845    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d678a67b-4541-4e68-b33c-ac41d0f967f2" path="/var/lib/kubelet/pods/d678a67b-4541-4e68-b33c-ac41d0f967f2/volumes"
Sep 18 19:37:24.678359 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:24.678321    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 18 19:37:34.679178 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:34.679137    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:37:37.256165 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.256129    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"]
Sep 18 19:37:37.256548 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.256328    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" podUID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" containerName="sequence-graph-eff75" containerID="cri-o://10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c" gracePeriod=30
Sep 18 19:37:37.386713 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.386683    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"]
Sep 18 19:37:37.386931 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.386896    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kserve-container" containerID="cri-o://25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a" gracePeriod=30
Sep 18 19:37:37.387076 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.387040    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kube-rbac-proxy" containerID="cri-o://ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc" gracePeriod=30
Sep 18 19:37:37.497858 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.497829    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"]
Sep 18 19:37:37.498243 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.498228    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d678a67b-4541-4e68-b33c-ac41d0f967f2" containerName="switch-graph-0c8e2"
Sep 18 19:37:37.498296 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.498245    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d678a67b-4541-4e68-b33c-ac41d0f967f2" containerName="switch-graph-0c8e2"
Sep 18 19:37:37.498296 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.498254    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kube-rbac-proxy"
Sep 18 19:37:37.498296 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.498259    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kube-rbac-proxy"
Sep 18 19:37:37.498296 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.498273    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kserve-container"
Sep 18 19:37:37.498296 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.498279    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kserve-container"
Sep 18 19:37:37.498484 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.498330    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kserve-container"
Sep 18 19:37:37.498484 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.498339    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d678a67b-4541-4e68-b33c-ac41d0f967f2" containerName="switch-graph-0c8e2"
Sep 18 19:37:37.498484 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.498345    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ac43eb-10ef-4ebe-a44d-5effdf16bc7b" containerName="kube-rbac-proxy"
Sep 18 19:37:37.502632 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.502613    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:37.505778 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.505759    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-6d8ab-kube-rbac-proxy-sar-config\""
Sep 18 19:37:37.506044 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.506024    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-6d8ab-predictor-serving-cert\""
Sep 18 19:37:37.520031 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.520008    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"]
Sep 18 19:37:37.579637 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.579609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f2647e3-cc5e-410f-9362-21da9e48d956-proxy-tls\") pod \"success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") " pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:37.579740 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.579712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj6jk\" (UniqueName: \"kubernetes.io/projected/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-api-access-fj6jk\") pod \"success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") " pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:37.579790 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.579746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") " pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:37.680423 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.680396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj6jk\" (UniqueName: \"kubernetes.io/projected/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-api-access-fj6jk\") pod \"success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") " pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:37.680423 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.680428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") " pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:37.680615 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.680477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f2647e3-cc5e-410f-9362-21da9e48d956-proxy-tls\") pod \"success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") " pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:37.681147 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.681118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") " pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:37.682959 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.682939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f2647e3-cc5e-410f-9362-21da9e48d956-proxy-tls\") pod \"success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") " pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:37.695317 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.695291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj6jk\" (UniqueName: \"kubernetes.io/projected/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-api-access-fj6jk\") pod \"success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") " pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:37.812293 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.812229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:37.906378 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.906349    2580 generic.go:356] "Generic (PLEG): container finished" podID="38d5f291-3a1d-4450-a3c4-864192b33970" containerID="ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc" exitCode=2
Sep 18 19:37:37.906513 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:37.906434    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" event={"ID":"38d5f291-3a1d-4450-a3c4-864192b33970","Type":"ContainerDied","Data":"ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc"}
Sep 18 19:37:38.086023 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:38.086001    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"]
Sep 18 19:37:38.088785 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:37:38.088761    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2647e3_cc5e_410f_9362_21da9e48d956.slice/crio-83bac4cc15758dfd39165049a2029e279588fa44ec0eceab85eda4c3d4a66de9 WatchSource:0}: Error finding container 83bac4cc15758dfd39165049a2029e279588fa44ec0eceab85eda4c3d4a66de9: Status 404 returned error can't find the container with id 83bac4cc15758dfd39165049a2029e279588fa44ec0eceab85eda4c3d4a66de9
Sep 18 19:37:38.912960 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:38.912929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" event={"ID":"9f2647e3-cc5e-410f-9362-21da9e48d956","Type":"ContainerStarted","Data":"39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41"}
Sep 18 19:37:38.913345 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:38.913003    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" event={"ID":"9f2647e3-cc5e-410f-9362-21da9e48d956","Type":"ContainerStarted","Data":"d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906"}
Sep 18 19:37:38.913345 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:38.913030    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:38.913345 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:38.913049    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" event={"ID":"9f2647e3-cc5e-410f-9362-21da9e48d956","Type":"ContainerStarted","Data":"83bac4cc15758dfd39165049a2029e279588fa44ec0eceab85eda4c3d4a66de9"}
Sep 18 19:37:38.913345 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:38.913075    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:38.914504 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:38.914476    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 19:37:38.933565 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:38.933516    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" podStartSLOduration=1.933498707 podStartE2EDuration="1.933498707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:37:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:37:38.933465823 +0000 UTC m=+1422.578221163" watchObservedRunningTime="2026-09-18 19:37:38.933498707 +0000 UTC m=+1422.578254024"
Sep 18 19:37:39.515083 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:39.515036    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" podUID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" containerName="sequence-graph-eff75" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:37:39.917840 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:39.917795    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 19:37:40.225777 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.225744    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Sep 18 19:37:40.231274 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.231242    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 19:37:40.335986 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.335956    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:37:40.401353 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.401326    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/38d5f291-3a1d-4450-a3c4-864192b33970-kube-rbac-proxy-sar-config\") pod \"38d5f291-3a1d-4450-a3c4-864192b33970\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") "
Sep 18 19:37:40.401493 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.401374    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls\") pod \"38d5f291-3a1d-4450-a3c4-864192b33970\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") "
Sep 18 19:37:40.401493 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.401435    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mwjd\" (UniqueName: \"kubernetes.io/projected/38d5f291-3a1d-4450-a3c4-864192b33970-kube-api-access-8mwjd\") pod \"38d5f291-3a1d-4450-a3c4-864192b33970\" (UID: \"38d5f291-3a1d-4450-a3c4-864192b33970\") "
Sep 18 19:37:40.401719 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.401686    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d5f291-3a1d-4450-a3c4-864192b33970-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "38d5f291-3a1d-4450-a3c4-864192b33970" (UID: "38d5f291-3a1d-4450-a3c4-864192b33970"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:37:40.403642 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.403618    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "38d5f291-3a1d-4450-a3c4-864192b33970" (UID: "38d5f291-3a1d-4450-a3c4-864192b33970"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:37:40.403642 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.403622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d5f291-3a1d-4450-a3c4-864192b33970-kube-api-access-8mwjd" (OuterVolumeSpecName: "kube-api-access-8mwjd") pod "38d5f291-3a1d-4450-a3c4-864192b33970" (UID: "38d5f291-3a1d-4450-a3c4-864192b33970"). InnerVolumeSpecName "kube-api-access-8mwjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:37:40.502338 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.502289    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/38d5f291-3a1d-4450-a3c4-864192b33970-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:37:40.502338 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.502310    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mwjd\" (UniqueName: \"kubernetes.io/projected/38d5f291-3a1d-4450-a3c4-864192b33970-kube-api-access-8mwjd\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:37:40.502338 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.502321    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/38d5f291-3a1d-4450-a3c4-864192b33970-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:37:40.923927 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.923895    2580 generic.go:356] "Generic (PLEG): container finished" podID="38d5f291-3a1d-4450-a3c4-864192b33970" containerID="25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a" exitCode=0
Sep 18 19:37:40.924294 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.923939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" event={"ID":"38d5f291-3a1d-4450-a3c4-864192b33970","Type":"ContainerDied","Data":"25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a"}
Sep 18 19:37:40.924294 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.923995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c" event={"ID":"38d5f291-3a1d-4450-a3c4-864192b33970","Type":"ContainerDied","Data":"7e300f33b7d3235b2691dbf5fc03e0752e141accee2e89809c3a1983dfc1bb58"}
Sep 18 19:37:40.924294 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.923941    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"
Sep 18 19:37:40.924294 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.924021    2580 scope.go:117] "RemoveContainer" containerID="ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc"
Sep 18 19:37:40.932805 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.932787    2580 scope.go:117] "RemoveContainer" containerID="25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a"
Sep 18 19:37:40.940645 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.940628    2580 scope.go:117] "RemoveContainer" containerID="ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc"
Sep 18 19:37:40.940894 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:37:40.940876    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc\": container with ID starting with ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc not found: ID does not exist" containerID="ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc"
Sep 18 19:37:40.940951 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.940901    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc"} err="failed to get container status \"ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc\": rpc error: code = NotFound desc = could not find container \"ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc\": container with ID starting with ffd3611d590597fc5be63da74200f393e0d465c020e251cbfb9fa294572745fc not found: ID does not exist"
Sep 18 19:37:40.940951 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.940916    2580 scope.go:117] "RemoveContainer" containerID="25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a"
Sep 18 19:37:40.941189 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:37:40.941172    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a\": container with ID starting with 25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a not found: ID does not exist" containerID="25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a"
Sep 18 19:37:40.941228 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.941196    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a"} err="failed to get container status \"25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a\": rpc error: code = NotFound desc = could not find container \"25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a\": container with ID starting with 25554b3aafcfb7164c83283310c3df42922c730209c17d93d631a8ac15d0670a not found: ID does not exist"
Sep 18 19:37:40.958022 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.953689    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"]
Sep 18 19:37:40.961114 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:40.961095    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eff75-predictor-84d6cb4997-pv47c"]
Sep 18 19:37:42.375340 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:42.375303    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" path="/var/lib/kubelet/pods/38d5f291-3a1d-4450-a3c4-864192b33970/volumes"
Sep 18 19:37:44.514742 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:44.514699    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" podUID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" containerName="sequence-graph-eff75" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:37:44.921919 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:44.921891    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:37:44.922397 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:44.922365    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 19:37:46.799561 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.799524    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"]
Sep 18 19:37:46.800095 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.800076    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kserve-container"
Sep 18 19:37:46.800182 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.800096    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kserve-container"
Sep 18 19:37:46.800182 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.800123    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kube-rbac-proxy"
Sep 18 19:37:46.800182 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.800130    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kube-rbac-proxy"
Sep 18 19:37:46.800343 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.800214    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kserve-container"
Sep 18 19:37:46.800343 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.800226    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d5f291-3a1d-4450-a3c4-864192b33970" containerName="kube-rbac-proxy"
Sep 18 19:37:46.803379 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.803357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:37:46.806748 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.806727    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-e0eb2-serving-cert\""
Sep 18 19:37:46.806845 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.806807    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-e0eb2-kube-rbac-proxy-sar-config\""
Sep 18 19:37:46.817829 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.817808    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"]
Sep 18 19:37:46.846573 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.846552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-proxy-tls\") pod \"ensemble-graph-e0eb2-66557d9bc-jj876\" (UID: \"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb\") " pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:37:46.846662 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.846586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-openshift-service-ca-bundle\") pod \"ensemble-graph-e0eb2-66557d9bc-jj876\" (UID: \"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb\") " pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:37:46.947895 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.947863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-proxy-tls\") pod \"ensemble-graph-e0eb2-66557d9bc-jj876\" (UID: \"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb\") " pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:37:46.948038 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.947903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-openshift-service-ca-bundle\") pod \"ensemble-graph-e0eb2-66557d9bc-jj876\" (UID: \"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb\") " pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:37:46.948564 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.948548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-openshift-service-ca-bundle\") pod \"ensemble-graph-e0eb2-66557d9bc-jj876\" (UID: \"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb\") " pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:37:46.950483 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:46.950463    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-proxy-tls\") pod \"ensemble-graph-e0eb2-66557d9bc-jj876\" (UID: \"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb\") " pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:37:47.113207 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:47.113180    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:37:47.404391 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:47.404355    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"]
Sep 18 19:37:47.406814 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:37:47.406789    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e6ad82_45fc_443e_b4ed_d917dcaa2bbb.slice/crio-3ace573cf2ae0a203eda4a896261923d41cc7dcefb1fdcf444e9349e024b478c WatchSource:0}: Error finding container 3ace573cf2ae0a203eda4a896261923d41cc7dcefb1fdcf444e9349e024b478c: Status 404 returned error can't find the container with id 3ace573cf2ae0a203eda4a896261923d41cc7dcefb1fdcf444e9349e024b478c
Sep 18 19:37:47.962703 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:47.962668    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" event={"ID":"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb","Type":"ContainerStarted","Data":"78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33"}
Sep 18 19:37:47.963157 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:47.962719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" event={"ID":"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb","Type":"ContainerStarted","Data":"3ace573cf2ae0a203eda4a896261923d41cc7dcefb1fdcf444e9349e024b478c"}
Sep 18 19:37:47.963157 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:47.962752    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:37:47.984885 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:47.984841    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" podStartSLOduration=1.984826787 podStartE2EDuration="1.984826787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:37:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:37:47.983132986 +0000 UTC m=+1431.627888304" watchObservedRunningTime="2026-09-18 19:37:47.984826787 +0000 UTC m=+1431.629582106"
Sep 18 19:37:49.514930 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:49.514892    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" podUID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" containerName="sequence-graph-eff75" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:37:49.515340 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:49.515026    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:37:53.973356 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:53.973323    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:37:54.515327 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:54.515286    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" podUID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" containerName="sequence-graph-eff75" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:37:54.923167 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:54.923130    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 19:37:57.302662 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.302627    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"]
Sep 18 19:37:57.303079 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.302818    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" podUID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" containerName="ensemble-graph-e0eb2" containerID="cri-o://78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33" gracePeriod=30
Sep 18 19:37:57.398847 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.398815    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"]
Sep 18 19:37:57.399192 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.399152    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kserve-container" containerID="cri-o://6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a" gracePeriod=30
Sep 18 19:37:57.399305 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.399222    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kube-rbac-proxy" containerID="cri-o://38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b" gracePeriod=30
Sep 18 19:37:57.514933 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.514906    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"]
Sep 18 19:37:57.518333 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.518314    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:57.521096 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.521078    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c155b-predictor-serving-cert\""
Sep 18 19:37:57.521571 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.521553    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c155b-kube-rbac-proxy-sar-config\""
Sep 18 19:37:57.529913 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.529882    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"]
Sep 18 19:37:57.632566 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.632536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/528e655c-f064-4061-85e8-daab5265109d-proxy-tls\") pod \"success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") " pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:57.632723 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.632577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/528e655c-f064-4061-85e8-daab5265109d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") " pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:57.632723 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.632596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ktxc\" (UniqueName: \"kubernetes.io/projected/528e655c-f064-4061-85e8-daab5265109d-kube-api-access-2ktxc\") pod \"success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") " pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:57.734037 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.734006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/528e655c-f064-4061-85e8-daab5265109d-proxy-tls\") pod \"success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") " pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:57.734184 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.734048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/528e655c-f064-4061-85e8-daab5265109d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") " pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:57.734184 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.734076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ktxc\" (UniqueName: \"kubernetes.io/projected/528e655c-f064-4061-85e8-daab5265109d-kube-api-access-2ktxc\") pod \"success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") " pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:57.734747 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.734694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/528e655c-f064-4061-85e8-daab5265109d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") " pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:57.736699 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.736675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/528e655c-f064-4061-85e8-daab5265109d-proxy-tls\") pod \"success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") " pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:57.742549 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.742528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ktxc\" (UniqueName: \"kubernetes.io/projected/528e655c-f064-4061-85e8-daab5265109d-kube-api-access-2ktxc\") pod \"success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") " pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:57.828222 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:57.828201    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:58.014945 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:58.014910    2580 generic.go:356] "Generic (PLEG): container finished" podID="41667039-c78d-4f53-9518-8e524c30d9b0" containerID="38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b" exitCode=2
Sep 18 19:37:58.015102 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:58.015011    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" event={"ID":"41667039-c78d-4f53-9518-8e524c30d9b0","Type":"ContainerDied","Data":"38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b"}
Sep 18 19:37:58.109298 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:58.109272    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"]
Sep 18 19:37:58.110848 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:37:58.110822    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528e655c_f064_4061_85e8_daab5265109d.slice/crio-66b3bc27c16e6a33854e9fdf0fc5f9521f5cf616e900d3fb134cc1f57b3c3e7b WatchSource:0}: Error finding container 66b3bc27c16e6a33854e9fdf0fc5f9521f5cf616e900d3fb134cc1f57b3c3e7b: Status 404 returned error can't find the container with id 66b3bc27c16e6a33854e9fdf0fc5f9521f5cf616e900d3fb134cc1f57b3c3e7b
Sep 18 19:37:58.971738 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:58.971700    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" podUID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" containerName="ensemble-graph-e0eb2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:37:59.027329 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:59.027293    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" event={"ID":"528e655c-f064-4061-85e8-daab5265109d","Type":"ContainerStarted","Data":"cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b"}
Sep 18 19:37:59.027507 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:59.027390    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" event={"ID":"528e655c-f064-4061-85e8-daab5265109d","Type":"ContainerStarted","Data":"fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74"}
Sep 18 19:37:59.027507 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:59.027428    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:37:59.027507 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:59.027453    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" event={"ID":"528e655c-f064-4061-85e8-daab5265109d","Type":"ContainerStarted","Data":"66b3bc27c16e6a33854e9fdf0fc5f9521f5cf616e900d3fb134cc1f57b3c3e7b"}
Sep 18 19:37:59.049914 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:59.049868    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" podStartSLOduration=2.049854089 podStartE2EDuration="2.049854089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:37:59.047691117 +0000 UTC m=+1442.692446458" watchObservedRunningTime="2026-09-18 19:37:59.049854089 +0000 UTC m=+1442.694609408"
Sep 18 19:37:59.515390 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:59.515353    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" podUID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" containerName="sequence-graph-eff75" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:37:59.673710 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:37:59.673670    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused"
Sep 18 19:38:00.032017 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.031966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:38:00.033448 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.033414    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 19:38:00.653255 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.653231    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:38:00.758769 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.758698    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/41667039-c78d-4f53-9518-8e524c30d9b0-kube-rbac-proxy-sar-config\") pod \"41667039-c78d-4f53-9518-8e524c30d9b0\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") "
Sep 18 19:38:00.758925 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.758784    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/41667039-c78d-4f53-9518-8e524c30d9b0-proxy-tls\") pod \"41667039-c78d-4f53-9518-8e524c30d9b0\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") "
Sep 18 19:38:00.758925 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.758821    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8fqn\" (UniqueName: \"kubernetes.io/projected/41667039-c78d-4f53-9518-8e524c30d9b0-kube-api-access-t8fqn\") pod \"41667039-c78d-4f53-9518-8e524c30d9b0\" (UID: \"41667039-c78d-4f53-9518-8e524c30d9b0\") "
Sep 18 19:38:00.759089 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.759052    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41667039-c78d-4f53-9518-8e524c30d9b0-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "41667039-c78d-4f53-9518-8e524c30d9b0" (UID: "41667039-c78d-4f53-9518-8e524c30d9b0"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:38:00.761232 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.761208    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41667039-c78d-4f53-9518-8e524c30d9b0-kube-api-access-t8fqn" (OuterVolumeSpecName: "kube-api-access-t8fqn") pod "41667039-c78d-4f53-9518-8e524c30d9b0" (UID: "41667039-c78d-4f53-9518-8e524c30d9b0"). InnerVolumeSpecName "kube-api-access-t8fqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:38:00.761377 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.761357    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41667039-c78d-4f53-9518-8e524c30d9b0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "41667039-c78d-4f53-9518-8e524c30d9b0" (UID: "41667039-c78d-4f53-9518-8e524c30d9b0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:38:00.859480 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.859452    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/41667039-c78d-4f53-9518-8e524c30d9b0-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:38:00.859480 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.859474    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8fqn\" (UniqueName: \"kubernetes.io/projected/41667039-c78d-4f53-9518-8e524c30d9b0-kube-api-access-t8fqn\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:38:00.859480 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:00.859484    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/41667039-c78d-4f53-9518-8e524c30d9b0-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:38:01.039102 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.039021    2580 generic.go:356] "Generic (PLEG): container finished" podID="41667039-c78d-4f53-9518-8e524c30d9b0" containerID="6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a" exitCode=0
Sep 18 19:38:01.039102 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.039082    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"
Sep 18 19:38:01.039628 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.039111    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" event={"ID":"41667039-c78d-4f53-9518-8e524c30d9b0","Type":"ContainerDied","Data":"6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a"}
Sep 18 19:38:01.039628 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.039185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc" event={"ID":"41667039-c78d-4f53-9518-8e524c30d9b0","Type":"ContainerDied","Data":"8057f85389851480b116e2b01f9fa0794cdd3ad45c5d7d7ccb339cf491dba128"}
Sep 18 19:38:01.039628 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.039227    2580 scope.go:117] "RemoveContainer" containerID="38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b"
Sep 18 19:38:01.039785 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.039727    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 19:38:01.048550 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.048534    2580 scope.go:117] "RemoveContainer" containerID="6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a"
Sep 18 19:38:01.056321 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.056303    2580 scope.go:117] "RemoveContainer" containerID="38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b"
Sep 18 19:38:01.056584 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:38:01.056564    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b\": container with ID starting with 38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b not found: ID does not exist" containerID="38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b"
Sep 18 19:38:01.056629 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.056593    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b"} err="failed to get container status \"38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b\": rpc error: code = NotFound desc = could not find container \"38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b\": container with ID starting with 38bc2e29fd2dd724784c8d1e59af0e67f2b4baec31766c479aa8983b80028d6b not found: ID does not exist"
Sep 18 19:38:01.056629 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.056610    2580 scope.go:117] "RemoveContainer" containerID="6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a"
Sep 18 19:38:01.056853 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:38:01.056835    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a\": container with ID starting with 6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a not found: ID does not exist" containerID="6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a"
Sep 18 19:38:01.056905 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.056862    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a"} err="failed to get container status \"6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a\": rpc error: code = NotFound desc = could not find container \"6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a\": container with ID starting with 6e1ad7816a38dda25a2926e3c32781667c4bc9669e76571e8fdaa70a74f9ee2a not found: ID does not exist"
Sep 18 19:38:01.067029 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.067005    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"]
Sep 18 19:38:01.071318 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:01.071297    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-e0eb2-predictor-59fdf574f5-mrftc"]
Sep 18 19:38:02.375833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:02.375798    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" path="/var/lib/kubelet/pods/41667039-c78d-4f53-9518-8e524c30d9b0/volumes"
Sep 18 19:38:03.971908 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:03.971871    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" podUID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" containerName="ensemble-graph-e0eb2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:38:04.515539 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:04.515501    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" podUID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" containerName="sequence-graph-eff75" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:38:04.922722 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:04.922687    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 19:38:06.044492 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:06.044465    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:38:06.044875 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:06.044850    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 19:38:07.415689 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:07.415665    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:38:07.511435 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:07.511367    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5b9ce6d1-e24c-4f05-b136-34e23d122d61-proxy-tls\") pod \"5b9ce6d1-e24c-4f05-b136-34e23d122d61\" (UID: \"5b9ce6d1-e24c-4f05-b136-34e23d122d61\") "
Sep 18 19:38:07.511435 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:07.511397    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b9ce6d1-e24c-4f05-b136-34e23d122d61-openshift-service-ca-bundle\") pod \"5b9ce6d1-e24c-4f05-b136-34e23d122d61\" (UID: \"5b9ce6d1-e24c-4f05-b136-34e23d122d61\") "
Sep 18 19:38:07.511857 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:07.511805    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b9ce6d1-e24c-4f05-b136-34e23d122d61-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "5b9ce6d1-e24c-4f05-b136-34e23d122d61" (UID: "5b9ce6d1-e24c-4f05-b136-34e23d122d61"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:38:07.513571 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:07.513544    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9ce6d1-e24c-4f05-b136-34e23d122d61-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5b9ce6d1-e24c-4f05-b136-34e23d122d61" (UID: "5b9ce6d1-e24c-4f05-b136-34e23d122d61"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:38:07.612419 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:07.612395    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5b9ce6d1-e24c-4f05-b136-34e23d122d61-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:38:07.612419 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:07.612417    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b9ce6d1-e24c-4f05-b136-34e23d122d61-openshift-service-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:38:08.075542 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.075508    2580 generic.go:356] "Generic (PLEG): container finished" podID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" containerID="10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c" exitCode=0
Sep 18 19:38:08.075717 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.075559    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"
Sep 18 19:38:08.075717 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.075589    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" event={"ID":"5b9ce6d1-e24c-4f05-b136-34e23d122d61","Type":"ContainerDied","Data":"10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c"}
Sep 18 19:38:08.075717 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.075644    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z" event={"ID":"5b9ce6d1-e24c-4f05-b136-34e23d122d61","Type":"ContainerDied","Data":"74400c14e31e01afe49b0e82b786e1559ba6315ded58dbd0921897e2a65f916f"}
Sep 18 19:38:08.075717 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.075667    2580 scope.go:117] "RemoveContainer" containerID="10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c"
Sep 18 19:38:08.085493 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.085470    2580 scope.go:117] "RemoveContainer" containerID="10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c"
Sep 18 19:38:08.085842 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:38:08.085824    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c\": container with ID starting with 10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c not found: ID does not exist" containerID="10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c"
Sep 18 19:38:08.085917 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.085852    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c"} err="failed to get container status \"10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c\": rpc error: code = NotFound desc = could not find container \"10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c\": container with ID starting with 10a857a1e77f8df702cc5dc33afc1a7c62a853843fd15afeac2505ca8e7ce59c not found: ID does not exist"
Sep 18 19:38:08.098528 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.098503    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"]
Sep 18 19:38:08.102284 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.102265    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-eff75-5f6b6f9b5b-x6k9z"]
Sep 18 19:38:08.375127 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.375104    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" path="/var/lib/kubelet/pods/5b9ce6d1-e24c-4f05-b136-34e23d122d61/volumes"
Sep 18 19:38:08.972054 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.972023    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" podUID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" containerName="ensemble-graph-e0eb2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:38:08.972445 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:08.972133    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:38:13.971393 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:13.971350    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" podUID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" containerName="ensemble-graph-e0eb2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:38:14.922673 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:14.922635    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 19:38:16.045078 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:16.045042    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 19:38:18.971509 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:18.971466    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" podUID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" containerName="ensemble-graph-e0eb2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:38:23.971744 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:23.971704    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" podUID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" containerName="ensemble-graph-e0eb2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:38:24.923203 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:24.923164    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 19:38:26.045515 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:26.045479    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 19:38:27.442761 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:27.442738    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:38:27.561171 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:27.561103    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-openshift-service-ca-bundle\") pod \"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb\" (UID: \"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb\") "
Sep 18 19:38:27.561171 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:27.561168    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-proxy-tls\") pod \"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb\" (UID: \"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb\") "
Sep 18 19:38:27.561440 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:27.561420    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" (UID: "26e6ad82-45fc-443e-b4ed-d917dcaa2bbb"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:38:27.563269 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:27.563247    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" (UID: "26e6ad82-45fc-443e-b4ed-d917dcaa2bbb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:38:27.662080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:27.662053    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-openshift-service-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:38:27.662080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:27.662075    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:38:28.169950 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:28.169915    2580 generic.go:356] "Generic (PLEG): container finished" podID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" containerID="78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33" exitCode=0
Sep 18 19:38:28.170149 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:28.169961    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"
Sep 18 19:38:28.170149 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:28.169965    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" event={"ID":"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb","Type":"ContainerDied","Data":"78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33"}
Sep 18 19:38:28.170149 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:28.170028    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876" event={"ID":"26e6ad82-45fc-443e-b4ed-d917dcaa2bbb","Type":"ContainerDied","Data":"3ace573cf2ae0a203eda4a896261923d41cc7dcefb1fdcf444e9349e024b478c"}
Sep 18 19:38:28.170149 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:28.170050    2580 scope.go:117] "RemoveContainer" containerID="78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33"
Sep 18 19:38:28.178886 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:28.178871    2580 scope.go:117] "RemoveContainer" containerID="78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33"
Sep 18 19:38:28.179172 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:38:28.179154    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33\": container with ID starting with 78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33 not found: ID does not exist" containerID="78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33"
Sep 18 19:38:28.179216 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:28.179180    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33"} err="failed to get container status \"78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33\": rpc error: code = NotFound desc = could not find container \"78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33\": container with ID starting with 78db8a04c894ecaf335122980213b8e5425ed9ffad6eaaf7220f03619c437e33 not found: ID does not exist"
Sep 18 19:38:28.198535 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:28.198514    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"]
Sep 18 19:38:28.204095 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:28.204071    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e0eb2-66557d9bc-jj876"]
Sep 18 19:38:28.375145 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:28.375119    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" path="/var/lib/kubelet/pods/26e6ad82-45fc-443e-b4ed-d917dcaa2bbb/volumes"
Sep 18 19:38:34.923148 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:34.923111    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:38:36.045264 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:36.045224    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 19:38:46.045410 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:46.045371    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:38:47.530293 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530265    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"]
Sep 18 19:38:47.530772 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530752    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" containerName="sequence-graph-eff75"
Sep 18 19:38:47.530855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530775    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" containerName="sequence-graph-eff75"
Sep 18 19:38:47.530855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530795    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kserve-container"
Sep 18 19:38:47.530855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530804    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kserve-container"
Sep 18 19:38:47.530855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530822    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kube-rbac-proxy"
Sep 18 19:38:47.530855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530830    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kube-rbac-proxy"
Sep 18 19:38:47.530855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530844    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" containerName="ensemble-graph-e0eb2"
Sep 18 19:38:47.530855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530853    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" containerName="ensemble-graph-e0eb2"
Sep 18 19:38:47.531221 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530941    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b9ce6d1-e24c-4f05-b136-34e23d122d61" containerName="sequence-graph-eff75"
Sep 18 19:38:47.531221 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530956    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="26e6ad82-45fc-443e-b4ed-d917dcaa2bbb" containerName="ensemble-graph-e0eb2"
Sep 18 19:38:47.531221 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530966    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kube-rbac-proxy"
Sep 18 19:38:47.531221 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.530997    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="41667039-c78d-4f53-9518-8e524c30d9b0" containerName="kserve-container"
Sep 18 19:38:47.533945 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.533926    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:38:47.537433 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.537409    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-6d8ab-kube-rbac-proxy-sar-config\""
Sep 18 19:38:47.537518 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.537453    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-6d8ab-serving-cert\""
Sep 18 19:38:47.551944 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.551917    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"]
Sep 18 19:38:47.608422 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.608394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa43e594-86b1-413a-b77b-f50e11192d96-openshift-service-ca-bundle\") pod \"sequence-graph-6d8ab-8565c985cd-wpxbz\" (UID: \"aa43e594-86b1-413a-b77b-f50e11192d96\") " pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:38:47.608554 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.608441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aa43e594-86b1-413a-b77b-f50e11192d96-proxy-tls\") pod \"sequence-graph-6d8ab-8565c985cd-wpxbz\" (UID: \"aa43e594-86b1-413a-b77b-f50e11192d96\") " pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:38:47.709215 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.709188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa43e594-86b1-413a-b77b-f50e11192d96-openshift-service-ca-bundle\") pod \"sequence-graph-6d8ab-8565c985cd-wpxbz\" (UID: \"aa43e594-86b1-413a-b77b-f50e11192d96\") " pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:38:47.709335 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.709232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aa43e594-86b1-413a-b77b-f50e11192d96-proxy-tls\") pod \"sequence-graph-6d8ab-8565c985cd-wpxbz\" (UID: \"aa43e594-86b1-413a-b77b-f50e11192d96\") " pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:38:47.709385 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:38:47.709338    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-6d8ab-serving-cert: secret "sequence-graph-6d8ab-serving-cert" not found
Sep 18 19:38:47.709421 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:38:47.709402    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa43e594-86b1-413a-b77b-f50e11192d96-proxy-tls podName:aa43e594-86b1-413a-b77b-f50e11192d96 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:48.209383127 +0000 UTC m=+1491.854138429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/aa43e594-86b1-413a-b77b-f50e11192d96-proxy-tls") pod "sequence-graph-6d8ab-8565c985cd-wpxbz" (UID: "aa43e594-86b1-413a-b77b-f50e11192d96") : secret "sequence-graph-6d8ab-serving-cert" not found
Sep 18 19:38:47.709792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:47.709774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa43e594-86b1-413a-b77b-f50e11192d96-openshift-service-ca-bundle\") pod \"sequence-graph-6d8ab-8565c985cd-wpxbz\" (UID: \"aa43e594-86b1-413a-b77b-f50e11192d96\") " pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:38:48.213989 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:48.213922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aa43e594-86b1-413a-b77b-f50e11192d96-proxy-tls\") pod \"sequence-graph-6d8ab-8565c985cd-wpxbz\" (UID: \"aa43e594-86b1-413a-b77b-f50e11192d96\") " pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:38:48.216797 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:48.216762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aa43e594-86b1-413a-b77b-f50e11192d96-proxy-tls\") pod \"sequence-graph-6d8ab-8565c985cd-wpxbz\" (UID: \"aa43e594-86b1-413a-b77b-f50e11192d96\") " pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:38:48.444150 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:48.444124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:38:48.722457 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:48.722431    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"]
Sep 18 19:38:48.724721 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:38:48.724698    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa43e594_86b1_413a_b77b_f50e11192d96.slice/crio-1fdcb888201e5b1dc420ea6924dc744d87869b2fb205d0e45bb09c4d3970cc07 WatchSource:0}: Error finding container 1fdcb888201e5b1dc420ea6924dc744d87869b2fb205d0e45bb09c4d3970cc07: Status 404 returned error can't find the container with id 1fdcb888201e5b1dc420ea6924dc744d87869b2fb205d0e45bb09c4d3970cc07
Sep 18 19:38:49.268058 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:49.268005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" event={"ID":"aa43e594-86b1-413a-b77b-f50e11192d96","Type":"ContainerStarted","Data":"b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88"}
Sep 18 19:38:49.268295 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:49.268091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" event={"ID":"aa43e594-86b1-413a-b77b-f50e11192d96","Type":"ContainerStarted","Data":"1fdcb888201e5b1dc420ea6924dc744d87869b2fb205d0e45bb09c4d3970cc07"}
Sep 18 19:38:49.268295 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:49.268117    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:38:49.287431 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:49.287309    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" podStartSLOduration=2.28729071 podStartE2EDuration="2.28729071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:49.287264665 +0000 UTC m=+1492.932020002" watchObservedRunningTime="2026-09-18 19:38:49.28729071 +0000 UTC m=+1492.932046010"
Sep 18 19:38:55.278332 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:55.278295    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:38:57.563594 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.563561    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"]
Sep 18 19:38:57.567077 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.567058    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:38:57.570453 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.570433    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-c155b-serving-cert\""
Sep 18 19:38:57.570593 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.570467    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-c155b-kube-rbac-proxy-sar-config\""
Sep 18 19:38:57.578262 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.578239    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"]
Sep 18 19:38:57.691662 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.691633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-openshift-service-ca-bundle\") pod \"ensemble-graph-c155b-fdbb4f9cb-9wl2z\" (UID: \"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4\") " pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:38:57.691795 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.691687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-proxy-tls\") pod \"ensemble-graph-c155b-fdbb4f9cb-9wl2z\" (UID: \"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4\") " pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:38:57.792399 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.792371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-proxy-tls\") pod \"ensemble-graph-c155b-fdbb4f9cb-9wl2z\" (UID: \"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4\") " pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:38:57.792515 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.792419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-openshift-service-ca-bundle\") pod \"ensemble-graph-c155b-fdbb4f9cb-9wl2z\" (UID: \"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4\") " pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:38:57.792965 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.792945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-openshift-service-ca-bundle\") pod \"ensemble-graph-c155b-fdbb4f9cb-9wl2z\" (UID: \"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4\") " pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:38:57.794801 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.794779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-proxy-tls\") pod \"ensemble-graph-c155b-fdbb4f9cb-9wl2z\" (UID: \"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4\") " pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:38:57.878634 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:57.878613    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:38:58.154318 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.154284    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"]
Sep 18 19:38:58.156770 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:38:58.156736    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cbdd583_b50f_4ed0_b586_0090a4fd2ef4.slice/crio-9f58f245067ceba82b0ba5642fdf3529f14f7ba43b73f8c8bc8f8df645dee719 WatchSource:0}: Error finding container 9f58f245067ceba82b0ba5642fdf3529f14f7ba43b73f8c8bc8f8df645dee719: Status 404 returned error can't find the container with id 9f58f245067ceba82b0ba5642fdf3529f14f7ba43b73f8c8bc8f8df645dee719
Sep 18 19:38:58.312393 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.312359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" event={"ID":"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4","Type":"ContainerStarted","Data":"01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e"}
Sep 18 19:38:58.312545 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.312410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" event={"ID":"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4","Type":"ContainerStarted","Data":"9f58f245067ceba82b0ba5642fdf3529f14f7ba43b73f8c8bc8f8df645dee719"}
Sep 18 19:38:58.312545 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.312431    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:38:58.333693 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.333644    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" podStartSLOduration=1.333627372 podStartE2EDuration="1.333627372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:38:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:58.333102343 +0000 UTC m=+1501.977857662" watchObservedRunningTime="2026-09-18 19:38:58.333627372 +0000 UTC m=+1501.978382695"
Sep 18 19:38:58.402030 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.402003    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:38:58.404371 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.404312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:38:58.411599 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.411579    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:38:58.414150 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.414125    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:38:58.467904 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.467879    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"]
Sep 18 19:38:58.468133 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.468092    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" podUID="aa43e594-86b1-413a-b77b-f50e11192d96" containerName="sequence-graph-6d8ab" containerID="cri-o://b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88" gracePeriod=30
Sep 18 19:38:58.558855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.558827    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"]
Sep 18 19:38:58.559073 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.559048    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kserve-container" containerID="cri-o://d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906" gracePeriod=30
Sep 18 19:38:58.559134 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.559072    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kube-rbac-proxy" containerID="cri-o://39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41" gracePeriod=30
Sep 18 19:38:58.721523 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.721493    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"]
Sep 18 19:38:58.724846 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.724828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:38:58.727861 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.727826    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-ad04b-predictor-serving-cert\""
Sep 18 19:38:58.727966 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.727865    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-ad04b-kube-rbac-proxy-sar-config\""
Sep 18 19:38:58.744447 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.744424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"]
Sep 18 19:38:58.798156 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.798121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a36d95d-b71a-494f-b8ee-23930a4e81e9-proxy-tls\") pod \"success-200-isvc-ad04b-predictor-56fd678f5c-ghsss\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") " pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:38:58.798283 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.798216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-ad04b-predictor-56fd678f5c-ghsss\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") " pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:38:58.798283 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.798246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vd28\" (UniqueName: \"kubernetes.io/projected/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-api-access-7vd28\") pod \"success-200-isvc-ad04b-predictor-56fd678f5c-ghsss\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") " pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:38:58.899256 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.899224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-ad04b-predictor-56fd678f5c-ghsss\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") " pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:38:58.899256 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.899255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vd28\" (UniqueName: \"kubernetes.io/projected/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-api-access-7vd28\") pod \"success-200-isvc-ad04b-predictor-56fd678f5c-ghsss\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") " pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:38:58.899441 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.899309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a36d95d-b71a-494f-b8ee-23930a4e81e9-proxy-tls\") pod \"success-200-isvc-ad04b-predictor-56fd678f5c-ghsss\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") " pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:38:58.899943 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.899924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-ad04b-predictor-56fd678f5c-ghsss\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") " pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:38:58.901783 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.901766    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a36d95d-b71a-494f-b8ee-23930a4e81e9-proxy-tls\") pod \"success-200-isvc-ad04b-predictor-56fd678f5c-ghsss\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") " pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:38:58.909984 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:58.909949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vd28\" (UniqueName: \"kubernetes.io/projected/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-api-access-7vd28\") pod \"success-200-isvc-ad04b-predictor-56fd678f5c-ghsss\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") " pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:38:59.035021 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:59.034951    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:38:59.319050 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:59.318941    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"]
Sep 18 19:38:59.320218 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:59.320185    2580 generic.go:356] "Generic (PLEG): container finished" podID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerID="39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41" exitCode=2
Sep 18 19:38:59.320297 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:59.320249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" event={"ID":"9f2647e3-cc5e-410f-9362-21da9e48d956","Type":"ContainerDied","Data":"39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41"}
Sep 18 19:38:59.321466 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:38:59.321437    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a36d95d_b71a_494f_b8ee_23930a4e81e9.slice/crio-d907e2bd402af15aff7533b5f8272fba1ce5fe7d4407381c094e4a153de0c0ab WatchSource:0}: Error finding container d907e2bd402af15aff7533b5f8272fba1ce5fe7d4407381c094e4a153de0c0ab: Status 404 returned error can't find the container with id d907e2bd402af15aff7533b5f8272fba1ce5fe7d4407381c094e4a153de0c0ab
Sep 18 19:38:59.918228 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:38:59.918190    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.39:8643/healthz\": dial tcp 10.132.0.39:8643: connect: connection refused"
Sep 18 19:39:00.277260 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:00.277177    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" podUID="aa43e594-86b1-413a-b77b-f50e11192d96" containerName="sequence-graph-6d8ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:39:00.326379 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:00.326338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" event={"ID":"7a36d95d-b71a-494f-b8ee-23930a4e81e9","Type":"ContainerStarted","Data":"2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6"}
Sep 18 19:39:00.326554 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:00.326394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" event={"ID":"7a36d95d-b71a-494f-b8ee-23930a4e81e9","Type":"ContainerStarted","Data":"a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3"}
Sep 18 19:39:00.326554 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:00.326427    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" event={"ID":"7a36d95d-b71a-494f-b8ee-23930a4e81e9","Type":"ContainerStarted","Data":"d907e2bd402af15aff7533b5f8272fba1ce5fe7d4407381c094e4a153de0c0ab"}
Sep 18 19:39:00.326554 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:00.326453    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:39:00.326554 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:00.326471    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:39:00.328127 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:00.328099    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 19:39:00.362575 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:00.362531    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" podStartSLOduration=2.362516206 podStartE2EDuration="2.362516206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:00.359229631 +0000 UTC m=+1504.003984951" watchObservedRunningTime="2026-09-18 19:39:00.362516206 +0000 UTC m=+1504.007271525"
Sep 18 19:39:01.331349 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:01.331304    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 19:39:01.801434 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:01.801413    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:39:01.925764 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:01.925701    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj6jk\" (UniqueName: \"kubernetes.io/projected/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-api-access-fj6jk\") pod \"9f2647e3-cc5e-410f-9362-21da9e48d956\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") "
Sep 18 19:39:01.925764 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:01.925754    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f2647e3-cc5e-410f-9362-21da9e48d956-proxy-tls\") pod \"9f2647e3-cc5e-410f-9362-21da9e48d956\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") "
Sep 18 19:39:01.925985 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:01.925808    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-rbac-proxy-sar-config\") pod \"9f2647e3-cc5e-410f-9362-21da9e48d956\" (UID: \"9f2647e3-cc5e-410f-9362-21da9e48d956\") "
Sep 18 19:39:01.926179 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:01.926156    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9f2647e3-cc5e-410f-9362-21da9e48d956" (UID: "9f2647e3-cc5e-410f-9362-21da9e48d956"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:39:01.927957 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:01.927931    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-api-access-fj6jk" (OuterVolumeSpecName: "kube-api-access-fj6jk") pod "9f2647e3-cc5e-410f-9362-21da9e48d956" (UID: "9f2647e3-cc5e-410f-9362-21da9e48d956"). InnerVolumeSpecName "kube-api-access-fj6jk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:39:01.928187 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:01.928152    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f2647e3-cc5e-410f-9362-21da9e48d956-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9f2647e3-cc5e-410f-9362-21da9e48d956" (UID: "9f2647e3-cc5e-410f-9362-21da9e48d956"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:39:02.026631 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.026603    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f2647e3-cc5e-410f-9362-21da9e48d956-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:39:02.026725 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.026637    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:39:02.026725 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.026648    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj6jk\" (UniqueName: \"kubernetes.io/projected/9f2647e3-cc5e-410f-9362-21da9e48d956-kube-api-access-fj6jk\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:39:02.337481 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.337453    2580 generic.go:356] "Generic (PLEG): container finished" podID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerID="d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906" exitCode=0
Sep 18 19:39:02.337808 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.337498    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"
Sep 18 19:39:02.337808 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.337539    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" event={"ID":"9f2647e3-cc5e-410f-9362-21da9e48d956","Type":"ContainerDied","Data":"d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906"}
Sep 18 19:39:02.337808 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.337597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l" event={"ID":"9f2647e3-cc5e-410f-9362-21da9e48d956","Type":"ContainerDied","Data":"83bac4cc15758dfd39165049a2029e279588fa44ec0eceab85eda4c3d4a66de9"}
Sep 18 19:39:02.337808 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.337625    2580 scope.go:117] "RemoveContainer" containerID="39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41"
Sep 18 19:39:02.346558 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.346543    2580 scope.go:117] "RemoveContainer" containerID="d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906"
Sep 18 19:39:02.353826 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.353811    2580 scope.go:117] "RemoveContainer" containerID="39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41"
Sep 18 19:39:02.354091 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:39:02.354072    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41\": container with ID starting with 39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41 not found: ID does not exist" containerID="39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41"
Sep 18 19:39:02.354148 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.354099    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41"} err="failed to get container status \"39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41\": rpc error: code = NotFound desc = could not find container \"39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41\": container with ID starting with 39dc464d0918fe092ed6f47183818a9270635defdf7119e42a62eecfdcdeef41 not found: ID does not exist"
Sep 18 19:39:02.354148 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.354113    2580 scope.go:117] "RemoveContainer" containerID="d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906"
Sep 18 19:39:02.354335 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:39:02.354321    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906\": container with ID starting with d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906 not found: ID does not exist" containerID="d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906"
Sep 18 19:39:02.354377 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.354339    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906"} err="failed to get container status \"d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906\": rpc error: code = NotFound desc = could not find container \"d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906\": container with ID starting with d006c268612d14e7fad6ece9c4038e0c97353c6bd941ea9a3ea7db8ea5311906 not found: ID does not exist"
Sep 18 19:39:02.362391 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.362372    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"]
Sep 18 19:39:02.374614 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:02.374595    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6d8ab-predictor-5c6f44cd6f-kwp2l"]
Sep 18 19:39:04.326352 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:04.326326    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:39:04.375501 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:04.375471    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" path="/var/lib/kubelet/pods/9f2647e3-cc5e-410f-9362-21da9e48d956/volumes"
Sep 18 19:39:05.276818 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:05.276775    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" podUID="aa43e594-86b1-413a-b77b-f50e11192d96" containerName="sequence-graph-6d8ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:39:06.335585 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:06.335556    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:39:06.336057 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:06.336031    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 19:39:10.277270 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:10.277179    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" podUID="aa43e594-86b1-413a-b77b-f50e11192d96" containerName="sequence-graph-6d8ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:39:10.277648 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:10.277278    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:39:15.276608 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:15.276567    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" podUID="aa43e594-86b1-413a-b77b-f50e11192d96" containerName="sequence-graph-6d8ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:39:16.336229 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:16.336188    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 19:39:20.277283 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:20.277244    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" podUID="aa43e594-86b1-413a-b77b-f50e11192d96" containerName="sequence-graph-6d8ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:39:25.277072 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:25.277035    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" podUID="aa43e594-86b1-413a-b77b-f50e11192d96" containerName="sequence-graph-6d8ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:39:26.336833 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:26.336790    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 19:39:28.619456 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:28.619433    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:39:28.722665 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:28.722606    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aa43e594-86b1-413a-b77b-f50e11192d96-proxy-tls\") pod \"aa43e594-86b1-413a-b77b-f50e11192d96\" (UID: \"aa43e594-86b1-413a-b77b-f50e11192d96\") "
Sep 18 19:39:28.722665 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:28.722643    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa43e594-86b1-413a-b77b-f50e11192d96-openshift-service-ca-bundle\") pod \"aa43e594-86b1-413a-b77b-f50e11192d96\" (UID: \"aa43e594-86b1-413a-b77b-f50e11192d96\") "
Sep 18 19:39:28.723060 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:28.723040    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa43e594-86b1-413a-b77b-f50e11192d96-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "aa43e594-86b1-413a-b77b-f50e11192d96" (UID: "aa43e594-86b1-413a-b77b-f50e11192d96"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:39:28.724803 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:28.724783    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa43e594-86b1-413a-b77b-f50e11192d96-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "aa43e594-86b1-413a-b77b-f50e11192d96" (UID: "aa43e594-86b1-413a-b77b-f50e11192d96"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:39:28.823928 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:28.823904    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aa43e594-86b1-413a-b77b-f50e11192d96-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:39:28.823928 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:28.823925    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa43e594-86b1-413a-b77b-f50e11192d96-openshift-service-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:39:29.461898 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:29.461865    2580 generic.go:356] "Generic (PLEG): container finished" podID="aa43e594-86b1-413a-b77b-f50e11192d96" containerID="b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88" exitCode=0
Sep 18 19:39:29.462087 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:29.461908    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"
Sep 18 19:39:29.462087 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:29.461955    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" event={"ID":"aa43e594-86b1-413a-b77b-f50e11192d96","Type":"ContainerDied","Data":"b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88"}
Sep 18 19:39:29.462087 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:29.462017    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz" event={"ID":"aa43e594-86b1-413a-b77b-f50e11192d96","Type":"ContainerDied","Data":"1fdcb888201e5b1dc420ea6924dc744d87869b2fb205d0e45bb09c4d3970cc07"}
Sep 18 19:39:29.462087 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:29.462041    2580 scope.go:117] "RemoveContainer" containerID="b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88"
Sep 18 19:39:29.470848 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:29.470831    2580 scope.go:117] "RemoveContainer" containerID="b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88"
Sep 18 19:39:29.471147 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:39:29.471127    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88\": container with ID starting with b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88 not found: ID does not exist" containerID="b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88"
Sep 18 19:39:29.471230 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:29.471159    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88"} err="failed to get container status \"b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88\": rpc error: code = NotFound desc = could not find container \"b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88\": container with ID starting with b7148b3e50028cc6150f0d66137947c2f3c63162a0bb0f06ddefacf80ea0ab88 not found: ID does not exist"
Sep 18 19:39:29.484956 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:29.484931    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"]
Sep 18 19:39:29.488824 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:29.488801    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6d8ab-8565c985cd-wpxbz"]
Sep 18 19:39:30.375503 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:30.375463    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa43e594-86b1-413a-b77b-f50e11192d96" path="/var/lib/kubelet/pods/aa43e594-86b1-413a-b77b-f50e11192d96/volumes"
Sep 18 19:39:36.336147 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:36.336107    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 19:39:46.337200 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:46.337164    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:39:58.713647 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.713612    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"]
Sep 18 19:39:58.714234 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.714214    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa43e594-86b1-413a-b77b-f50e11192d96" containerName="sequence-graph-6d8ab"
Sep 18 19:39:58.714234 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.714234    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa43e594-86b1-413a-b77b-f50e11192d96" containerName="sequence-graph-6d8ab"
Sep 18 19:39:58.714409 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.714250    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kube-rbac-proxy"
Sep 18 19:39:58.714409 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.714259    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kube-rbac-proxy"
Sep 18 19:39:58.714409 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.714274    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kserve-container"
Sep 18 19:39:58.714409 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.714282    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kserve-container"
Sep 18 19:39:58.714409 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.714370    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kserve-container"
Sep 18 19:39:58.714409 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.714382    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa43e594-86b1-413a-b77b-f50e11192d96" containerName="sequence-graph-6d8ab"
Sep 18 19:39:58.714409 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.714396    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f2647e3-cc5e-410f-9362-21da9e48d956" containerName="kube-rbac-proxy"
Sep 18 19:39:58.719040 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.719016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:39:58.721852 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.721830    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-ad04b-serving-cert\""
Sep 18 19:39:58.721993 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.721832    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-ad04b-kube-rbac-proxy-sar-config\""
Sep 18 19:39:58.728400 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.728380    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"]
Sep 18 19:39:58.841562 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.841532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/79e6401d-2b34-4363-b33d-f4e0482bde59-proxy-tls\") pod \"sequence-graph-ad04b-7db6969cbf-q9xkp\" (UID: \"79e6401d-2b34-4363-b33d-f4e0482bde59\") " pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:39:58.841696 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.841586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79e6401d-2b34-4363-b33d-f4e0482bde59-openshift-service-ca-bundle\") pod \"sequence-graph-ad04b-7db6969cbf-q9xkp\" (UID: \"79e6401d-2b34-4363-b33d-f4e0482bde59\") " pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:39:58.942810 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.942784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79e6401d-2b34-4363-b33d-f4e0482bde59-openshift-service-ca-bundle\") pod \"sequence-graph-ad04b-7db6969cbf-q9xkp\" (UID: \"79e6401d-2b34-4363-b33d-f4e0482bde59\") " pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:39:58.942911 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.942833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/79e6401d-2b34-4363-b33d-f4e0482bde59-proxy-tls\") pod \"sequence-graph-ad04b-7db6969cbf-q9xkp\" (UID: \"79e6401d-2b34-4363-b33d-f4e0482bde59\") " pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:39:58.943434 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.943415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79e6401d-2b34-4363-b33d-f4e0482bde59-openshift-service-ca-bundle\") pod \"sequence-graph-ad04b-7db6969cbf-q9xkp\" (UID: \"79e6401d-2b34-4363-b33d-f4e0482bde59\") " pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:39:58.945391 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:58.945368    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/79e6401d-2b34-4363-b33d-f4e0482bde59-proxy-tls\") pod \"sequence-graph-ad04b-7db6969cbf-q9xkp\" (UID: \"79e6401d-2b34-4363-b33d-f4e0482bde59\") " pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:39:59.032263 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:59.032213    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:39:59.311041 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:59.311006    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"]
Sep 18 19:39:59.312836 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:39:59.312809    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e6401d_2b34_4363_b33d_f4e0482bde59.slice/crio-5e01e7e874881f84c88925ab3d505cc84ccc1b9e69b07c428217f548505ee897 WatchSource:0}: Error finding container 5e01e7e874881f84c88925ab3d505cc84ccc1b9e69b07c428217f548505ee897: Status 404 returned error can't find the container with id 5e01e7e874881f84c88925ab3d505cc84ccc1b9e69b07c428217f548505ee897
Sep 18 19:39:59.598452 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:59.598417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" event={"ID":"79e6401d-2b34-4363-b33d-f4e0482bde59","Type":"ContainerStarted","Data":"35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044"}
Sep 18 19:39:59.598610 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:59.598472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" event={"ID":"79e6401d-2b34-4363-b33d-f4e0482bde59","Type":"ContainerStarted","Data":"5e01e7e874881f84c88925ab3d505cc84ccc1b9e69b07c428217f548505ee897"}
Sep 18 19:39:59.598610 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:59.598520    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:39:59.619599 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:39:59.619555    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" podStartSLOduration=1.6195429099999998 podStartE2EDuration="1.61954291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:59.616855818 +0000 UTC m=+1563.261611155" watchObservedRunningTime="2026-09-18 19:39:59.61954291 +0000 UTC m=+1563.264298230"
Sep 18 19:40:05.609160 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:40:05.609127    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:43:58.432840 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:43:58.432812    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:43:58.437350 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:43:58.437328    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:43:58.440792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:43:58.440771    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:43:58.445258 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:43:58.445243    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:47:12.567049 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:12.567017    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"]
Sep 18 19:47:12.569519 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:12.567227    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" podUID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" containerName="ensemble-graph-c155b" containerID="cri-o://01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e" gracePeriod=30
Sep 18 19:47:13.020063 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.020030    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"]
Sep 18 19:47:13.020263 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.020240    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kserve-container" containerID="cri-o://fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74" gracePeriod=30
Sep 18 19:47:13.020353 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.020323    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kube-rbac-proxy" containerID="cri-o://cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b" gracePeriod=30
Sep 18 19:47:13.307437 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.307350    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"]
Sep 18 19:47:13.311313 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.311289    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:13.315202 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.315179    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0596f-kube-rbac-proxy-sar-config\""
Sep 18 19:47:13.317595 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.317574    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0596f-predictor-serving-cert\""
Sep 18 19:47:13.334168 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.334144    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"]
Sep 18 19:47:13.406566 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.406541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0596f-predictor-87598dbc5-lgkcj\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") " pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:13.406706 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.406576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26f13b02-1609-41f2-9fbf-47dac5af25c3-proxy-tls\") pod \"success-200-isvc-0596f-predictor-87598dbc5-lgkcj\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") " pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:13.406706 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.406627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fx9b\" (UniqueName: \"kubernetes.io/projected/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-api-access-5fx9b\") pod \"success-200-isvc-0596f-predictor-87598dbc5-lgkcj\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") " pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:13.507862 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.507837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fx9b\" (UniqueName: \"kubernetes.io/projected/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-api-access-5fx9b\") pod \"success-200-isvc-0596f-predictor-87598dbc5-lgkcj\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") " pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:13.508029 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.507900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0596f-predictor-87598dbc5-lgkcj\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") " pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:13.508029 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.507940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26f13b02-1609-41f2-9fbf-47dac5af25c3-proxy-tls\") pod \"success-200-isvc-0596f-predictor-87598dbc5-lgkcj\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") " pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:13.508588 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.508564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0596f-predictor-87598dbc5-lgkcj\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") " pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:13.510417 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.510398    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26f13b02-1609-41f2-9fbf-47dac5af25c3-proxy-tls\") pod \"success-200-isvc-0596f-predictor-87598dbc5-lgkcj\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") " pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:13.533589 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.533562    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fx9b\" (UniqueName: \"kubernetes.io/projected/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-api-access-5fx9b\") pod \"success-200-isvc-0596f-predictor-87598dbc5-lgkcj\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") " pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:13.622399 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.622361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:13.708797 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.708761    2580 generic.go:356] "Generic (PLEG): container finished" podID="528e655c-f064-4061-85e8-daab5265109d" containerID="cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b" exitCode=2
Sep 18 19:47:13.709002 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.708830    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" event={"ID":"528e655c-f064-4061-85e8-daab5265109d","Type":"ContainerDied","Data":"cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b"}
Sep 18 19:47:13.899335 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:13.899309    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"]
Sep 18 19:47:13.902583 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:47:13.902553    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f13b02_1609_41f2_9fbf_47dac5af25c3.slice/crio-f3fc1728ec63df223bdc83685768d5cbf3dc6b669dd3d9fa4f076d6f29b9ca67 WatchSource:0}: Error finding container f3fc1728ec63df223bdc83685768d5cbf3dc6b669dd3d9fa4f076d6f29b9ca67: Status 404 returned error can't find the container with id f3fc1728ec63df223bdc83685768d5cbf3dc6b669dd3d9fa4f076d6f29b9ca67
Sep 18 19:47:14.325082 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:14.324990    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" podUID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" containerName="ensemble-graph-c155b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:47:14.715403 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:14.715370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" event={"ID":"26f13b02-1609-41f2-9fbf-47dac5af25c3","Type":"ContainerStarted","Data":"2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12"}
Sep 18 19:47:14.715808 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:14.715430    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:14.715808 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:14.715456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" event={"ID":"26f13b02-1609-41f2-9fbf-47dac5af25c3","Type":"ContainerStarted","Data":"b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa"}
Sep 18 19:47:14.715808 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:14.715480    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:14.715808 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:14.715497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" event={"ID":"26f13b02-1609-41f2-9fbf-47dac5af25c3","Type":"ContainerStarted","Data":"f3fc1728ec63df223bdc83685768d5cbf3dc6b669dd3d9fa4f076d6f29b9ca67"}
Sep 18 19:47:14.716751 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:14.716724    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 19:47:14.737821 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:14.737778    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" podStartSLOduration=1.737762866 podStartE2EDuration="1.737762866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:14.736943997 +0000 UTC m=+1998.381699321" watchObservedRunningTime="2026-09-18 19:47:14.737762866 +0000 UTC m=+1998.382518186"
Sep 18 19:47:15.719989 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:15.719923    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 19:47:16.062473 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.062444    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:47:16.130184 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.130155    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/528e655c-f064-4061-85e8-daab5265109d-kube-rbac-proxy-sar-config\") pod \"528e655c-f064-4061-85e8-daab5265109d\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") "
Sep 18 19:47:16.130336 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.130191    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ktxc\" (UniqueName: \"kubernetes.io/projected/528e655c-f064-4061-85e8-daab5265109d-kube-api-access-2ktxc\") pod \"528e655c-f064-4061-85e8-daab5265109d\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") "
Sep 18 19:47:16.130336 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.130230    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/528e655c-f064-4061-85e8-daab5265109d-proxy-tls\") pod \"528e655c-f064-4061-85e8-daab5265109d\" (UID: \"528e655c-f064-4061-85e8-daab5265109d\") "
Sep 18 19:47:16.130583 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.130555    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528e655c-f064-4061-85e8-daab5265109d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "528e655c-f064-4061-85e8-daab5265109d" (UID: "528e655c-f064-4061-85e8-daab5265109d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:47:16.132442 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.132413    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528e655c-f064-4061-85e8-daab5265109d-kube-api-access-2ktxc" (OuterVolumeSpecName: "kube-api-access-2ktxc") pod "528e655c-f064-4061-85e8-daab5265109d" (UID: "528e655c-f064-4061-85e8-daab5265109d"). InnerVolumeSpecName "kube-api-access-2ktxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:47:16.132538 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.132499    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/528e655c-f064-4061-85e8-daab5265109d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "528e655c-f064-4061-85e8-daab5265109d" (UID: "528e655c-f064-4061-85e8-daab5265109d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:47:16.230783 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.230760    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/528e655c-f064-4061-85e8-daab5265109d-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:47:16.230783 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.230781    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/528e655c-f064-4061-85e8-daab5265109d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:47:16.230911 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.230791    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ktxc\" (UniqueName: \"kubernetes.io/projected/528e655c-f064-4061-85e8-daab5265109d-kube-api-access-2ktxc\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:47:16.726243 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.726171    2580 generic.go:356] "Generic (PLEG): container finished" podID="528e655c-f064-4061-85e8-daab5265109d" containerID="fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74" exitCode=0
Sep 18 19:47:16.726243 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.726233    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"
Sep 18 19:47:16.726616 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.726235    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" event={"ID":"528e655c-f064-4061-85e8-daab5265109d","Type":"ContainerDied","Data":"fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74"}
Sep 18 19:47:16.726616 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.726357    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" event={"ID":"528e655c-f064-4061-85e8-daab5265109d","Type":"ContainerDied","Data":"66b3bc27c16e6a33854e9fdf0fc5f9521f5cf616e900d3fb134cc1f57b3c3e7b"}
Sep 18 19:47:16.726616 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.726384    2580 scope.go:117] "RemoveContainer" containerID="cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b"
Sep 18 19:47:16.735438 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.735423    2580 scope.go:117] "RemoveContainer" containerID="fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74"
Sep 18 19:47:16.743516 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.743494    2580 scope.go:117] "RemoveContainer" containerID="cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b"
Sep 18 19:47:16.743841 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:47:16.743817    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b\": container with ID starting with cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b not found: ID does not exist" containerID="cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b"
Sep 18 19:47:16.743913 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.743851    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b"} err="failed to get container status \"cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b\": rpc error: code = NotFound desc = could not find container \"cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b\": container with ID starting with cf76e0c658464b00be8dac40aebcf28726ef5ebe64e1541e874d908626f2a17b not found: ID does not exist"
Sep 18 19:47:16.743913 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.743875    2580 scope.go:117] "RemoveContainer" containerID="fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74"
Sep 18 19:47:16.744247 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:47:16.744227    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74\": container with ID starting with fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74 not found: ID does not exist" containerID="fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74"
Sep 18 19:47:16.744341 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.744251    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74"} err="failed to get container status \"fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74\": rpc error: code = NotFound desc = could not find container \"fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74\": container with ID starting with fb6e5a74980c6400ca34a8be35894ad4803aa2d359c288a83d6059907d9f4e74 not found: ID does not exist"
Sep 18 19:47:16.745296 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.745279    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"]
Sep 18 19:47:16.748664 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:16.748642    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s"]
Sep 18 19:47:17.040863 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:17.040799    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.41:8643/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 18 19:47:17.045985 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:17.045950    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c155b-predictor-5575ddc5bc-j5k6s" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: i/o timeout"
Sep 18 19:47:18.375826 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:18.375796    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="528e655c-f064-4061-85e8-daab5265109d" path="/var/lib/kubelet/pods/528e655c-f064-4061-85e8-daab5265109d/volumes"
Sep 18 19:47:19.324745 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:19.324709    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" podUID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" containerName="ensemble-graph-c155b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:47:20.724545 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:20.724518    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:47:20.724993 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:20.724952    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 19:47:24.324810 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:24.324763    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" podUID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" containerName="ensemble-graph-c155b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:47:24.325194 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:24.324907    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:47:29.324166 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:29.324128    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" podUID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" containerName="ensemble-graph-c155b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:47:30.725789 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:30.725752    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 19:47:34.324481 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:34.324442    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" podUID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" containerName="ensemble-graph-c155b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:47:39.324896 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:39.324857    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" podUID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" containerName="ensemble-graph-c155b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:47:40.725908 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:40.725872    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 19:47:42.724589 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.724565    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:47:42.815858 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.815832    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-openshift-service-ca-bundle\") pod \"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4\" (UID: \"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4\") "
Sep 18 19:47:42.816013 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.815880    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-proxy-tls\") pod \"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4\" (UID: \"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4\") "
Sep 18 19:47:42.816190 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.816171    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" (UID: "4cbdd583-b50f-4ed0-b586-0090a4fd2ef4"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:47:42.818018 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.818000    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" (UID: "4cbdd583-b50f-4ed0-b586-0090a4fd2ef4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:47:42.848224 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.848192    2580 generic.go:356] "Generic (PLEG): container finished" podID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" containerID="01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e" exitCode=0
Sep 18 19:47:42.848330 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.848243    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"
Sep 18 19:47:42.848330 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.848282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" event={"ID":"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4","Type":"ContainerDied","Data":"01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e"}
Sep 18 19:47:42.848443 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.848334    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z" event={"ID":"4cbdd583-b50f-4ed0-b586-0090a4fd2ef4","Type":"ContainerDied","Data":"9f58f245067ceba82b0ba5642fdf3529f14f7ba43b73f8c8bc8f8df645dee719"}
Sep 18 19:47:42.848443 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.848357    2580 scope.go:117] "RemoveContainer" containerID="01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e"
Sep 18 19:47:42.859691 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.859674    2580 scope.go:117] "RemoveContainer" containerID="01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e"
Sep 18 19:47:42.859999 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:47:42.859948    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e\": container with ID starting with 01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e not found: ID does not exist" containerID="01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e"
Sep 18 19:47:42.860069 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.860001    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e"} err="failed to get container status \"01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e\": rpc error: code = NotFound desc = could not find container \"01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e\": container with ID starting with 01db233336251f93918287556bcdd663368764eccb6658b208b9c30fc46f4c6e not found: ID does not exist"
Sep 18 19:47:42.877668 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.877647    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"]
Sep 18 19:47:42.882881 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.882849    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c155b-fdbb4f9cb-9wl2z"]
Sep 18 19:47:42.916528 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.916509    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:47:42.916528 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:42.916529    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4-openshift-service-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:47:44.374826 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:44.374793    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" path="/var/lib/kubelet/pods/4cbdd583-b50f-4ed0-b586-0090a4fd2ef4/volumes"
Sep 18 19:47:50.725841 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:47:50.725804    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 19:48:00.726589 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:00.726556    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:48:12.995718 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:12.995631    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"]
Sep 18 19:48:12.996203 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:12.996186    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kserve-container"
Sep 18 19:48:12.996275 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:12.996206    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kserve-container"
Sep 18 19:48:12.996275 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:12.996227    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" containerName="ensemble-graph-c155b"
Sep 18 19:48:12.996275 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:12.996237    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" containerName="ensemble-graph-c155b"
Sep 18 19:48:12.996275 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:12.996256    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kube-rbac-proxy"
Sep 18 19:48:12.996275 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:12.996266    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kube-rbac-proxy"
Sep 18 19:48:12.996521 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:12.996361    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kserve-container"
Sep 18 19:48:12.996521 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:12.996374    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="528e655c-f064-4061-85e8-daab5265109d" containerName="kube-rbac-proxy"
Sep 18 19:48:12.996521 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:12.996384    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cbdd583-b50f-4ed0-b586-0090a4fd2ef4" containerName="ensemble-graph-c155b"
Sep 18 19:48:13.000915 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.000894    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:13.011399 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.011379    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-0596f-kube-rbac-proxy-sar-config\""
Sep 18 19:48:13.011502 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.011388    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-0596f-serving-cert\""
Sep 18 19:48:13.033890 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.033868    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"]
Sep 18 19:48:13.136147 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.136125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-openshift-service-ca-bundle\") pod \"splitter-graph-0596f-65848496cb-n9fcx\" (UID: \"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7\") " pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:13.136266 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.136171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-proxy-tls\") pod \"splitter-graph-0596f-65848496cb-n9fcx\" (UID: \"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7\") " pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:13.237172 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.237147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-openshift-service-ca-bundle\") pod \"splitter-graph-0596f-65848496cb-n9fcx\" (UID: \"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7\") " pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:13.237267 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.237194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-proxy-tls\") pod \"splitter-graph-0596f-65848496cb-n9fcx\" (UID: \"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7\") " pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:13.237309 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:48:13.237296    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-0596f-serving-cert: secret "splitter-graph-0596f-serving-cert" not found
Sep 18 19:48:13.237366 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:48:13.237357    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-proxy-tls podName:67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7 nodeName:}" failed. No retries permitted until 2026-09-18 19:48:13.737340204 +0000 UTC m=+2057.382095505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-proxy-tls") pod "splitter-graph-0596f-65848496cb-n9fcx" (UID: "67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7") : secret "splitter-graph-0596f-serving-cert" not found
Sep 18 19:48:13.237709 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.237690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-openshift-service-ca-bundle\") pod \"splitter-graph-0596f-65848496cb-n9fcx\" (UID: \"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7\") " pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:13.727010 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.726963    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"]
Sep 18 19:48:13.727216 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.727174    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" podUID="79e6401d-2b34-4363-b33d-f4e0482bde59" containerName="sequence-graph-ad04b" containerID="cri-o://35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044" gracePeriod=30
Sep 18 19:48:13.740391 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.740365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-proxy-tls\") pod \"splitter-graph-0596f-65848496cb-n9fcx\" (UID: \"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7\") " pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:13.742862 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.742838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-proxy-tls\") pod \"splitter-graph-0596f-65848496cb-n9fcx\" (UID: \"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7\") " pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:13.901508 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.901452    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"]
Sep 18 19:48:13.901761 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.901733    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kserve-container" containerID="cri-o://a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3" gracePeriod=30
Sep 18 19:48:13.901861 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.901757    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kube-rbac-proxy" containerID="cri-o://2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6" gracePeriod=30
Sep 18 19:48:13.911367 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:13.911345    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:14.089312 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.089276    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"]
Sep 18 19:48:14.092889 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.092869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:14.096870 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.096851    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-38355-predictor-serving-cert\""
Sep 18 19:48:14.096993 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.096855    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-38355-kube-rbac-proxy-sar-config\""
Sep 18 19:48:14.104382 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.104357    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"]
Sep 18 19:48:14.191954 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.191923    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"]
Sep 18 19:48:14.194051 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:48:14.194026    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67037119_1e8c_4f66_9ae4_c2e9e6ebdcb7.slice/crio-4a6676688551cc03c2ddb25aa4a127d1137d535f9bd4863ed7e21e3185482eab WatchSource:0}: Error finding container 4a6676688551cc03c2ddb25aa4a127d1137d535f9bd4863ed7e21e3185482eab: Status 404 returned error can't find the container with id 4a6676688551cc03c2ddb25aa4a127d1137d535f9bd4863ed7e21e3185482eab
Sep 18 19:48:14.245003 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.244961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-38355-predictor-6966f67cf9-g4qb2\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") " pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:14.245102 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.245062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-785x6\" (UniqueName: \"kubernetes.io/projected/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-api-access-785x6\") pod \"success-200-isvc-38355-predictor-6966f67cf9-g4qb2\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") " pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:14.245221 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.245130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f678985d-7172-42c8-bb3f-2dc778f1a925-proxy-tls\") pod \"success-200-isvc-38355-predictor-6966f67cf9-g4qb2\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") " pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:14.346141 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.346105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-38355-predictor-6966f67cf9-g4qb2\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") " pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:14.346305 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.346195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-785x6\" (UniqueName: \"kubernetes.io/projected/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-api-access-785x6\") pod \"success-200-isvc-38355-predictor-6966f67cf9-g4qb2\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") " pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:14.346305 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.346255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f678985d-7172-42c8-bb3f-2dc778f1a925-proxy-tls\") pod \"success-200-isvc-38355-predictor-6966f67cf9-g4qb2\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") " pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:14.346792 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.346771    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-38355-predictor-6966f67cf9-g4qb2\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") " pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:14.348680 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.348663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f678985d-7172-42c8-bb3f-2dc778f1a925-proxy-tls\") pod \"success-200-isvc-38355-predictor-6966f67cf9-g4qb2\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") " pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:14.356364 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.356341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-785x6\" (UniqueName: \"kubernetes.io/projected/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-api-access-785x6\") pod \"success-200-isvc-38355-predictor-6966f67cf9-g4qb2\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") " pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:14.407953 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.407928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:14.682466 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:14.682439    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"]
Sep 18 19:48:14.683911 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:48:14.683887    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf678985d_7172_42c8_bb3f_2dc778f1a925.slice/crio-396a55e11118f02c53ee69abbf33b20f1a94522041056642350bd0a30e7a973c WatchSource:0}: Error finding container 396a55e11118f02c53ee69abbf33b20f1a94522041056642350bd0a30e7a973c: Status 404 returned error can't find the container with id 396a55e11118f02c53ee69abbf33b20f1a94522041056642350bd0a30e7a973c
Sep 18 19:48:15.014738 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.014652    2580 generic.go:356] "Generic (PLEG): container finished" podID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerID="2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6" exitCode=2
Sep 18 19:48:15.014886 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.014741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" event={"ID":"7a36d95d-b71a-494f-b8ee-23930a4e81e9","Type":"ContainerDied","Data":"2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6"}
Sep 18 19:48:15.016515 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.016487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" event={"ID":"f678985d-7172-42c8-bb3f-2dc778f1a925","Type":"ContainerStarted","Data":"370f85cd5c6eaefb5b87877a3021b4fcfa756abe7dcb55808283b6e974674cbd"}
Sep 18 19:48:15.016659 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.016536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" event={"ID":"f678985d-7172-42c8-bb3f-2dc778f1a925","Type":"ContainerStarted","Data":"880b559f0280fe92c2bd00874a6a711dce894afe94534ef7410f2755b533c6d5"}
Sep 18 19:48:15.016659 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.016571    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:15.016775 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.016655    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:15.016775 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.016697    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" event={"ID":"f678985d-7172-42c8-bb3f-2dc778f1a925","Type":"ContainerStarted","Data":"396a55e11118f02c53ee69abbf33b20f1a94522041056642350bd0a30e7a973c"}
Sep 18 19:48:15.018144 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.018117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" event={"ID":"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7","Type":"ContainerStarted","Data":"e301e0f4e5bd99ba991f501fc5e5b8ffa7c5f89662e9107c2f6ac22b3f9a4e4f"}
Sep 18 19:48:15.018144 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.018130    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused"
Sep 18 19:48:15.018348 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.018164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" event={"ID":"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7","Type":"ContainerStarted","Data":"4a6676688551cc03c2ddb25aa4a127d1137d535f9bd4863ed7e21e3185482eab"}
Sep 18 19:48:15.018348 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.018247    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:15.041008 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.040946    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" podStartSLOduration=1.040933493 podStartE2EDuration="1.040933493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:48:15.039107265 +0000 UTC m=+2058.683862587" watchObservedRunningTime="2026-09-18 19:48:15.040933493 +0000 UTC m=+2058.685688812"
Sep 18 19:48:15.060285 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.060252    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" podStartSLOduration=3.060240713 podStartE2EDuration="3.060240713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:48:15.060083868 +0000 UTC m=+2058.704839187" watchObservedRunningTime="2026-09-18 19:48:15.060240713 +0000 UTC m=+2058.704996036"
Sep 18 19:48:15.607223 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:15.607175    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" podUID="79e6401d-2b34-4363-b33d-f4e0482bde59" containerName="sequence-graph-ad04b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:16.022837 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:16.022744    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused"
Sep 18 19:48:16.331809 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:16.331764    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.44:8643/healthz\": dial tcp 10.132.0.44:8643: connect: connection refused"
Sep 18 19:48:16.336106 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:16.336067    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 19:48:16.954799 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:16.954777    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:48:17.028041 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.028009    2580 generic.go:356] "Generic (PLEG): container finished" podID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerID="a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3" exitCode=0
Sep 18 19:48:17.028196 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.028065    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"
Sep 18 19:48:17.028196 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.028100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" event={"ID":"7a36d95d-b71a-494f-b8ee-23930a4e81e9","Type":"ContainerDied","Data":"a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3"}
Sep 18 19:48:17.028196 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.028158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss" event={"ID":"7a36d95d-b71a-494f-b8ee-23930a4e81e9","Type":"ContainerDied","Data":"d907e2bd402af15aff7533b5f8272fba1ce5fe7d4407381c094e4a153de0c0ab"}
Sep 18 19:48:17.028196 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.028185    2580 scope.go:117] "RemoveContainer" containerID="2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6"
Sep 18 19:48:17.036830 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.036813    2580 scope.go:117] "RemoveContainer" containerID="a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3"
Sep 18 19:48:17.044318 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.044302    2580 scope.go:117] "RemoveContainer" containerID="2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6"
Sep 18 19:48:17.044586 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:48:17.044567    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6\": container with ID starting with 2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6 not found: ID does not exist" containerID="2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6"
Sep 18 19:48:17.044648 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.044592    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6"} err="failed to get container status \"2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6\": rpc error: code = NotFound desc = could not find container \"2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6\": container with ID starting with 2e008a0f863d52e1686dcecf4b54f79cf08001734a004bb960a570e510caf9a6 not found: ID does not exist"
Sep 18 19:48:17.044648 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.044609    2580 scope.go:117] "RemoveContainer" containerID="a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3"
Sep 18 19:48:17.044848 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:48:17.044831    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3\": container with ID starting with a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3 not found: ID does not exist" containerID="a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3"
Sep 18 19:48:17.044886 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.044854    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3"} err="failed to get container status \"a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3\": rpc error: code = NotFound desc = could not find container \"a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3\": container with ID starting with a3a5ba0148b9a5a90d93b58d8d5a558d6e4f7f1d86cb3f075906f46553db11c3 not found: ID does not exist"
Sep 18 19:48:17.070176 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.070154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a36d95d-b71a-494f-b8ee-23930a4e81e9-proxy-tls\") pod \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") "
Sep 18 19:48:17.070247 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.070216    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vd28\" (UniqueName: \"kubernetes.io/projected/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-api-access-7vd28\") pod \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") "
Sep 18 19:48:17.070313 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.070249    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-rbac-proxy-sar-config\") pod \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\" (UID: \"7a36d95d-b71a-494f-b8ee-23930a4e81e9\") "
Sep 18 19:48:17.070617 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.070597    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7a36d95d-b71a-494f-b8ee-23930a4e81e9" (UID: "7a36d95d-b71a-494f-b8ee-23930a4e81e9"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:48:17.072242 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.072219    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a36d95d-b71a-494f-b8ee-23930a4e81e9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7a36d95d-b71a-494f-b8ee-23930a4e81e9" (UID: "7a36d95d-b71a-494f-b8ee-23930a4e81e9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:48:17.072356 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.072338    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-api-access-7vd28" (OuterVolumeSpecName: "kube-api-access-7vd28") pod "7a36d95d-b71a-494f-b8ee-23930a4e81e9" (UID: "7a36d95d-b71a-494f-b8ee-23930a4e81e9"). InnerVolumeSpecName "kube-api-access-7vd28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:48:17.171548 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.171523    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vd28\" (UniqueName: \"kubernetes.io/projected/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-api-access-7vd28\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:48:17.171548 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.171548    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7a36d95d-b71a-494f-b8ee-23930a4e81e9-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:48:17.171671 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.171561    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a36d95d-b71a-494f-b8ee-23930a4e81e9-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:48:17.354992 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.354956    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"]
Sep 18 19:48:17.358682 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:17.358661    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ad04b-predictor-56fd678f5c-ghsss"]
Sep 18 19:48:18.375642 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:18.375609    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" path="/var/lib/kubelet/pods/7a36d95d-b71a-494f-b8ee-23930a4e81e9/volumes"
Sep 18 19:48:20.607684 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:20.607647    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" podUID="79e6401d-2b34-4363-b33d-f4e0482bde59" containerName="sequence-graph-ad04b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:21.027223 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:21.027151    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:48:21.027742 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:21.027708    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused"
Sep 18 19:48:21.028866 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:21.028847    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:25.607694 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:25.607658    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" podUID="79e6401d-2b34-4363-b33d-f4e0482bde59" containerName="sequence-graph-ad04b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:25.608069 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:25.607768    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:48:28.058775 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.058740    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"]
Sep 18 19:48:28.059225 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.058954    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" podUID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" containerName="splitter-graph-0596f" containerID="cri-o://e301e0f4e5bd99ba991f501fc5e5b8ffa7c5f89662e9107c2f6ac22b3f9a4e4f" gracePeriod=30
Sep 18 19:48:28.249209 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.249174    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"]
Sep 18 19:48:28.249442 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.249394    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kserve-container" containerID="cri-o://b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa" gracePeriod=30
Sep 18 19:48:28.249502 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.249427    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kube-rbac-proxy" containerID="cri-o://2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12" gracePeriod=30
Sep 18 19:48:28.541617 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.541580    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"]
Sep 18 19:48:28.541935 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.541922    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kube-rbac-proxy"
Sep 18 19:48:28.541997 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.541937    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kube-rbac-proxy"
Sep 18 19:48:28.541997 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.541960    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kserve-container"
Sep 18 19:48:28.541997 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.541966    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kserve-container"
Sep 18 19:48:28.542128 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.542044    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kserve-container"
Sep 18 19:48:28.542128 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.542055    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a36d95d-b71a-494f-b8ee-23930a4e81e9" containerName="kube-rbac-proxy"
Sep 18 19:48:28.545107 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.545091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:28.548374 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.548355    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-aa781-kube-rbac-proxy-sar-config\""
Sep 18 19:48:28.549170 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.549154    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-aa781-predictor-serving-cert\""
Sep 18 19:48:28.562651 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.562630    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"]
Sep 18 19:48:28.658822 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.658744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b0c3a395-0c47-4914-9bca-e1d4e556b013-proxy-tls\") pod \"success-200-isvc-aa781-predictor-d59d4666c-6l225\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") " pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:28.658822 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.658790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjwg6\" (UniqueName: \"kubernetes.io/projected/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-api-access-wjwg6\") pod \"success-200-isvc-aa781-predictor-d59d4666c-6l225\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") " pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:28.658822 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.658811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-aa781-predictor-d59d4666c-6l225\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") " pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:28.759959 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.759929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b0c3a395-0c47-4914-9bca-e1d4e556b013-proxy-tls\") pod \"success-200-isvc-aa781-predictor-d59d4666c-6l225\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") " pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:28.760120 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.760000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjwg6\" (UniqueName: \"kubernetes.io/projected/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-api-access-wjwg6\") pod \"success-200-isvc-aa781-predictor-d59d4666c-6l225\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") " pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:28.760120 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.760035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-aa781-predictor-d59d4666c-6l225\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") " pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:28.760816 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.760736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-aa781-predictor-d59d4666c-6l225\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") " pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:28.762538 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.762520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b0c3a395-0c47-4914-9bca-e1d4e556b013-proxy-tls\") pod \"success-200-isvc-aa781-predictor-d59d4666c-6l225\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") " pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:28.769944 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.769925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjwg6\" (UniqueName: \"kubernetes.io/projected/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-api-access-wjwg6\") pod \"success-200-isvc-aa781-predictor-d59d4666c-6l225\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") " pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:28.854566 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:28.854540    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:29.087726 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:29.087681    2580 generic.go:356] "Generic (PLEG): container finished" podID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerID="2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12" exitCode=2
Sep 18 19:48:29.088085 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:29.087726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" event={"ID":"26f13b02-1609-41f2-9fbf-47dac5af25c3","Type":"ContainerDied","Data":"2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12"}
Sep 18 19:48:29.136628 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:29.136600    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"]
Sep 18 19:48:29.139284 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:48:29.139256    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c3a395_0c47_4914_9bca_e1d4e556b013.slice/crio-66f9370a28355bbd6312be1b8634bbaf4b392444c11eb2cfa03b2236e846afc4 WatchSource:0}: Error finding container 66f9370a28355bbd6312be1b8634bbaf4b392444c11eb2cfa03b2236e846afc4: Status 404 returned error can't find the container with id 66f9370a28355bbd6312be1b8634bbaf4b392444c11eb2cfa03b2236e846afc4
Sep 18 19:48:30.095380 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:30.095340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" event={"ID":"b0c3a395-0c47-4914-9bca-e1d4e556b013","Type":"ContainerStarted","Data":"1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4"}
Sep 18 19:48:30.095745 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:30.095403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" event={"ID":"b0c3a395-0c47-4914-9bca-e1d4e556b013","Type":"ContainerStarted","Data":"5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4"}
Sep 18 19:48:30.095745 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:30.095425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" event={"ID":"b0c3a395-0c47-4914-9bca-e1d4e556b013","Type":"ContainerStarted","Data":"66f9370a28355bbd6312be1b8634bbaf4b392444c11eb2cfa03b2236e846afc4"}
Sep 18 19:48:30.095745 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:30.095456    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:30.117937 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:30.117880    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" podStartSLOduration=2.117866547 podStartE2EDuration="2.117866547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:48:30.116182553 +0000 UTC m=+2073.760937874" watchObservedRunningTime="2026-09-18 19:48:30.117866547 +0000 UTC m=+2073.762621869"
Sep 18 19:48:30.606991 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:30.606937    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" podUID="79e6401d-2b34-4363-b33d-f4e0482bde59" containerName="sequence-graph-ad04b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:30.720404 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:30.720362    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.46:8643/healthz\": dial tcp 10.132.0.46:8643: connect: connection refused"
Sep 18 19:48:30.725324 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:30.725300    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 19:48:31.026399 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.026309    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" podUID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" containerName="splitter-graph-0596f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:31.028539 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.028512    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused"
Sep 18 19:48:31.099598 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.099571    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:31.101006 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.100955    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.49:8080: connect: connection refused"
Sep 18 19:48:31.807396 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.807376    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:48:31.885646 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.885615    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26f13b02-1609-41f2-9fbf-47dac5af25c3-proxy-tls\") pod \"26f13b02-1609-41f2-9fbf-47dac5af25c3\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") "
Sep 18 19:48:31.885764 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.885664    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-rbac-proxy-sar-config\") pod \"26f13b02-1609-41f2-9fbf-47dac5af25c3\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") "
Sep 18 19:48:31.885818 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.885762    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fx9b\" (UniqueName: \"kubernetes.io/projected/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-api-access-5fx9b\") pod \"26f13b02-1609-41f2-9fbf-47dac5af25c3\" (UID: \"26f13b02-1609-41f2-9fbf-47dac5af25c3\") "
Sep 18 19:48:31.886109 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.886082    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "26f13b02-1609-41f2-9fbf-47dac5af25c3" (UID: "26f13b02-1609-41f2-9fbf-47dac5af25c3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:48:31.887855 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.887822    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f13b02-1609-41f2-9fbf-47dac5af25c3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "26f13b02-1609-41f2-9fbf-47dac5af25c3" (UID: "26f13b02-1609-41f2-9fbf-47dac5af25c3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:48:31.887996 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.887930    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-api-access-5fx9b" (OuterVolumeSpecName: "kube-api-access-5fx9b") pod "26f13b02-1609-41f2-9fbf-47dac5af25c3" (UID: "26f13b02-1609-41f2-9fbf-47dac5af25c3"). InnerVolumeSpecName "kube-api-access-5fx9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:48:31.987048 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.986956    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26f13b02-1609-41f2-9fbf-47dac5af25c3-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:48:31.987048 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.987007    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:48:31.987048 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:31.987022    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fx9b\" (UniqueName: \"kubernetes.io/projected/26f13b02-1609-41f2-9fbf-47dac5af25c3-kube-api-access-5fx9b\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:48:32.107285 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.107257    2580 generic.go:356] "Generic (PLEG): container finished" podID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerID="b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa" exitCode=0
Sep 18 19:48:32.107672 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.107330    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" event={"ID":"26f13b02-1609-41f2-9fbf-47dac5af25c3","Type":"ContainerDied","Data":"b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa"}
Sep 18 19:48:32.107672 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.107393    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"
Sep 18 19:48:32.107672 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.107399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj" event={"ID":"26f13b02-1609-41f2-9fbf-47dac5af25c3","Type":"ContainerDied","Data":"f3fc1728ec63df223bdc83685768d5cbf3dc6b669dd3d9fa4f076d6f29b9ca67"}
Sep 18 19:48:32.107672 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.107432    2580 scope.go:117] "RemoveContainer" containerID="2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12"
Sep 18 19:48:32.107672 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.107610    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.49:8080: connect: connection refused"
Sep 18 19:48:32.121221 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.121197    2580 scope.go:117] "RemoveContainer" containerID="b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa"
Sep 18 19:48:32.130439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.130421    2580 scope.go:117] "RemoveContainer" containerID="2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12"
Sep 18 19:48:32.130743 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:48:32.130718    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12\": container with ID starting with 2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12 not found: ID does not exist" containerID="2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12"
Sep 18 19:48:32.130794 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.130753    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12"} err="failed to get container status \"2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12\": rpc error: code = NotFound desc = could not find container \"2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12\": container with ID starting with 2d959f6a428a0a26fbdf6d803b29740388ae287430ddb0a7a1ea6b5923388b12 not found: ID does not exist"
Sep 18 19:48:32.130794 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.130769    2580 scope.go:117] "RemoveContainer" containerID="b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa"
Sep 18 19:48:32.131122 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:48:32.131101    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa\": container with ID starting with b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa not found: ID does not exist" containerID="b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa"
Sep 18 19:48:32.131189 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.131127    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa"} err="failed to get container status \"b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa\": rpc error: code = NotFound desc = could not find container \"b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa\": container with ID starting with b10fe03e13bcdff648973e98ed776982c5a1b8d51e53739a2bf26932034c3afa not found: ID does not exist"
Sep 18 19:48:32.140930 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.140908    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"]
Sep 18 19:48:32.145548 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.145526    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0596f-predictor-87598dbc5-lgkcj"]
Sep 18 19:48:32.374863 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:32.374830    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" path="/var/lib/kubelet/pods/26f13b02-1609-41f2-9fbf-47dac5af25c3/volumes"
Sep 18 19:48:35.607115 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:35.607082    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" podUID="79e6401d-2b34-4363-b33d-f4e0482bde59" containerName="sequence-graph-ad04b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:36.026366 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:36.026260    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" podUID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" containerName="splitter-graph-0596f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:37.112345 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:37.112311    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:48:37.112966 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:37.112933    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.49:8080: connect: connection refused"
Sep 18 19:48:40.607609 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:40.607570    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" podUID="79e6401d-2b34-4363-b33d-f4e0482bde59" containerName="sequence-graph-ad04b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:41.026951 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:41.026862    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" podUID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" containerName="splitter-graph-0596f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:41.027133 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:41.027013    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:41.028053 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:41.028027    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused"
Sep 18 19:48:43.918328 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:43.918305    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:48:43.974093 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:43.974068    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/79e6401d-2b34-4363-b33d-f4e0482bde59-proxy-tls\") pod \"79e6401d-2b34-4363-b33d-f4e0482bde59\" (UID: \"79e6401d-2b34-4363-b33d-f4e0482bde59\") "
Sep 18 19:48:43.974200 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:43.974118    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79e6401d-2b34-4363-b33d-f4e0482bde59-openshift-service-ca-bundle\") pod \"79e6401d-2b34-4363-b33d-f4e0482bde59\" (UID: \"79e6401d-2b34-4363-b33d-f4e0482bde59\") "
Sep 18 19:48:43.974465 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:43.974440    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79e6401d-2b34-4363-b33d-f4e0482bde59-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "79e6401d-2b34-4363-b33d-f4e0482bde59" (UID: "79e6401d-2b34-4363-b33d-f4e0482bde59"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:48:43.976104 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:43.976078    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79e6401d-2b34-4363-b33d-f4e0482bde59-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "79e6401d-2b34-4363-b33d-f4e0482bde59" (UID: "79e6401d-2b34-4363-b33d-f4e0482bde59"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:48:44.074650 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.074589    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/79e6401d-2b34-4363-b33d-f4e0482bde59-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:48:44.074650 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.074613    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79e6401d-2b34-4363-b33d-f4e0482bde59-openshift-service-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:48:44.165881 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.165850    2580 generic.go:356] "Generic (PLEG): container finished" podID="79e6401d-2b34-4363-b33d-f4e0482bde59" containerID="35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044" exitCode=0
Sep 18 19:48:44.165992 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.165895    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"
Sep 18 19:48:44.165992 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.165896    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" event={"ID":"79e6401d-2b34-4363-b33d-f4e0482bde59","Type":"ContainerDied","Data":"35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044"}
Sep 18 19:48:44.165992 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.165945    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp" event={"ID":"79e6401d-2b34-4363-b33d-f4e0482bde59","Type":"ContainerDied","Data":"5e01e7e874881f84c88925ab3d505cc84ccc1b9e69b07c428217f548505ee897"}
Sep 18 19:48:44.166124 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.166000    2580 scope.go:117] "RemoveContainer" containerID="35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044"
Sep 18 19:48:44.174959 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.174936    2580 scope.go:117] "RemoveContainer" containerID="35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044"
Sep 18 19:48:44.175298 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:48:44.175273    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044\": container with ID starting with 35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044 not found: ID does not exist" containerID="35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044"
Sep 18 19:48:44.175404 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.175310    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044"} err="failed to get container status \"35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044\": rpc error: code = NotFound desc = could not find container \"35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044\": container with ID starting with 35bc3d1f257bb415490cf9361dbbf3a45376d15f93032abf53737b5cfe79e044 not found: ID does not exist"
Sep 18 19:48:44.191210 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.191185    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"]
Sep 18 19:48:44.196777 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.196753    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ad04b-7db6969cbf-q9xkp"]
Sep 18 19:48:44.206373 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:48:44.206350    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e6401d_2b34_4363_b33d_f4e0482bde59.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e6401d_2b34_4363_b33d_f4e0482bde59.slice/crio-5e01e7e874881f84c88925ab3d505cc84ccc1b9e69b07c428217f548505ee897\": RecentStats: unable to find data in memory cache]"
Sep 18 19:48:44.374411 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:44.374378    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79e6401d-2b34-4363-b33d-f4e0482bde59" path="/var/lib/kubelet/pods/79e6401d-2b34-4363-b33d-f4e0482bde59/volumes"
Sep 18 19:48:46.026732 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:46.026689    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" podUID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" containerName="splitter-graph-0596f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:47.113171 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:47.113125    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.49:8080: connect: connection refused"
Sep 18 19:48:51.026096 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:51.026049    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" podUID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" containerName="splitter-graph-0596f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:51.028615 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:51.028590    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused"
Sep 18 19:48:56.027527 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:56.027485    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" podUID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" containerName="splitter-graph-0596f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:48:57.113424 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:57.113386    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.49:8080: connect: connection refused"
Sep 18 19:48:58.232021 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.231990    2580 generic.go:356] "Generic (PLEG): container finished" podID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" containerID="e301e0f4e5bd99ba991f501fc5e5b8ffa7c5f89662e9107c2f6ac22b3f9a4e4f" exitCode=0
Sep 18 19:48:58.232339 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.232017    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" event={"ID":"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7","Type":"ContainerDied","Data":"e301e0f4e5bd99ba991f501fc5e5b8ffa7c5f89662e9107c2f6ac22b3f9a4e4f"}
Sep 18 19:48:58.232339 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.232081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx" event={"ID":"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7","Type":"ContainerDied","Data":"4a6676688551cc03c2ddb25aa4a127d1137d535f9bd4863ed7e21e3185482eab"}
Sep 18 19:48:58.232339 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.232117    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a6676688551cc03c2ddb25aa4a127d1137d535f9bd4863ed7e21e3185482eab"
Sep 18 19:48:58.240756 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.240737    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:58.370868 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.370847    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-openshift-service-ca-bundle\") pod \"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7\" (UID: \"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7\") "
Sep 18 19:48:58.371024 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.370883    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-proxy-tls\") pod \"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7\" (UID: \"67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7\") "
Sep 18 19:48:58.371227 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.371209    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" (UID: "67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:48:58.373566 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.373536    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" (UID: "67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:48:58.463372 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.463353    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:48:58.468739 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.468715    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:48:58.471379 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.471357    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-openshift-service-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:48:58.471483 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.471383    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:48:58.471678 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.471664    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:48:58.477319 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:58.477301    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:48:59.237124 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:59.237094    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"
Sep 18 19:48:59.257600 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:59.257571    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"]
Sep 18 19:48:59.271753 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:48:59.271730    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-0596f-65848496cb-n9fcx"]
Sep 18 19:49:00.374798 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:00.374764    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" path="/var/lib/kubelet/pods/67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7/volumes"
Sep 18 19:49:01.029106 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:01.029078    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 19:49:07.113439 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:07.113397    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.49:8080: connect: connection refused"
Sep 18 19:49:14.095384 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095348    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"]
Sep 18 19:49:14.095766 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095730    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kube-rbac-proxy"
Sep 18 19:49:14.095766 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095744    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kube-rbac-proxy"
Sep 18 19:49:14.095766 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095758    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79e6401d-2b34-4363-b33d-f4e0482bde59" containerName="sequence-graph-ad04b"
Sep 18 19:49:14.095766 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095764    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="79e6401d-2b34-4363-b33d-f4e0482bde59" containerName="sequence-graph-ad04b"
Sep 18 19:49:14.095896 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095778    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kserve-container"
Sep 18 19:49:14.095896 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095783    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kserve-container"
Sep 18 19:49:14.095896 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095796    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" containerName="splitter-graph-0596f"
Sep 18 19:49:14.095896 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095801    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" containerName="splitter-graph-0596f"
Sep 18 19:49:14.095896 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095854    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="79e6401d-2b34-4363-b33d-f4e0482bde59" containerName="sequence-graph-ad04b"
Sep 18 19:49:14.095896 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095861    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="67037119-1e8c-4f66-9ae4-c2e9e6ebdcb7" containerName="splitter-graph-0596f"
Sep 18 19:49:14.095896 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095869    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kube-rbac-proxy"
Sep 18 19:49:14.095896 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.095875    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f13b02-1609-41f2-9fbf-47dac5af25c3" containerName="kserve-container"
Sep 18 19:49:14.100359 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.100342    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 19:49:14.103119 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.103098    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-38355-serving-cert\""
Sep 18 19:49:14.103654 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.103637    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-38355-kube-rbac-proxy-sar-config\""
Sep 18 19:49:14.109893 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.109871    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"]
Sep 18 19:49:14.191780 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.191751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03e62539-a102-43e1-9fb3-f1c1257f9b0e-proxy-tls\") pod \"switch-graph-38355-74cc5846cd-qjrcw\" (UID: \"03e62539-a102-43e1-9fb3-f1c1257f9b0e\") " pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 19:49:14.191877 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.191794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e62539-a102-43e1-9fb3-f1c1257f9b0e-openshift-service-ca-bundle\") pod \"switch-graph-38355-74cc5846cd-qjrcw\" (UID: \"03e62539-a102-43e1-9fb3-f1c1257f9b0e\") " pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 19:49:14.292127 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.292088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e62539-a102-43e1-9fb3-f1c1257f9b0e-openshift-service-ca-bundle\") pod \"switch-graph-38355-74cc5846cd-qjrcw\" (UID: \"03e62539-a102-43e1-9fb3-f1c1257f9b0e\") " pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 19:49:14.292263 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.292169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03e62539-a102-43e1-9fb3-f1c1257f9b0e-proxy-tls\") pod \"switch-graph-38355-74cc5846cd-qjrcw\" (UID: \"03e62539-a102-43e1-9fb3-f1c1257f9b0e\") " pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 19:49:14.292660 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.292639    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e62539-a102-43e1-9fb3-f1c1257f9b0e-openshift-service-ca-bundle\") pod \"switch-graph-38355-74cc5846cd-qjrcw\" (UID: \"03e62539-a102-43e1-9fb3-f1c1257f9b0e\") " pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 19:49:14.294605 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.294587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03e62539-a102-43e1-9fb3-f1c1257f9b0e-proxy-tls\") pod \"switch-graph-38355-74cc5846cd-qjrcw\" (UID: \"03e62539-a102-43e1-9fb3-f1c1257f9b0e\") " pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 19:49:14.411385 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.411332    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 19:49:14.687259 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:14.687237    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"]
Sep 18 19:49:14.689948 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:49:14.689919    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e62539_a102_43e1_9fb3_f1c1257f9b0e.slice/crio-b3230540c0a68d4222824a1ed2ae2c1bb3911de3b4f13657a667a560990048c4 WatchSource:0}: Error finding container b3230540c0a68d4222824a1ed2ae2c1bb3911de3b4f13657a667a560990048c4: Status 404 returned error can't find the container with id b3230540c0a68d4222824a1ed2ae2c1bb3911de3b4f13657a667a560990048c4
Sep 18 19:49:15.310813 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:15.310782    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" event={"ID":"03e62539-a102-43e1-9fb3-f1c1257f9b0e","Type":"ContainerStarted","Data":"4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d"}
Sep 18 19:49:15.311231 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:15.310832    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" event={"ID":"03e62539-a102-43e1-9fb3-f1c1257f9b0e","Type":"ContainerStarted","Data":"b3230540c0a68d4222824a1ed2ae2c1bb3911de3b4f13657a667a560990048c4"}
Sep 18 19:49:15.311231 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:15.310863    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 19:49:15.341670 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:15.341628    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" podStartSLOduration=1.341612247 podStartE2EDuration="1.341612247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:49:15.340674133 +0000 UTC m=+2118.985429456" watchObservedRunningTime="2026-09-18 19:49:15.341612247 +0000 UTC m=+2118.986367568"
Sep 18 19:49:17.114031 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:17.113966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:49:21.320445 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:21.320410    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 19:49:28.310667 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:28.310623    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"]
Sep 18 19:49:28.314174 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:28.314158    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:49:28.316848 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:28.316823    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-aa781-serving-cert\""
Sep 18 19:49:28.316954 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:28.316855    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-aa781-kube-rbac-proxy-sar-config\""
Sep 18 19:49:28.325673 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:28.325651    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"]
Sep 18 19:49:28.396684 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:28.396657    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64673d93-8108-4ecc-9370-44f00738d5ff-openshift-service-ca-bundle\") pod \"splitter-graph-aa781-77f68cffbc-9jwmt\" (UID: \"64673d93-8108-4ecc-9370-44f00738d5ff\") " pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:49:28.396817 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:28.396705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/64673d93-8108-4ecc-9370-44f00738d5ff-proxy-tls\") pod \"splitter-graph-aa781-77f68cffbc-9jwmt\" (UID: \"64673d93-8108-4ecc-9370-44f00738d5ff\") " pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:49:28.497908 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:28.497883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64673d93-8108-4ecc-9370-44f00738d5ff-openshift-service-ca-bundle\") pod \"splitter-graph-aa781-77f68cffbc-9jwmt\" (UID: \"64673d93-8108-4ecc-9370-44f00738d5ff\") " pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:49:28.498074 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:28.497926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/64673d93-8108-4ecc-9370-44f00738d5ff-proxy-tls\") pod \"splitter-graph-aa781-77f68cffbc-9jwmt\" (UID: \"64673d93-8108-4ecc-9370-44f00738d5ff\") " pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:49:28.498074 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:49:28.498045    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-aa781-serving-cert: secret "splitter-graph-aa781-serving-cert" not found
Sep 18 19:49:28.498200 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:49:28.498102    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64673d93-8108-4ecc-9370-44f00738d5ff-proxy-tls podName:64673d93-8108-4ecc-9370-44f00738d5ff nodeName:}" failed. No retries permitted until 2026-09-18 19:49:28.998087318 +0000 UTC m=+2132.642842615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/64673d93-8108-4ecc-9370-44f00738d5ff-proxy-tls") pod "splitter-graph-aa781-77f68cffbc-9jwmt" (UID: "64673d93-8108-4ecc-9370-44f00738d5ff") : secret "splitter-graph-aa781-serving-cert" not found
Sep 18 19:49:28.498574 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:28.498551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64673d93-8108-4ecc-9370-44f00738d5ff-openshift-service-ca-bundle\") pod \"splitter-graph-aa781-77f68cffbc-9jwmt\" (UID: \"64673d93-8108-4ecc-9370-44f00738d5ff\") " pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:49:29.001786 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:29.001753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/64673d93-8108-4ecc-9370-44f00738d5ff-proxy-tls\") pod \"splitter-graph-aa781-77f68cffbc-9jwmt\" (UID: \"64673d93-8108-4ecc-9370-44f00738d5ff\") " pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:49:29.004397 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:29.004378    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/64673d93-8108-4ecc-9370-44f00738d5ff-proxy-tls\") pod \"splitter-graph-aa781-77f68cffbc-9jwmt\" (UID: \"64673d93-8108-4ecc-9370-44f00738d5ff\") " pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:49:29.224685 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:29.224668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:49:29.499177 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:29.499153    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"]
Sep 18 19:49:29.500959 ip-10-0-143-37 kubenswrapper[2580]: W0918 19:49:29.500934    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64673d93_8108_4ecc_9370_44f00738d5ff.slice/crio-ec4f24fe9040b07bc32ddd8983899ceb3029ee9528f0404533d8ffe8b5bc7a6c WatchSource:0}: Error finding container ec4f24fe9040b07bc32ddd8983899ceb3029ee9528f0404533d8ffe8b5bc7a6c: Status 404 returned error can't find the container with id ec4f24fe9040b07bc32ddd8983899ceb3029ee9528f0404533d8ffe8b5bc7a6c
Sep 18 19:49:30.382919 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:30.382879    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" event={"ID":"64673d93-8108-4ecc-9370-44f00738d5ff","Type":"ContainerStarted","Data":"a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16"}
Sep 18 19:49:30.383134 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:30.382937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" event={"ID":"64673d93-8108-4ecc-9370-44f00738d5ff","Type":"ContainerStarted","Data":"ec4f24fe9040b07bc32ddd8983899ceb3029ee9528f0404533d8ffe8b5bc7a6c"}
Sep 18 19:49:30.383134 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:30.383027    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:49:30.401632 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:30.401582    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" podStartSLOduration=2.401568052 podStartE2EDuration="2.401568052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:49:30.400707236 +0000 UTC m=+2134.045462583" watchObservedRunningTime="2026-09-18 19:49:30.401568052 +0000 UTC m=+2134.046323372"
Sep 18 19:49:36.393748 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:49:36.393717    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:53:58.493468 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:53:58.493437    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:53:58.501955 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:53:58.501934    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:53:58.502664 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:53:58.502647    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:53:58.510352 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:53:58.510334    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:54:58.601461 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:54:58.601430    2580 scope.go:117] "RemoveContainer" containerID="e301e0f4e5bd99ba991f501fc5e5b8ffa7c5f89662e9107c2f6ac22b3f9a4e4f"
Sep 18 19:57:43.467858 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:43.467767    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"]
Sep 18 19:57:43.468473 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:43.468019    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" podUID="64673d93-8108-4ecc-9370-44f00738d5ff" containerName="splitter-graph-aa781" containerID="cri-o://a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16" gracePeriod=30
Sep 18 19:57:43.594911 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:43.594880    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"]
Sep 18 19:57:43.595158 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:43.595120    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kserve-container" containerID="cri-o://5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4" gracePeriod=30
Sep 18 19:57:43.595256 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:43.595157    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kube-rbac-proxy" containerID="cri-o://1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4" gracePeriod=30
Sep 18 19:57:43.747155 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:43.747084    2580 generic.go:356] "Generic (PLEG): container finished" podID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerID="1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4" exitCode=2
Sep 18 19:57:43.747271 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:43.747161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" event={"ID":"b0c3a395-0c47-4914-9bca-e1d4e556b013","Type":"ContainerDied","Data":"1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4"}
Sep 18 19:57:46.342989 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.342945    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:57:46.393601 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.393569    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" podUID="64673d93-8108-4ecc-9370-44f00738d5ff" containerName="splitter-graph-aa781" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:57:46.427760 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.427736    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b0c3a395-0c47-4914-9bca-e1d4e556b013-proxy-tls\") pod \"b0c3a395-0c47-4914-9bca-e1d4e556b013\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") "
Sep 18 19:57:46.427889 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.427851    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-rbac-proxy-sar-config\") pod \"b0c3a395-0c47-4914-9bca-e1d4e556b013\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") "
Sep 18 19:57:46.427889 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.427881    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjwg6\" (UniqueName: \"kubernetes.io/projected/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-api-access-wjwg6\") pod \"b0c3a395-0c47-4914-9bca-e1d4e556b013\" (UID: \"b0c3a395-0c47-4914-9bca-e1d4e556b013\") "
Sep 18 19:57:46.428232 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.428202    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b0c3a395-0c47-4914-9bca-e1d4e556b013" (UID: "b0c3a395-0c47-4914-9bca-e1d4e556b013"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:57:46.430004 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.429947    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0c3a395-0c47-4914-9bca-e1d4e556b013-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b0c3a395-0c47-4914-9bca-e1d4e556b013" (UID: "b0c3a395-0c47-4914-9bca-e1d4e556b013"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:57:46.430088 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.430040    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-api-access-wjwg6" (OuterVolumeSpecName: "kube-api-access-wjwg6") pod "b0c3a395-0c47-4914-9bca-e1d4e556b013" (UID: "b0c3a395-0c47-4914-9bca-e1d4e556b013"). InnerVolumeSpecName "kube-api-access-wjwg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:57:46.528914 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.528848    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:57:46.528914 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.528874    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjwg6\" (UniqueName: \"kubernetes.io/projected/b0c3a395-0c47-4914-9bca-e1d4e556b013-kube-api-access-wjwg6\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:57:46.528914 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.528888    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b0c3a395-0c47-4914-9bca-e1d4e556b013-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:57:46.764774 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.764746    2580 generic.go:356] "Generic (PLEG): container finished" podID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerID="5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4" exitCode=0
Sep 18 19:57:46.764879 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.764799    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"
Sep 18 19:57:46.764923 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.764796    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" event={"ID":"b0c3a395-0c47-4914-9bca-e1d4e556b013","Type":"ContainerDied","Data":"5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4"}
Sep 18 19:57:46.764959 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.764944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225" event={"ID":"b0c3a395-0c47-4914-9bca-e1d4e556b013","Type":"ContainerDied","Data":"66f9370a28355bbd6312be1b8634bbaf4b392444c11eb2cfa03b2236e846afc4"}
Sep 18 19:57:46.765016 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.764992    2580 scope.go:117] "RemoveContainer" containerID="1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4"
Sep 18 19:57:46.774334 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.774317    2580 scope.go:117] "RemoveContainer" containerID="5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4"
Sep 18 19:57:46.782229 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.782212    2580 scope.go:117] "RemoveContainer" containerID="1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4"
Sep 18 19:57:46.782496 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:57:46.782476    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4\": container with ID starting with 1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4 not found: ID does not exist" containerID="1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4"
Sep 18 19:57:46.782559 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.782503    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4"} err="failed to get container status \"1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4\": rpc error: code = NotFound desc = could not find container \"1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4\": container with ID starting with 1d6bc272716f09f636ac340086a867aa79ae7755d9eb5a568f65ff7e78883ee4 not found: ID does not exist"
Sep 18 19:57:46.782559 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.782519    2580 scope.go:117] "RemoveContainer" containerID="5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4"
Sep 18 19:57:46.782814 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:57:46.782796    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4\": container with ID starting with 5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4 not found: ID does not exist" containerID="5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4"
Sep 18 19:57:46.782900 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.782820    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4"} err="failed to get container status \"5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4\": rpc error: code = NotFound desc = could not find container \"5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4\": container with ID starting with 5988633719a04a89d26f497379ed0136a2ca35f5b6b81fe6f2390f3699bf7ff4 not found: ID does not exist"
Sep 18 19:57:46.788761 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.788739    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"]
Sep 18 19:57:46.794151 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:46.794131    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-aa781-predictor-d59d4666c-6l225"]
Sep 18 19:57:48.375859 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:48.375816    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" path="/var/lib/kubelet/pods/b0c3a395-0c47-4914-9bca-e1d4e556b013/volumes"
Sep 18 19:57:51.392416 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:51.392370    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" podUID="64673d93-8108-4ecc-9370-44f00738d5ff" containerName="splitter-graph-aa781" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:57:56.391466 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:56.391426    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" podUID="64673d93-8108-4ecc-9370-44f00738d5ff" containerName="splitter-graph-aa781" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:57:56.391884 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:57:56.391526    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:58:01.391562 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:01.391525    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" podUID="64673d93-8108-4ecc-9370-44f00738d5ff" containerName="splitter-graph-aa781" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:58:06.392022 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:06.391962    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" podUID="64673d93-8108-4ecc-9370-44f00738d5ff" containerName="splitter-graph-aa781" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:58:11.391727 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:11.391679    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" podUID="64673d93-8108-4ecc-9370-44f00738d5ff" containerName="splitter-graph-aa781" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:58:13.624527 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.624490    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:58:13.731917 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.731840    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64673d93-8108-4ecc-9370-44f00738d5ff-openshift-service-ca-bundle\") pod \"64673d93-8108-4ecc-9370-44f00738d5ff\" (UID: \"64673d93-8108-4ecc-9370-44f00738d5ff\") "
Sep 18 19:58:13.731917 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.731873    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/64673d93-8108-4ecc-9370-44f00738d5ff-proxy-tls\") pod \"64673d93-8108-4ecc-9370-44f00738d5ff\" (UID: \"64673d93-8108-4ecc-9370-44f00738d5ff\") "
Sep 18 19:58:13.732254 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.732233    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64673d93-8108-4ecc-9370-44f00738d5ff-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "64673d93-8108-4ecc-9370-44f00738d5ff" (UID: "64673d93-8108-4ecc-9370-44f00738d5ff"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:58:13.734059 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.734034    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64673d93-8108-4ecc-9370-44f00738d5ff-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "64673d93-8108-4ecc-9370-44f00738d5ff" (UID: "64673d93-8108-4ecc-9370-44f00738d5ff"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:58:13.832856 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.832828    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64673d93-8108-4ecc-9370-44f00738d5ff-openshift-service-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:58:13.832856 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.832852    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/64673d93-8108-4ecc-9370-44f00738d5ff-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 19:58:13.899712 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.899679    2580 generic.go:356] "Generic (PLEG): container finished" podID="64673d93-8108-4ecc-9370-44f00738d5ff" containerID="a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16" exitCode=0
Sep 18 19:58:13.899846 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.899724    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"
Sep 18 19:58:13.899846 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.899761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" event={"ID":"64673d93-8108-4ecc-9370-44f00738d5ff","Type":"ContainerDied","Data":"a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16"}
Sep 18 19:58:13.899846 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.899820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt" event={"ID":"64673d93-8108-4ecc-9370-44f00738d5ff","Type":"ContainerDied","Data":"ec4f24fe9040b07bc32ddd8983899ceb3029ee9528f0404533d8ffe8b5bc7a6c"}
Sep 18 19:58:13.899846 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.899843    2580 scope.go:117] "RemoveContainer" containerID="a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16"
Sep 18 19:58:13.908733 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.908717    2580 scope.go:117] "RemoveContainer" containerID="a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16"
Sep 18 19:58:13.909015 ip-10-0-143-37 kubenswrapper[2580]: E0918 19:58:13.908995    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16\": container with ID starting with a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16 not found: ID does not exist" containerID="a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16"
Sep 18 19:58:13.909080 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.909026    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16"} err="failed to get container status \"a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16\": rpc error: code = NotFound desc = could not find container \"a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16\": container with ID starting with a4a2c1d4e2444a79e865cf061da0256aeaacadf9ec01edc5d977248614ad3a16 not found: ID does not exist"
Sep 18 19:58:13.923407 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.923382    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"]
Sep 18 19:58:13.931775 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:13.931757    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-aa781-77f68cffbc-9jwmt"]
Sep 18 19:58:14.376130 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:14.376092    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64673d93-8108-4ecc-9370-44f00738d5ff" path="/var/lib/kubelet/pods/64673d93-8108-4ecc-9370-44f00738d5ff/volumes"
Sep 18 19:58:58.525440 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:58.525347    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:58:58.532618 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:58.532596    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 19:58:58.533483 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:58.533461    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 19:58:58.541235 ip-10-0-143-37 kubenswrapper[2580]: I0918 19:58:58.541218    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 20:03:58.554354 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:03:58.554240    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 20:03:58.562772 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:03:58.562747    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 20:03:58.562934 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:03:58.562919    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 20:03:58.570768 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:03:58.570748    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 20:05:34.210161 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:34.210122    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"]
Sep 18 20:05:34.210734 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:34.210406    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" podUID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" containerName="switch-graph-38355" containerID="cri-o://4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d" gracePeriod=30
Sep 18 20:05:34.361119 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:34.361086    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"]
Sep 18 20:05:34.361344 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:34.361306    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kserve-container" containerID="cri-o://880b559f0280fe92c2bd00874a6a711dce894afe94534ef7410f2755b533c6d5" gracePeriod=30
Sep 18 20:05:34.361439 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:34.361378    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kube-rbac-proxy" containerID="cri-o://370f85cd5c6eaefb5b87877a3021b4fcfa756abe7dcb55808283b6e974674cbd" gracePeriod=30
Sep 18 20:05:34.991241 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:34.991207    2580 generic.go:356] "Generic (PLEG): container finished" podID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerID="370f85cd5c6eaefb5b87877a3021b4fcfa756abe7dcb55808283b6e974674cbd" exitCode=2
Sep 18 20:05:34.991419 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:34.991289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" event={"ID":"f678985d-7172-42c8-bb3f-2dc778f1a925","Type":"ContainerDied","Data":"370f85cd5c6eaefb5b87877a3021b4fcfa756abe7dcb55808283b6e974674cbd"}
Sep 18 20:05:36.023426 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:36.023382    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.48:8643/healthz\": dial tcp 10.132.0.48:8643: connect: connection refused"
Sep 18 20:05:36.319190 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:36.319090    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" podUID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" containerName="switch-graph-38355" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:05:37.005458 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.005425    2580 generic.go:356] "Generic (PLEG): container finished" podID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerID="880b559f0280fe92c2bd00874a6a711dce894afe94534ef7410f2755b533c6d5" exitCode=0
Sep 18 20:05:37.005620 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.005485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" event={"ID":"f678985d-7172-42c8-bb3f-2dc778f1a925","Type":"ContainerDied","Data":"880b559f0280fe92c2bd00874a6a711dce894afe94534ef7410f2755b533c6d5"}
Sep 18 20:05:37.105961 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.105941    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 20:05:37.231837 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.231776    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-rbac-proxy-sar-config\") pod \"f678985d-7172-42c8-bb3f-2dc778f1a925\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") "
Sep 18 20:05:37.231837 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.231836    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-785x6\" (UniqueName: \"kubernetes.io/projected/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-api-access-785x6\") pod \"f678985d-7172-42c8-bb3f-2dc778f1a925\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") "
Sep 18 20:05:37.232044 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.231937    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f678985d-7172-42c8-bb3f-2dc778f1a925-proxy-tls\") pod \"f678985d-7172-42c8-bb3f-2dc778f1a925\" (UID: \"f678985d-7172-42c8-bb3f-2dc778f1a925\") "
Sep 18 20:05:37.232116 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.232102    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f678985d-7172-42c8-bb3f-2dc778f1a925" (UID: "f678985d-7172-42c8-bb3f-2dc778f1a925"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:05:37.232200 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.232183    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 20:05:37.234134 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.234113    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-api-access-785x6" (OuterVolumeSpecName: "kube-api-access-785x6") pod "f678985d-7172-42c8-bb3f-2dc778f1a925" (UID: "f678985d-7172-42c8-bb3f-2dc778f1a925"). InnerVolumeSpecName "kube-api-access-785x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:05:37.234240 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.234216    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f678985d-7172-42c8-bb3f-2dc778f1a925-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f678985d-7172-42c8-bb3f-2dc778f1a925" (UID: "f678985d-7172-42c8-bb3f-2dc778f1a925"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:05:37.332810 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.332786    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-785x6\" (UniqueName: \"kubernetes.io/projected/f678985d-7172-42c8-bb3f-2dc778f1a925-kube-api-access-785x6\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 20:05:37.332810 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:37.332808    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f678985d-7172-42c8-bb3f-2dc778f1a925-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 20:05:38.012381 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:38.012353    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"
Sep 18 20:05:38.012381 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:38.012361    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2" event={"ID":"f678985d-7172-42c8-bb3f-2dc778f1a925","Type":"ContainerDied","Data":"396a55e11118f02c53ee69abbf33b20f1a94522041056642350bd0a30e7a973c"}
Sep 18 20:05:38.012615 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:38.012430    2580 scope.go:117] "RemoveContainer" containerID="370f85cd5c6eaefb5b87877a3021b4fcfa756abe7dcb55808283b6e974674cbd"
Sep 18 20:05:38.022541 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:38.022517    2580 scope.go:117] "RemoveContainer" containerID="880b559f0280fe92c2bd00874a6a711dce894afe94534ef7410f2755b533c6d5"
Sep 18 20:05:38.037112 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:38.037088    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"]
Sep 18 20:05:38.043316 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:38.043294    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-38355-predictor-6966f67cf9-g4qb2"]
Sep 18 20:05:38.376126 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:38.376096    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" path="/var/lib/kubelet/pods/f678985d-7172-42c8-bb3f-2dc778f1a925/volumes"
Sep 18 20:05:41.319661 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:41.319623    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" podUID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" containerName="switch-graph-38355" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:05:46.319822 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:46.319776    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" podUID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" containerName="switch-graph-38355" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:05:46.320322 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:46.319902    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 20:05:51.319181 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:51.319135    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" podUID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" containerName="switch-graph-38355" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:05:51.574145 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:51.574063    2580 ???:1] "http: TLS handshake error from 10.0.140.94:33420: EOF"
Sep 18 20:05:51.580488 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:51.580457    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:05:52.513700 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:52.513660    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:05:53.394131 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:53.394104    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:05:54.244775 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:54.244744    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:05:55.095616 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:55.095582    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:05:55.964240 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:55.964200    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:05:56.319940 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:56.319843    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" podUID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" containerName="switch-graph-38355" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:05:56.923887 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:56.923856    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:05:57.808444 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:57.808413    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:05:58.676950 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:58.676920    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:05:59.568184 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:05:59.568154    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:06:00.419271 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:00.419244    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:06:01.307139 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:01.307108    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:06:01.320079 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:01.320045    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" podUID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" containerName="switch-graph-38355" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:06:02.148615 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:02.148582    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:06:03.034472 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:03.034443    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:06:03.905820 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:03.905789    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-38355-74cc5846cd-qjrcw_03e62539-a102-43e1-9fb3-f1c1257f9b0e/switch-graph-38355/0.log"
Sep 18 20:06:04.350756 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:04.350726    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 20:06:04.424000 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:04.423959    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e62539-a102-43e1-9fb3-f1c1257f9b0e-openshift-service-ca-bundle\") pod \"03e62539-a102-43e1-9fb3-f1c1257f9b0e\" (UID: \"03e62539-a102-43e1-9fb3-f1c1257f9b0e\") "
Sep 18 20:06:04.424131 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:04.424084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03e62539-a102-43e1-9fb3-f1c1257f9b0e-proxy-tls\") pod \"03e62539-a102-43e1-9fb3-f1c1257f9b0e\" (UID: \"03e62539-a102-43e1-9fb3-f1c1257f9b0e\") "
Sep 18 20:06:04.424333 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:04.424285    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03e62539-a102-43e1-9fb3-f1c1257f9b0e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "03e62539-a102-43e1-9fb3-f1c1257f9b0e" (UID: "03e62539-a102-43e1-9fb3-f1c1257f9b0e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:06:04.426205 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:04.426176    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03e62539-a102-43e1-9fb3-f1c1257f9b0e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "03e62539-a102-43e1-9fb3-f1c1257f9b0e" (UID: "03e62539-a102-43e1-9fb3-f1c1257f9b0e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:06:04.524815 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:04.524764    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e62539-a102-43e1-9fb3-f1c1257f9b0e-openshift-service-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 20:06:04.524815 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:04.524786    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03e62539-a102-43e1-9fb3-f1c1257f9b0e-proxy-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Sep 18 20:06:05.139108 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:05.139077    2580 generic.go:356] "Generic (PLEG): container finished" podID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" containerID="4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d" exitCode=137
Sep 18 20:06:05.139325 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:05.139132    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"
Sep 18 20:06:05.139325 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:05.139171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" event={"ID":"03e62539-a102-43e1-9fb3-f1c1257f9b0e","Type":"ContainerDied","Data":"4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d"}
Sep 18 20:06:05.139325 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:05.139231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw" event={"ID":"03e62539-a102-43e1-9fb3-f1c1257f9b0e","Type":"ContainerDied","Data":"b3230540c0a68d4222824a1ed2ae2c1bb3911de3b4f13657a667a560990048c4"}
Sep 18 20:06:05.139325 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:05.139263    2580 scope.go:117] "RemoveContainer" containerID="4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d"
Sep 18 20:06:05.148386 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:05.148367    2580 scope.go:117] "RemoveContainer" containerID="4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d"
Sep 18 20:06:05.148670 ip-10-0-143-37 kubenswrapper[2580]: E0918 20:06:05.148651    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d\": container with ID starting with 4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d not found: ID does not exist" containerID="4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d"
Sep 18 20:06:05.148748 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:05.148677    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d"} err="failed to get container status \"4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d\": rpc error: code = NotFound desc = could not find container \"4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d\": container with ID starting with 4497aaacfd19abe1ffd6b71d1177aed041a31152cbaa8c646166067acfc72f8d not found: ID does not exist"
Sep 18 20:06:05.161808 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:05.161780    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"]
Sep 18 20:06:05.167022 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:05.166999    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-38355-74cc5846cd-qjrcw"]
Sep 18 20:06:06.375194 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:06.375161    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" path="/var/lib/kubelet/pods/03e62539-a102-43e1-9fb3-f1c1257f9b0e/volumes"
Sep 18 20:06:09.295091 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:09.295012    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p2742_b82e3dd9-8c44-49cc-861b-69e0b21d16ec/global-pull-secret-syncer/0.log"
Sep 18 20:06:09.429802 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:09.429778    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wfc56_a07cc7e5-d5f1-44e3-affc-88808fec404e/konnectivity-agent/0.log"
Sep 18 20:06:09.521127 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:09.521100    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-37.ec2.internal_6afa4c8539d7081c7f2c331a410f49da/haproxy/0.log"
Sep 18 20:06:13.529260 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:13.529223    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c733224f-f71b-4617-932d-0382115f3244/alertmanager/0.log"
Sep 18 20:06:13.571995 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:13.571954    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c733224f-f71b-4617-932d-0382115f3244/config-reloader/0.log"
Sep 18 20:06:13.613636 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:13.613613    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c733224f-f71b-4617-932d-0382115f3244/kube-rbac-proxy-web/0.log"
Sep 18 20:06:13.646070 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:13.646039    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c733224f-f71b-4617-932d-0382115f3244/kube-rbac-proxy/0.log"
Sep 18 20:06:13.694966 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:13.694937    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c733224f-f71b-4617-932d-0382115f3244/kube-rbac-proxy-metric/0.log"
Sep 18 20:06:13.730495 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:13.730474    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c733224f-f71b-4617-932d-0382115f3244/prom-label-proxy/0.log"
Sep 18 20:06:13.768466 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:13.768449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c733224f-f71b-4617-932d-0382115f3244/init-config-reloader/0.log"
Sep 18 20:06:13.853879 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:13.853856    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-n8bfn_60f01d14-922a-4b69-a575-74908eaca8f4/kube-state-metrics/0.log"
Sep 18 20:06:13.901133 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:13.901113    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-n8bfn_60f01d14-922a-4b69-a575-74908eaca8f4/kube-rbac-proxy-main/0.log"
Sep 18 20:06:13.944599 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:13.944574    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-n8bfn_60f01d14-922a-4b69-a575-74908eaca8f4/kube-rbac-proxy-self/0.log"
Sep 18 20:06:13.993725 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:13.993703    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5897564487-s5ffz_4e1ff0bd-c692-4ade-ad46-7a2a8d797c70/metrics-server/0.log"
Sep 18 20:06:14.194596 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:14.194545    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpzts_cfb0302d-70f3-4e02-bd86-1969585c4954/node-exporter/0.log"
Sep 18 20:06:14.225945 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:14.225925    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpzts_cfb0302d-70f3-4e02-bd86-1969585c4954/kube-rbac-proxy/0.log"
Sep 18 20:06:14.258140 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:14.258119    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpzts_cfb0302d-70f3-4e02-bd86-1969585c4954/init-textfile/0.log"
Sep 18 20:06:14.910057 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:14.910031    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c96b8b6b6-hxv6l_d4c4ef1c-c4a7-413b-b293-6905fed1d4fb/telemeter-client/0.log"
Sep 18 20:06:14.955164 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:14.955148    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c96b8b6b6-hxv6l_d4c4ef1c-c4a7-413b-b293-6905fed1d4fb/reload/0.log"
Sep 18 20:06:14.985552 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:14.985531    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c96b8b6b6-hxv6l_d4c4ef1c-c4a7-413b-b293-6905fed1d4fb/kube-rbac-proxy/0.log"
Sep 18 20:06:16.954092 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954054    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"]
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954391    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kserve-container"
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954403    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kserve-container"
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954412    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kube-rbac-proxy"
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954417    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kube-rbac-proxy"
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954427    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kube-rbac-proxy"
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954433    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kube-rbac-proxy"
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954439    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kserve-container"
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954446    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kserve-container"
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954453    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" containerName="switch-graph-38355"
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954459    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" containerName="switch-graph-38355"
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954465    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64673d93-8108-4ecc-9370-44f00738d5ff" containerName="splitter-graph-aa781"
Sep 18 20:06:16.954480 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954471    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="64673d93-8108-4ecc-9370-44f00738d5ff" containerName="splitter-graph-aa781"
Sep 18 20:06:16.954858 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954522    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kube-rbac-proxy"
Sep 18 20:06:16.954858 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954529    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="03e62539-a102-43e1-9fb3-f1c1257f9b0e" containerName="switch-graph-38355"
Sep 18 20:06:16.954858 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954536    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kube-rbac-proxy"
Sep 18 20:06:16.954858 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954543    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c3a395-0c47-4914-9bca-e1d4e556b013" containerName="kserve-container"
Sep 18 20:06:16.954858 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954549    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="64673d93-8108-4ecc-9370-44f00738d5ff" containerName="splitter-graph-aa781"
Sep 18 20:06:16.954858 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.954557    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f678985d-7172-42c8-bb3f-2dc778f1a925" containerName="kserve-container"
Sep 18 20:06:16.958818 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.958800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:16.964756 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.964731    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7jg6d\"/\"kube-root-ca.crt\""
Sep 18 20:06:16.965647 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.965625    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7jg6d\"/\"openshift-service-ca.crt\""
Sep 18 20:06:16.965715 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:16.965633    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7jg6d\"/\"default-dockercfg-76422\""
Sep 18 20:06:17.000117 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.000092    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"]
Sep 18 20:06:17.013771 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.013750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-sys\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.013875 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.013789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-podres\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.013875 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.013811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97s8m\" (UniqueName: \"kubernetes.io/projected/3ae3a698-2dad-44e0-8267-44ea519cf28f-kube-api-access-97s8m\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.013984 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.013910    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-proc\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.013984 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.013950    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-lib-modules\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.107843 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.107819    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/1.log"
Sep 18 20:06:17.113379 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.113353    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-tb4hf_e8b7818b-cec4-4406-8a2a-e3c212cab8af/console-operator/2.log"
Sep 18 20:06:17.115018 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.115000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-proc\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.115094 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.115038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-lib-modules\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.115094 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.115060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-sys\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.115206 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.115116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-sys\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.115206 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.115124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-proc\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.115206 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.115140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-podres\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.115206 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.115179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97s8m\" (UniqueName: \"kubernetes.io/projected/3ae3a698-2dad-44e0-8267-44ea519cf28f-kube-api-access-97s8m\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.115206 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.115188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-lib-modules\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.115461 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.115213    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ae3a698-2dad-44e0-8267-44ea519cf28f-podres\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.169058 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.169027    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97s8m\" (UniqueName: \"kubernetes.io/projected/3ae3a698-2dad-44e0-8267-44ea519cf28f-kube-api-access-97s8m\") pod \"perf-node-gather-daemonset-wvhsb\" (UID: \"3ae3a698-2dad-44e0-8267-44ea519cf28f\") " pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.268807 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.268746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:17.554035 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.553951    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"]
Sep 18 20:06:17.557266 ip-10-0-143-37 kubenswrapper[2580]: W0918 20:06:17.557239    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3ae3a698_2dad_44e0_8267_44ea519cf28f.slice/crio-0650ac41abe3327b0f44afe177d009c344bc5b1faa4af1bc4e49049e6317ecea WatchSource:0}: Error finding container 0650ac41abe3327b0f44afe177d009c344bc5b1faa4af1bc4e49049e6317ecea: Status 404 returned error can't find the container with id 0650ac41abe3327b0f44afe177d009c344bc5b1faa4af1bc4e49049e6317ecea
Sep 18 20:06:17.785485 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:17.785463    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-ldgqv_7948f1f6-7263-4173-bc81-16ce21ae65ed/download-server/0.log"
Sep 18 20:06:18.200124 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:18.200091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb" event={"ID":"3ae3a698-2dad-44e0-8267-44ea519cf28f","Type":"ContainerStarted","Data":"4a7cdec1224d0f6d067738e89778dbe6afca0c4493bb4705543a5714bb6fb148"}
Sep 18 20:06:18.200474 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:18.200143    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb" event={"ID":"3ae3a698-2dad-44e0-8267-44ea519cf28f","Type":"ContainerStarted","Data":"0650ac41abe3327b0f44afe177d009c344bc5b1faa4af1bc4e49049e6317ecea"}
Sep 18 20:06:18.200474 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:18.200189    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:18.222737 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:18.222693    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb" podStartSLOduration=2.222679878 podStartE2EDuration="2.222679878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:06:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:06:18.222316648 +0000 UTC m=+3141.867071969" watchObservedRunningTime="2026-09-18 20:06:18.222679878 +0000 UTC m=+3141.867435198"
Sep 18 20:06:19.679705 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:19.679663    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rzqsw_646e7537-ad0c-4b98-85a3-7da9f26d66e9/dns/0.log"
Sep 18 20:06:19.710301 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:19.710274    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rzqsw_646e7537-ad0c-4b98-85a3-7da9f26d66e9/kube-rbac-proxy/0.log"
Sep 18 20:06:19.771987 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:19.771950    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cmpvg_373c0994-3612-49aa-80f4-37ed02681856/dns-node-resolver/0.log"
Sep 18 20:06:20.333753 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:20.333729    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mchl7_7a6186c8-e5b6-4b5c-827f-0702f4786c68/node-ca/0.log"
Sep 18 20:06:21.485631 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:21.485600    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nf6c8_63e24fba-9743-4bbf-9613-c0b0e126d7ba/serve-healthcheck-canary/0.log"
Sep 18 20:06:21.997228 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:21.997205    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shm2b_b963ed37-bec8-4b85-a755-387803d45330/kube-rbac-proxy/0.log"
Sep 18 20:06:22.035006 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:22.034960    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shm2b_b963ed37-bec8-4b85-a755-387803d45330/exporter/0.log"
Sep 18 20:06:22.076059 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:22.076032    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shm2b_b963ed37-bec8-4b85-a755-387803d45330/extractor/0.log"
Sep 18 20:06:24.215262 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:24.215234    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7jg6d/perf-node-gather-daemonset-wvhsb"
Sep 18 20:06:24.476650 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:24.476580    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-5ccfd4fdb4-fdqwf_c7a5670a-ccf9-4ec8-9f92-5a51af13d981/manager/0.log"
Sep 18 20:06:24.512911 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:24.512883    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-62r6c_e3b67cd5-6d33-4c29-829d-0963c625ca4f/manager/0.log"
Sep 18 20:06:29.513784 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:29.513745    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-qj4tm_a7a2bad5-8cc6-46d0-a7d8-227bd9607cd8/migrator/0.log"
Sep 18 20:06:29.544369 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:29.544348    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-qj4tm_a7a2bad5-8cc6-46d0-a7d8-227bd9607cd8/graceful-termination/0.log"
Sep 18 20:06:29.931959 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:29.931933    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-swxbm_63716f9e-c352-4d9c-91a4-ede4d11977cc/kube-storage-version-migrator-operator/1.log"
Sep 18 20:06:29.933085 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:29.933065    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-swxbm_63716f9e-c352-4d9c-91a4-ede4d11977cc/kube-storage-version-migrator-operator/0.log"
Sep 18 20:06:30.966371 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:30.966343    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52rk4_ddf53171-d25a-4e1b-8aa4-00e664f2f2d3/kube-multus-additional-cni-plugins/0.log"
Sep 18 20:06:30.990992 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:30.990949    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52rk4_ddf53171-d25a-4e1b-8aa4-00e664f2f2d3/egress-router-binary-copy/0.log"
Sep 18 20:06:31.019517 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:31.019497    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52rk4_ddf53171-d25a-4e1b-8aa4-00e664f2f2d3/cni-plugins/0.log"
Sep 18 20:06:31.047548 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:31.047528    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52rk4_ddf53171-d25a-4e1b-8aa4-00e664f2f2d3/bond-cni-plugin/0.log"
Sep 18 20:06:31.082077 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:31.082060    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52rk4_ddf53171-d25a-4e1b-8aa4-00e664f2f2d3/routeoverride-cni/0.log"
Sep 18 20:06:31.106812 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:31.106785    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52rk4_ddf53171-d25a-4e1b-8aa4-00e664f2f2d3/whereabouts-cni-bincopy/0.log"
Sep 18 20:06:31.143586 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:31.143568    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52rk4_ddf53171-d25a-4e1b-8aa4-00e664f2f2d3/whereabouts-cni/0.log"
Sep 18 20:06:31.675092 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:31.675064    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hg9dp_d3fd8613-128f-437b-b356-c618813583d0/kube-multus/0.log"
Sep 18 20:06:31.861295 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:31.861270    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r7bpt_d3082557-8a7a-424f-b6af-d746972e7352/network-metrics-daemon/0.log"
Sep 18 20:06:31.892792 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:31.892766    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r7bpt_d3082557-8a7a-424f-b6af-d746972e7352/kube-rbac-proxy/0.log"
Sep 18 20:06:33.401266 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:33.401237    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-controller/0.log"
Sep 18 20:06:33.436951 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:33.436923    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/1.log"
Sep 18 20:06:33.436951 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:33.436936    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/ovn-acl-logging/0.log"
Sep 18 20:06:33.477944 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:33.477923    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/kube-rbac-proxy-node/0.log"
Sep 18 20:06:33.514624 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:33.514605    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/kube-rbac-proxy-ovn-metrics/0.log"
Sep 18 20:06:33.544221 ip-10-0-143-37 kubenswrapper[2580]: I0918 20:06:33.544197    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx96p_65ef3b15-9c5b-43b6-8cdb-e4cb3e03e3fe/northd/0.log"