Sep 17 16:39:55.982536 ip-10-0-143-228 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 16:39:55.982551 ip-10-0-143-228 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 16:39:55.982560 ip-10-0-143-228 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 16:39:55.982876 ip-10-0-143-228 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 16:40:07.357194 ip-10-0-143-228 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 16:40:07.357210 ip-10-0-143-228 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f55b53d33a594bd18df39a6b9c9f0ff1 --
Sep 17 16:44:01.209973 ip-10-0-143-228 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 16:44:04.639796 ip-10-0-143-228 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 16:44:04.639796 ip-10-0-143-228 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 16:44:04.639796 ip-10-0-143-228 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 16:44:04.639796 ip-10-0-143-228 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 16:44:04.639796 ip-10-0-143-228 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 16:44:04.640466 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.639852    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 16:44:04.642851 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642835    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:44:04.642851 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642850    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642854    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642858    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642861    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642863    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642866    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642869    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642873    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642876    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642878    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642881    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642884    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642886    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642889    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642891    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642894    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642897    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642899    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642901    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:44:04.642920 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642909    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642912    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642915    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642918    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642921    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642923    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642926    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642929    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642932    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642935    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642937    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642940    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642942    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642945    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642947    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642951    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642955    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642958    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642961    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:44:04.643366 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642963    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642966    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642968    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642971    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642973    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642975    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642978    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642980    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642983    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642985    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642987    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642990    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642992    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642995    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.642998    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643001    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643004    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643006    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643009    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643011    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:44:04.643884 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643015    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643018    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643022    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643025    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643028    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643031    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643033    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643036    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643039    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643041    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643044    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643047    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643049    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643052    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643054    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643057    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643061    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643064    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643067    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:44:04.644369 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643070    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643073    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643077    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643080    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643083    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643085    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643088    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643092    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643095    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643098    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643100    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643103    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643105    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643108    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643111    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643113    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643116    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643119    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643121    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643123    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:44:04.644859 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643126    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643830    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643836    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643839    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643842    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643845    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643848    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643850    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643853    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643856    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643858    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643861    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643864    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643866    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643869    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643872    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643874    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643877    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643880    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:44:04.645351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643882    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643885    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643889    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643891    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643894    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643897    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643899    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643902    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643905    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643907    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643910    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643912    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643915    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643918    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643920    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643925    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643929    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643932    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643935    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643938    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:44:04.645850 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643941    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643944    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643947    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643949    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643952    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643955    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643957    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643960    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643962    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643964    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643967    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643971    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643973    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643977    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643981    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643984    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643987    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643990    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643992    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:44:04.646370 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643995    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.643998    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644000    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644003    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644005    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644008    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644010    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644013    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644015    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644018    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644020    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644023    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644025    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644028    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644031    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644033    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644036    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644038    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644041    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644043    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:44:04.646846 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644045    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644048    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644053    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644056    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644059    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644061    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644064    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644067    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644069    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644072    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644075    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644077    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644080    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644083    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644085    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644088    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644090    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644093    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644095    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644098    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:44:04.647330 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644103    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644105    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644481    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644486    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644490    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644493    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644496    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644499    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644501    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644504    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644506    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644509    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644512    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644514    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644517    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644519    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644522    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644524    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644537    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:44:04.647844 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644541    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644544    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644547    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644550    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644553    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644555    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644558    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644560    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644563    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644565    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644568    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644571    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644575    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644580    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644582    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644585    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644587    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644590    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644592    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:44:04.648300 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644597    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644601    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644604    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644607    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644609    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644612    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644615    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644617    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644620    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644623    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644625    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644643    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644645    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644648    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644650    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644653    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644656    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644659    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644662    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644664    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:44:04.648842 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644667    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644669    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644672    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644674    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644677    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644679    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644683    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644686    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644688    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644691    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644693    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644696    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644699    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644702    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644705    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644707    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644710    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644712    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644715    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:44:04.649329 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644717    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644720    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644722    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644725    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644728    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644730    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644732    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644735    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644738    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644741    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644743    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644746    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644748    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644751    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644753    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644755    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644758    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644761    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644763    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644767    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:44:04.649806 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644770    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644772    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644774    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.644778    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644846    2571 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644878    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644885    2571 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644889    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644893    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644896    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644901    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644905    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644908    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644911    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644915    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644919    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644922    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644925    2571 flags.go:64] FLAG: --cgroup-root=""
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644928    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644931    2571 flags.go:64] FLAG: --client-ca-file=""
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644933    2571 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644936    2571 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644940    2571 flags.go:64] FLAG: --cluster-domain=""
Sep 17 16:44:04.650302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644943    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644946    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644950    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644953    2571 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644957    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644960    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644963    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644966    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644970    2571 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644973    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644976    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644978    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644981    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644985    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644988    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644991    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644994    2571 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.644998    2571 flags.go:64] FLAG: --enable-server="true"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645001    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645006    2571 flags.go:64] FLAG: --event-burst="100"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645009    2571 flags.go:64] FLAG: --event-qps="50"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645012    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645015    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645018    2571 flags.go:64] FLAG: --eviction-hard=""
Sep 17 16:44:04.650910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645021    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645024    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645027    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645029    2571 flags.go:64] FLAG: --eviction-soft=""
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645033    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645036    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645038    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645041    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645044    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645047    2571 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645050    2571 flags.go:64] FLAG: --feature-gates=""
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645054    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645057    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645059    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645062    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645065    2571 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645069    2571 flags.go:64] FLAG: --help="false"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645072    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-143-228.ec2.internal"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645075    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645078    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645081    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645084    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645087    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645090    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 16:44:04.651504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645093    2571 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645100    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645103    2571 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645106    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645109    2571 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645112    2571 flags.go:64] FLAG: --kube-reserved=""
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645115    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645118    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645121    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645124    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645127    2571 flags.go:64] FLAG: --lock-file=""
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645129    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645132    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645135    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645141    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645144    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645146    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645149    2571 flags.go:64] FLAG: --logging-format="text"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645152    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645156    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645159    2571 flags.go:64] FLAG: --manifest-url=""
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645161    2571 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645165    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645168    2571 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645172    2571 flags.go:64] FLAG: --max-pods="110"
Sep 17 16:44:04.652361 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645175    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645178    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645181    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645184    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645187    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645190    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645192    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645199    2571 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645203    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645206    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645209    2571 flags.go:64] FLAG: --pod-cidr=""
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645212    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645217    2571 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645221    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645224    2571 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645227    2571 flags.go:64] FLAG: --port="10250"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645229    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645232    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ac467a232c6e2df6"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645235    2571 flags.go:64] FLAG: --qos-reserved=""
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645238    2571 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645241    2571 flags.go:64] FLAG: --register-node="true"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645245    2571 flags.go:64] FLAG: --register-with-taints=""
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645248    2571 flags.go:64] FLAG: --registry-burst="10"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645251    2571 flags.go:64] FLAG: --registry-qps="5"
Sep 17 16:44:04.653263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645254    2571 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645257    2571 flags.go:64] FLAG: --reserved-memory=""
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645261    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645264    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645267    2571 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645270    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645273    2571 flags.go:64] FLAG: --runonce="false"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645275    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645279    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645282    2571 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645285    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645287    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645290    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645293    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645296    2571 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645299    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645303    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645305    2571 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645308    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645311    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645314    2571 flags.go:64] FLAG: --system-cgroups=""
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645317    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645322    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645325    2571 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645328    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 16:44:04.653876 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645332    2571 flags.go:64] FLAG: --tls-min-version=""
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645334    2571 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645337    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645340    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645342    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645345    2571 flags.go:64] FLAG: --v="2"
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645349    2571 flags.go:64] FLAG: --version="false"
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645353    2571 flags.go:64] FLAG: --vmodule=""
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645356    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645359    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645468    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645472    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645475    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645477    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645482    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645485    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645488    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645491    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645494    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645496    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645498    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645501    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:44:04.654494 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645503    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645507    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645510    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645512    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645515    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645517    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645520    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645522    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645524    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645527    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645529    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645532    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645535    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645537    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645539    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645542    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645544    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645547    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645549    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645552    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:44:04.655061 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645556    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645558    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645561    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645563    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645567    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645570    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645574    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645577    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645580    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645583    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645585    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645588    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645590    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645593    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645596    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645599    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645601    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645604    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645606    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:44:04.655558 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645609    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645612    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645614    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645617    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645620    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645622    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645625    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645641    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645644    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645646    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645649    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645651    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645654    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645657    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645660    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645663    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645667    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645671    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645675    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:44:04.656057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645678    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645681    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645683    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645686    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645688    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645691    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645693    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645696    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645698    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645701    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645704    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645707    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645710    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645713    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645716    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645718    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645721    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645723    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645726    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645728    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:44:04.656517 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645731    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645734    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645736    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645739    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645741    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645743    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645746    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645748    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.645751    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.645760    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.654374    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.654391    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.654413    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.654419    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654478    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:44:04.657055 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654483    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654487    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654490    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654493    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654496    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654499    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654502    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654505    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654508    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654511    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654513    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654516    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654519    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654521    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654524    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654527    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654530    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654532    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654535    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654537    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:44:04.657429 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654540    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654542    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654545    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654548    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654550    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654553    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654556    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654559    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654562    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654564    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654567    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654570    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654572    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654575    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654578    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654580    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654583    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654585    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654588    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654591    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:44:04.657974 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654594    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654596    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654599    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654601    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654604    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654606    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654611    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654615    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654618    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654621    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654623    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654626    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654647    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654652    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654655    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654658    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654661    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654663    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654666    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:44:04.658470 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654668    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654671    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654674    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654677    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654680    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654682    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654684    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654687    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654690    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654692    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654695    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654697    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654700    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654702    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654705    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654707    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654710    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654712    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654715    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654719    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:44:04.658976 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654721    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654724    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654727    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654729    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654732    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654734    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654737    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654739    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654742    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654746    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654749    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654752    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654756    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654760    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654763    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654766    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654769    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654771    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:44:04.659485 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654775    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.654780    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654898    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654903    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654906    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654909    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654913    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654917    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654919    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654922    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654925    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654928    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654931    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654934    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:44:04.659949 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654937    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654940    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654943    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654946    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654949    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654951    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654954    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654957    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654960    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654963    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654965    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654968    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654970    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654972    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654975    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654977    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654980    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654982    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654985    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654987    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:44:04.660310 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654990    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654993    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654995    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.654997    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655000    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655003    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655005    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655008    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655011    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655013    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655017    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655021    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655023    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655028    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655030    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655033    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655035    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655038    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655040    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:44:04.660870 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655043    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655045    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655048    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655050    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655053    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655055    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655058    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655060    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655063    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655066    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655068    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655071    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655074    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655076    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655080    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655084    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655087    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655090    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655092    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:44:04.661349 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655095    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655098    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655100    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655103    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655106    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655109    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655112    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655115    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655118    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655121    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655126    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655129    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655132    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655134    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655137    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655139    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655142    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655144    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655147    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655149    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:44:04.661837 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655152    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655154    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655157    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655159    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655162    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655164    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655166    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655169    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:04.655171    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.655176    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.655284    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.657830    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.658706    2571 server.go:1019] "Starting client certificate rotation"
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.658816    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 16:44:04.662345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.658852    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 16:44:04.662705 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.661176    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 16:44:04.662705 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.662448    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 16:44:04.670312 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.670292    2571 log.go:25] "Validated CRI v1 runtime API"
Sep 17 16:44:04.671936 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.671920    2571 log.go:25] "Validated CRI v1 image API"
Sep 17 16:44:04.673273 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.673259    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 16:44:04.677329 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.677302    2571 fs.go:135] Filesystem UUIDs: map[3b90fe2d-a331-4135-8093-28a610d93b5f:/dev/nvme0n1p4 581fec6d-d153-40b2-b538-e6f1f1bf61f7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 17 16:44:04.677397 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.677328    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 16:44:04.682884 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.682773    2571 manager.go:216] Machine: {Timestamp:2026-09-17 16:44:04.682277849 +0000 UTC m=+1.981024578 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3075410 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a92409ba63809a1ba660c4971a082 SystemUUID:ec2a9240-9ba6-3809-a1ba-660c4971a082 BootID:f55b53d3-3a59-4bd1-8df3-9a6b9c9f0ff1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d5:9b:4a:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d5:9b:4a:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:c2:ed:01:76:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 16:44:04.682884 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.682879    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 16:44:04.682986 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.682954    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 16:44:04.685371 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.685318    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 16:44:04.685725 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.685554    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 16:44:04.686844 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.686831    2571 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 16:44:04.686883 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.686847    2571 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 16:44:04.686883 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.686856    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 16:44:04.686883 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.686868    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 16:44:04.686971 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.686944    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 16:44:04.690218 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.690200    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 16:44:04.690720 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.690708    2571 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 16:44:04.690842 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.690832    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 16:44:04.690873 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.690865    2571 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 16:44:04.690903 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.690875    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 16:44:04.690903 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.690886    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 16:44:04.690903 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.690896    2571 kubelet.go:398] "Adding apiserver pod source"
Sep 17 16:44:04.691005 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.690905    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 16:44:04.691242 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.691228    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 16:44:04.691279 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.691253    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 16:44:04.693254 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.693239    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 16:44:04.701840 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.701822    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 16:44:04.701896 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.701869    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 16:44:04.703115 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703103    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 16:44:04.703173 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703121    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 16:44:04.703173 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703129    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 16:44:04.703173 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703134    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 16:44:04.703173 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703143    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 16:44:04.703173 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703148    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 16:44:04.703173 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703162    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 16:44:04.703173 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703168    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 16:44:04.703173 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703174    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 16:44:04.703382 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703180    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 16:44:04.703382 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703189    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 16:44:04.703382 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703194    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 16:44:04.703382 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703221    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 16:44:04.703382 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.703226    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 16:44:04.706883 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.706859    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 16:44:04.706883 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.706871    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 16:44:04.707005 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.706906    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 16:44:04.707112 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.707099    2571 server.go:1268] "Started kubelet"
Sep 17 16:44:04.707192 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.707157    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 16:44:04.707535 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.707329    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 16:44:04.707688 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.707670    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 16:44:04.708139 ip-10-0-143-228 systemd[1]: Started Kubernetes Kubelet.
Sep 17 16:44:04.708875 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.708856    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 16:44:04.709594 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.709578    2571 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 16:44:04.711601 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.711585    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 16:44:04.714901 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.714882    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 16:44:04.714996 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.714901    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 16:44:04.715051 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.715013    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 17 16:44:04.715505 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.715484    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 16:44:04.715581 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.715510    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 16:44:04.715581 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.715492    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 16:44:04.715699 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.715653    2571 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 16:44:04.715699 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.715663    2571 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 16:44:04.715824 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.715808    2571 factory.go:55] Registering systemd factory
Sep 17 16:44:04.715824 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.715824    2571 factory.go:223] Registration of the systemd container factory successfully
Sep 17 16:44:04.716072 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.716059    2571 factory.go:153] Registering CRI-O factory
Sep 17 16:44:04.716152 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.716074    2571 factory.go:223] Registration of the crio container factory successfully
Sep 17 16:44:04.716152 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.716126    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 16:44:04.716152 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.716144    2571 factory.go:103] Registering Raw factory
Sep 17 16:44:04.716302 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.716159    2571 manager.go:1196] Started watching for new ooms in manager
Sep 17 16:44:04.716506 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.716493    2571 manager.go:349] Starting recovery of all containers
Sep 17 16:44:04.717770 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.717747    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 16:44:04.717863 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.717851    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 16:44:04.737652 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.737611    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c75fr"
Sep 17 16:44:04.737652 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.737652    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c75fr"
Sep 17 16:44:04.746256 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.746230    2571 manager.go:354] Recovery completed
Sep 17 16:44:04.750394 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.750376    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:44:04.752238 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.752207    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:44:04.752335 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.752258    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:44:04.752335 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.752272    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:44:04.752902 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.752889    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 16:44:04.752967 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.752901    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:44:04.752967 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.752903    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 16:44:04.752967 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.752939    2571 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 16:44:04.753553 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.753538    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:44:04.753611 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.753568    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:44:04.753611 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.753581    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:44:04.755047 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.755036    2571 policy_none.go:49] "None policy: Start"
Sep 17 16:44:04.755095 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.755052    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 16:44:04.755095 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.755069    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 16:44:04.757004 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.756993    2571 policy_none.go:47] "Start"
Sep 17 16:44:04.787286 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.787264    2571 manager.go:337] "Starting Device Plugin manager"
Sep 17 16:44:04.787392 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.787312    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 16:44:04.787392 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.787326    2571 server.go:87] "Starting device plugin registration server"
Sep 17 16:44:04.787605 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.787593    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 16:44:04.787682 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.787619    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 16:44:04.787841 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.787827    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 16:44:04.787913 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.787905    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 16:44:04.787965 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.787914    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 16:44:04.788442 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.788416    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 16:44:04.788526 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.788471    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 17 16:44:04.883614 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.883569    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 16:44:04.885624 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.884978    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 16:44:04.885624 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.885033    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 16:44:04.885624 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.885454    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 16:44:04.885624 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.885503    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 16:44:04.887424 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.887401    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:44:04.887868 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.887851    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:44:04.888674 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.888654    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:44:04.888767 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.888693    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:44:04.888767 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.888709    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:44:04.888767 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.888731    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-228.ec2.internal"
Sep 17 16:44:04.897532 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.897473    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-228.ec2.internal"
Sep 17 16:44:04.897532 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.897502    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-228.ec2.internal\": node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 17 16:44:04.917819 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:04.917784    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 17 16:44:04.986582 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.986538    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"]
Sep 17 16:44:04.986688 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.986647    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:44:04.988189 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.988165    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:44:04.988320 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.988203    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:44:04.988320 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.988217    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:44:04.990206 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.990190    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:44:04.990329 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.990313    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:04.990381 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.990345    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:44:04.991014 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.990997    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:44:04.991091 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.991032    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:44:04.991091 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.991045    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:44:04.991091 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.991048    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:44:04.991195 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.991069    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:44:04.991195 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.991120    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:44:04.993010 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.992994    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:04.993098 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.993019    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:44:04.993727 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.993710    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:44:04.993809 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.993737    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:44:04.993809 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:04.993747    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:44:05.016339 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.016308    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-228.ec2.internal\" not found" node="ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.017063 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.017046    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.017115 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.017076    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.017115 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.017094    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e70fcf4e6b756809a2612ebd8cc6497-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"9e70fcf4e6b756809a2612ebd8cc6497\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.018242 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.018227    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 17 16:44:05.020744 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.020729    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-228.ec2.internal\" not found" node="ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.117682 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.117652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.117682 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.117686    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.117881 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.117713    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e70fcf4e6b756809a2612ebd8cc6497-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"9e70fcf4e6b756809a2612ebd8cc6497\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.117881 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.117748    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.117881 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.117767    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.117881 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.117748    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e70fcf4e6b756809a2612ebd8cc6497-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"9e70fcf4e6b756809a2612ebd8cc6497\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.118673 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.118655    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 17 16:44:05.219522 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.219449    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 17 16:44:05.319928 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.319881    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 17 16:44:05.319928 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.319899    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.325339 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.325101    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.420280 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.420244    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 17 16:44:05.520810 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.520734    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 17 16:44:05.612374 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.612342    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:44:05.615281 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.615267    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.631613 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.631590    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 16:44:05.633449 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.633433    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 17 16:44:05.646326 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.646304    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 16:44:05.658449 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.658427    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 16:44:05.658560 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.658543    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 16:44:05.658612 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.658589    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 16:44:05.691796 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.691761    2571 apiserver.go:52] "Watching apiserver"
Sep 17 16:44:05.706836 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.706811    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:44:05.714076 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.714054    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 16:44:05.714421 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.714399    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal","kube-system/konnectivity-agent-jj6qr","kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd","openshift-dns/node-resolver-qrbkk","openshift-image-registry/node-ca-cm58d","openshift-multus/network-metrics-daemon-pbvnw","openshift-ovn-kubernetes/ovnkube-node-jtwdg","kube-system/global-pull-secret-syncer-klgkp","openshift-cluster-node-tuning-operator/tuned-7g7mq","openshift-monitoring/node-exporter-f55vr","openshift-multus/multus-2k258","openshift-network-diagnostics/network-check-target-5rsr7","openshift-multus/multus-additional-cni-plugins-2hnmt","openshift-network-operator/iptables-alerter-dpzks"]
Sep 17 16:44:05.715835 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.715820    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 16:44:05.716776 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.716763    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.718738 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.718716    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:05.719584 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.719569    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 16:44:05.719795 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.719780    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 16:44:05.719865 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.719805    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-chq5f\""
Sep 17 16:44:05.720704 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.720690    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-run\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.720774 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.720715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-lib-modules\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.720774 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.720730    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4fjq\" (UniqueName: \"kubernetes.io/projected/875335d5-a53b-482b-aef5-2fb2363bfa9d-kube-api-access-k4fjq\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.720774 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.720754    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-sysctl-d\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.720889 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.720775    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-sysctl-conf\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.720889 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.720797    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-sys\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.720889 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.720778    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.720889 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.720864    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-sysconfig\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.721078 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.720921    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-kubernetes\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.721078 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.720951    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-systemd\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.721078 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.720996    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-tuned\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.721078 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.721024    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/875335d5-a53b-482b-aef5-2fb2363bfa9d-tmp\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.721078 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.721071    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-modprobe-d\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.721303 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.721097    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-var-lib-kubelet\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.721303 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.721120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-host\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.721303 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.721198    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7mcfc\""
Sep 17 16:44:05.721303 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.721231    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 16:44:05.722774 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.722760    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 16:44:05.722852 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.722837    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qrbkk"
Sep 17 16:44:05.723002 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.722980    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fj9nw\""
Sep 17 16:44:05.724739 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.723941    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 16:44:05.724739 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.724306    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 16:44:05.724739 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.724473    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 16:44:05.724964 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.724948    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cm58d"
Sep 17 16:44:05.727022 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.727006    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:05.727101 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.727064    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:05.729126 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.729107    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.729470 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.729269    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k5rpc\""
Sep 17 16:44:05.729470 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.729300    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 16:44:05.729470 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.729274    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 16:44:05.729620 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.729497    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 16:44:05.729748 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.729729    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 16:44:05.729826 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.729780    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f4w97\""
Sep 17 16:44:05.730341 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.730324    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 16:44:05.731266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.731248    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:05.731353 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.731322    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:05.732985 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.732975    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 16:44:05.733510 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.733493    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.735658 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.735625    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.736328 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.736313    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 16:44:05.736436 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.736416    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 16:44:05.737068 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.737054    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 16:44:05.737891 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.737877    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:05.737973 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.737951    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:05.740154 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.740137    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.741165 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.741144    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 16:44:05.741250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.741206    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 16:44:05.741250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.741231    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 16:44:05.741355 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.741276    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 16:44:05.741749 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.741327    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 16:44:05.742223 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.741927    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 16:44:05.742223 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.742015    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kvkx2\""
Sep 17 16:44:05.742349 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.742295    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qtpqq\""
Sep 17 16:44:05.742573 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.742550    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 16:44:05.742804 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.742787    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 16:44:05.742853 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.742789    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpzks"
Sep 17 16:44:05.743792 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.743774    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 16:44:05.743874 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.743817    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 16:39:04 +0000 UTC" deadline="2028-05-15 14:05:18.390283766 +0000 UTC"
Sep 17 16:44:05.743874 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.743860    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14541h21m12.646427703s"
Sep 17 16:44:05.743999 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.743983    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 16:44:05.745277 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.745081    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 16:44:05.745277 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.745105    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qjwzk\""
Sep 17 16:44:05.745277 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.745108    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 16:44:05.745277 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.745133    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 16:44:05.745277 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.745169    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-48wqc\""
Sep 17 16:44:05.745277 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.745103    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 16:44:05.745934 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.745920    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 16:44:05.746160 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.746146    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v22nc\""
Sep 17 16:44:05.746363 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.746351    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 16:44:05.746870 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.746850    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 16:44:05.746870 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.746863    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 16:44:05.797116 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.797093    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9hw7f"
Sep 17 16:44:05.810399 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.810373    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9hw7f"
Sep 17 16:44:05.816386 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.816369    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 16:44:05.821885 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.821870    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-var-lib-openvswitch\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.821942 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.821892    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-log-socket\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.821942 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.821911    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/205bc652-451f-483f-8ef3-c736c1b8078e-ovn-node-metrics-cert\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.822006 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.821945    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlbh6\" (UniqueName: \"kubernetes.io/projected/26fae68a-5b43-4922-80b0-85e02d657dcb-kube-api-access-jlbh6\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.822006 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.821969    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-system-cni-dir\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.822006 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.821985    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-multus-cni-dir\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.822006 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.821998    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-dbus\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:05.822114 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrw77\" (UniqueName: \"kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77\") pod \"network-check-target-5rsr7\" (UID: \"761a0949-beec-4697-8f72-c03e252b6acb\") " pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:05.822114 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822029    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.822114 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-host\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.822114 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822084    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-multus-socket-dir-parent\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.822114 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822102    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-hostroot\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.822283 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822115    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-host\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.822283 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822116    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edd7139d-c5f9-4116-9874-81a64a742b90-cni-binary-copy\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.822283 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822148    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf952\" (UniqueName: \"kubernetes.io/projected/2c4df0ad-6bfa-4618-96e2-ccdfb53fc446-kube-api-access-sf952\") pod \"iptables-alerter-dpzks\" (UID: \"2c4df0ad-6bfa-4618-96e2-ccdfb53fc446\") " pod="openshift-network-operator/iptables-alerter-dpzks"
Sep 17 16:44:05.822283 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822168    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:05.822283 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822184    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-device-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.822283 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822197    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-sys-fs\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.822283 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822210    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-node-log\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.822283 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822239    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tq7v\" (UniqueName: \"kubernetes.io/projected/7740d182-6376-444a-815f-d023d12adb99-kube-api-access-8tq7v\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:05.822283 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822262    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d9f40078-4c30-4766-9964-c75481081c36-konnectivity-ca\") pod \"konnectivity-agent-jj6qr\" (UID: \"d9f40078-4c30-4766-9964-c75481081c36\") " pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:05.822283 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822280    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-run-openvswitch\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.822540 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-systemd\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.822540 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822307    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-sys\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.822540 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.822540 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822335    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c4df0ad-6bfa-4618-96e2-ccdfb53fc446-host-slash\") pod \"iptables-alerter-dpzks\" (UID: \"2c4df0ad-6bfa-4618-96e2-ccdfb53fc446\") " pod="openshift-network-operator/iptables-alerter-dpzks"
Sep 17 16:44:05.822540 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822348    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-systemd-units\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.822540 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822383    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-systemd\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.822540 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822412    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-run-ovn\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.822540 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822441    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-modprobe-d\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.822540 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822516    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-modprobe-d\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.822540 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/205bc652-451f-483f-8ef3-c736c1b8078e-env-overrides\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.822818 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-run\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.822818 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4fjq\" (UniqueName: \"kubernetes.io/projected/875335d5-a53b-482b-aef5-2fb2363bfa9d-kube-api-access-k4fjq\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.822818 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-wtmp\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.822818 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822608    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-run-k8s-cni-cncf-io\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.822818 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822621    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-run-multus-certs\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.822818 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822652    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-run-netns\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.822818 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822680    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-var-lib-kubelet\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.822818 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822724    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-run\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.822818 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822749    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/205bc652-451f-483f-8ef3-c736c1b8078e-ovnkube-config\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.822818 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822778    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-sysctl-d\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.822818 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822809    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-root\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822835    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822852    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmch8\" (UniqueName: \"kubernetes.io/projected/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-kube-api-access-vmch8\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822879    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92c8b0e9-8317-4b4f-afb0-7d9e4df469ea-serviceca\") pod \"node-ca-cm58d\" (UID: \"92c8b0e9-8317-4b4f-afb0-7d9e4df469ea\") " pod="openshift-image-registry/node-ca-cm58d"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822885    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-sysctl-d\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822909    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-registration-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-cni-netd\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822956    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c4df0ad-6bfa-4618-96e2-ccdfb53fc446-iptables-alerter-script\") pod \"iptables-alerter-dpzks\" (UID: \"2c4df0ad-6bfa-4618-96e2-ccdfb53fc446\") " pod="openshift-network-operator/iptables-alerter-dpzks"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822978    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-kubernetes\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.822998    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823019    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823039    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-kubernetes\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823062    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/205bc652-451f-483f-8ef3-c736c1b8078e-ovnkube-script-lib\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.823100 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx2g7\" (UniqueName: \"kubernetes.io/projected/205bc652-451f-483f-8ef3-c736c1b8078e-kube-api-access-lx2g7\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823099    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26fae68a-5b43-4922-80b0-85e02d657dcb-system-cni-dir\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-metrics-client-ca\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823144    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctvtw\" (UniqueName: \"kubernetes.io/projected/edd7139d-c5f9-4116-9874-81a64a742b90-kube-api-access-ctvtw\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-slash\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823179    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebfe5a84-b861-42d0-8872-a150201e5f06-tmp-dir\") pod \"node-resolver-qrbkk\" (UID: \"ebfe5a84-b861-42d0-8872-a150201e5f06\") " pod="openshift-dns/node-resolver-qrbkk"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823192    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-tls\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823206    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mnj4\" (UniqueName: \"kubernetes.io/projected/92c8b0e9-8317-4b4f-afb0-7d9e4df469ea-kube-api-access-2mnj4\") pod \"node-ca-cm58d\" (UID: \"92c8b0e9-8317-4b4f-afb0-7d9e4df469ea\") " pod="openshift-image-registry/node-ca-cm58d"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823219    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-socket-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-run-systemd\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-sysctl-conf\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823260    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-sys\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823273    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26fae68a-5b43-4922-80b0-85e02d657dcb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823302    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebfe5a84-b861-42d0-8872-a150201e5f06-hosts-file\") pod \"node-resolver-qrbkk\" (UID: \"ebfe5a84-b861-42d0-8872-a150201e5f06\") " pod="openshift-dns/node-resolver-qrbkk"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823317    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-sys\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823339    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-var-lib-cni-multus\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823364    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d9f40078-4c30-4766-9964-c75481081c36-agent-certs\") pod \"konnectivity-agent-jj6qr\" (UID: \"d9f40078-4c30-4766-9964-c75481081c36\") " pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:05.823484 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823371    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-sysctl-conf\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823381    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-sysconfig\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823400    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-tuned\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823407    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-sysconfig\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/875335d5-a53b-482b-aef5-2fb2363bfa9d-tmp\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823434    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26fae68a-5b43-4922-80b0-85e02d657dcb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823454    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-var-lib-cni-bin\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823468    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-cni-bin\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-var-lib-kubelet\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-textfile\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823555    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-kubelet-config\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823571    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-kubelet\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823591    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-run-netns\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823597    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-var-lib-kubelet\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-etc-openvswitch\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823697    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-lib-modules\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.824158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823714    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823732    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26fae68a-5b43-4922-80b0-85e02d657dcb-cnibin\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823760    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26fae68a-5b43-4922-80b0-85e02d657dcb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823779    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875335d5-a53b-482b-aef5-2fb2363bfa9d-lib-modules\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823823    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-cnibin\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823844    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-multus-conf-dir\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823864    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edd7139d-c5f9-4116-9874-81a64a742b90-multus-daemon-config\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823886    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92c8b0e9-8317-4b4f-afb0-7d9e4df469ea-host\") pod \"node-ca-cm58d\" (UID: \"92c8b0e9-8317-4b4f-afb0-7d9e4df469ea\") " pod="openshift-image-registry/node-ca-cm58d"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823924    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26fae68a-5b43-4922-80b0-85e02d657dcb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.823968    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f248r\" (UniqueName: \"kubernetes.io/projected/ebfe5a84-b861-42d0-8872-a150201e5f06-kube-api-access-f248r\") pod \"node-resolver-qrbkk\" (UID: \"ebfe5a84-b861-42d0-8872-a150201e5f06\") " pod="openshift-dns/node-resolver-qrbkk"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.824001    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-etc-kubernetes\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.824793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.824029    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5fbq\" (UniqueName: \"kubernetes.io/projected/ac611a20-2b8c-4759-90ef-30897c5a2c7f-kube-api-access-m5fbq\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.826822 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.826803    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/875335d5-a53b-482b-aef5-2fb2363bfa9d-etc-tuned\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.826902 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.826829    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/875335d5-a53b-482b-aef5-2fb2363bfa9d-tmp\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.827622 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.827604    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:44:05.834688 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.834669    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4fjq\" (UniqueName: \"kubernetes.io/projected/875335d5-a53b-482b-aef5-2fb2363bfa9d-kube-api-access-k4fjq\") pod \"tuned-7g7mq\" (UID: \"875335d5-a53b-482b-aef5-2fb2363bfa9d\") " pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:05.924853 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.924819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-sys\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.924853 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.924852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.924871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c4df0ad-6bfa-4618-96e2-ccdfb53fc446-host-slash\") pod \"iptables-alerter-dpzks\" (UID: \"2c4df0ad-6bfa-4618-96e2-ccdfb53fc446\") " pod="openshift-network-operator/iptables-alerter-dpzks"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.924904    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-systemd-units\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.924923    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c4df0ad-6bfa-4618-96e2-ccdfb53fc446-host-slash\") pod \"iptables-alerter-dpzks\" (UID: \"2c4df0ad-6bfa-4618-96e2-ccdfb53fc446\") " pod="openshift-network-operator/iptables-alerter-dpzks"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.924934    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-run-ovn\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.924963    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/205bc652-451f-483f-8ef3-c736c1b8078e-env-overrides\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.924970    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-run-ovn\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.924995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-wtmp\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925009    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-sys\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925019    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-run-k8s-cni-cncf-io\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-systemd-units\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925046    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-run-k8s-cni-cncf-io\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-run-multus-certs\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.925080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925086    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-run-netns\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-var-lib-kubelet\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925089    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-run-multus-certs\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/205bc652-451f-483f-8ef3-c736c1b8078e-ovnkube-config\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925173    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-wtmp\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925188    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-root\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925188    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-var-lib-kubelet\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925185    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-run-netns\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925225    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925253    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-root\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmch8\" (UniqueName: \"kubernetes.io/projected/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-kube-api-access-vmch8\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925398    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92c8b0e9-8317-4b4f-afb0-7d9e4df469ea-serviceca\") pod \"node-ca-cm58d\" (UID: \"92c8b0e9-8317-4b4f-afb0-7d9e4df469ea\") " pod="openshift-image-registry/node-ca-cm58d"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925418    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/205bc652-451f-483f-8ef3-c736c1b8078e-env-overrides\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925426    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-registration-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-cni-netd\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925477    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c4df0ad-6bfa-4618-96e2-ccdfb53fc446-iptables-alerter-script\") pod \"iptables-alerter-dpzks\" (UID: \"2c4df0ad-6bfa-4618-96e2-ccdfb53fc446\") " pod="openshift-network-operator/iptables-alerter-dpzks"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925500    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.925743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925523    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925525    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-registration-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925549    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/205bc652-451f-483f-8ef3-c736c1b8078e-ovnkube-script-lib\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925572    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-cni-netd\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925575    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx2g7\" (UniqueName: \"kubernetes.io/projected/205bc652-451f-483f-8ef3-c736c1b8078e-kube-api-access-lx2g7\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925619    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26fae68a-5b43-4922-80b0-85e02d657dcb-system-cni-dir\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925679    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-metrics-client-ca\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925702    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctvtw\" (UniqueName: \"kubernetes.io/projected/edd7139d-c5f9-4116-9874-81a64a742b90-kube-api-access-ctvtw\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925724    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-slash\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebfe5a84-b861-42d0-8872-a150201e5f06-tmp-dir\") pod \"node-resolver-qrbkk\" (UID: \"ebfe5a84-b861-42d0-8872-a150201e5f06\") " pod="openshift-dns/node-resolver-qrbkk"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925769    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-tls\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925783    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/205bc652-451f-483f-8ef3-c736c1b8078e-ovnkube-config\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925794    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnj4\" (UniqueName: \"kubernetes.io/projected/92c8b0e9-8317-4b4f-afb0-7d9e4df469ea-kube-api-access-2mnj4\") pod \"node-ca-cm58d\" (UID: \"92c8b0e9-8317-4b4f-afb0-7d9e4df469ea\") " pod="openshift-image-registry/node-ca-cm58d"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-socket-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925842    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-run-systemd\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925853    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26fae68a-5b43-4922-80b0-85e02d657dcb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.926485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebfe5a84-b861-42d0-8872-a150201e5f06-hosts-file\") pod \"node-resolver-qrbkk\" (UID: \"ebfe5a84-b861-42d0-8872-a150201e5f06\") " pod="openshift-dns/node-resolver-qrbkk"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-var-lib-cni-multus\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925964    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26fae68a-5b43-4922-80b0-85e02d657dcb-system-cni-dir\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.925976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d9f40078-4c30-4766-9964-c75481081c36-agent-certs\") pod \"konnectivity-agent-jj6qr\" (UID: \"d9f40078-4c30-4766-9964-c75481081c36\") " pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26fae68a-5b43-4922-80b0-85e02d657dcb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926026    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c4df0ad-6bfa-4618-96e2-ccdfb53fc446-iptables-alerter-script\") pod \"iptables-alerter-dpzks\" (UID: \"2c4df0ad-6bfa-4618-96e2-ccdfb53fc446\") " pod="openshift-network-operator/iptables-alerter-dpzks"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926031    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-var-lib-cni-bin\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-cni-bin\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926108    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926136    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-textfile\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926160    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-kubelet-config\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926164    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-socket-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926221    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-run-systemd\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926224    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-var-lib-cni-multus\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926224    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92c8b0e9-8317-4b4f-afb0-7d9e4df469ea-serviceca\") pod \"node-ca-cm58d\" (UID: \"92c8b0e9-8317-4b4f-afb0-7d9e4df469ea\") " pod="openshift-image-registry/node-ca-cm58d"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926261    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-kubelet-config\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926264    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-slash\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.927250 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926306    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926358    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-host-var-lib-cni-bin\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926381    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26fae68a-5b43-4922-80b0-85e02d657dcb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebfe5a84-b861-42d0-8872-a150201e5f06-hosts-file\") pod \"node-resolver-qrbkk\" (UID: \"ebfe5a84-b861-42d0-8872-a150201e5f06\") " pod="openshift-dns/node-resolver-qrbkk"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926473    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-cni-bin\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926503    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-metrics-client-ca\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926547    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-kubelet\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926572    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-run-netns\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926605    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-etc-openvswitch\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926608    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-run-netns\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26fae68a-5b43-4922-80b0-85e02d657dcb-cnibin\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926674    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-kubelet\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26fae68a-5b43-4922-80b0-85e02d657dcb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926702    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926717    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-etc-openvswitch\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926726    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-cnibin\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.928482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926733    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26fae68a-5b43-4922-80b0-85e02d657dcb-cnibin\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926750    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-multus-conf-dir\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926819    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-cnibin\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926892    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-textfile\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edd7139d-c5f9-4116-9874-81a64a742b90-multus-daemon-config\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926937    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26fae68a-5b43-4922-80b0-85e02d657dcb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926956    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-multus-conf-dir\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926966    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92c8b0e9-8317-4b4f-afb0-7d9e4df469ea-host\") pod \"node-ca-cm58d\" (UID: \"92c8b0e9-8317-4b4f-afb0-7d9e4df469ea\") " pod="openshift-image-registry/node-ca-cm58d"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926988    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26fae68a-5b43-4922-80b0-85e02d657dcb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f248r\" (UniqueName: \"kubernetes.io/projected/ebfe5a84-b861-42d0-8872-a150201e5f06-kube-api-access-f248r\") pod \"node-resolver-qrbkk\" (UID: \"ebfe5a84-b861-42d0-8872-a150201e5f06\") " pod="openshift-dns/node-resolver-qrbkk"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-etc-kubernetes\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.927052    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5fbq\" (UniqueName: \"kubernetes.io/projected/ac611a20-2b8c-4759-90ef-30897c5a2c7f-kube-api-access-m5fbq\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927077    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-var-lib-openvswitch\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-log-socket\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-log-socket\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.929452 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.927145    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs podName:7740d182-6376-444a-815f-d023d12adb99 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:06.427103687 +0000 UTC m=+3.725850407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs") pod "network-metrics-daemon-pbvnw" (UID: "7740d182-6376-444a-815f-d023d12adb99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927178    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92c8b0e9-8317-4b4f-afb0-7d9e4df469ea-host\") pod \"node-ca-cm58d\" (UID: \"92c8b0e9-8317-4b4f-afb0-7d9e4df469ea\") " pod="openshift-image-registry/node-ca-cm58d"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927260    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26fae68a-5b43-4922-80b0-85e02d657dcb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.926660    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebfe5a84-b861-42d0-8872-a150201e5f06-tmp-dir\") pod \"node-resolver-qrbkk\" (UID: \"ebfe5a84-b861-42d0-8872-a150201e5f06\") " pod="openshift-dns/node-resolver-qrbkk"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927328    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-etc-kubernetes\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927565    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/205bc652-451f-483f-8ef3-c736c1b8078e-ovnkube-script-lib\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927619    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-var-lib-openvswitch\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/205bc652-451f-483f-8ef3-c736c1b8078e-ovn-node-metrics-cert\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927744    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26fae68a-5b43-4922-80b0-85e02d657dcb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927753    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlbh6\" (UniqueName: \"kubernetes.io/projected/26fae68a-5b43-4922-80b0-85e02d657dcb-kube-api-access-jlbh6\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927789    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-system-cni-dir\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927815    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-multus-cni-dir\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927790    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edd7139d-c5f9-4116-9874-81a64a742b90-multus-daemon-config\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927842    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-system-cni-dir\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-dbus\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrw77\" (UniqueName: \"kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77\") pod \"network-check-target-5rsr7\" (UID: \"761a0949-beec-4697-8f72-c03e252b6acb\") " pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927951    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-multus-socket-dir-parent\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.930266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927972    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-hostroot\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927976    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-dbus\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928001    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edd7139d-c5f9-4116-9874-81a64a742b90-cni-binary-copy\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928026    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf952\" (UniqueName: \"kubernetes.io/projected/2c4df0ad-6bfa-4618-96e2-ccdfb53fc446-kube-api-access-sf952\") pod \"iptables-alerter-dpzks\" (UID: \"2c4df0ad-6bfa-4618-96e2-ccdfb53fc446\") " pod="openshift-network-operator/iptables-alerter-dpzks"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928028    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-multus-socket-dir-parent\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928049    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928083    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-device-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.927980    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-multus-cni-dir\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928109    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-sys-fs\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.928125    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-node-log\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-device-dir\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928162    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tq7v\" (UniqueName: \"kubernetes.io/projected/7740d182-6376-444a-815f-d023d12adb99-kube-api-access-8tq7v\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.928176    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret podName:cbf5729d-3ed3-4da0-b9b9-45a5d851a373 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:06.428159971 +0000 UTC m=+3.726906692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret") pod "global-pull-secret-syncer-klgkp" (UID: "cbf5729d-3ed3-4da0-b9b9-45a5d851a373") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928205    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d9f40078-4c30-4766-9964-c75481081c36-konnectivity-ca\") pod \"konnectivity-agent-jj6qr\" (UID: \"d9f40078-4c30-4766-9964-c75481081c36\") " pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928229    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-run-openvswitch\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.930806 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928303    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edd7139d-c5f9-4116-9874-81a64a742b90-hostroot\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.931263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928364    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac611a20-2b8c-4759-90ef-30897c5a2c7f-sys-fs\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.931263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928406    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-node-log\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.931263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928515    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/205bc652-451f-483f-8ef3-c736c1b8078e-run-openvswitch\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.931263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928625    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edd7139d-c5f9-4116-9874-81a64a742b90-cni-binary-copy\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.931263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928826    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d9f40078-4c30-4766-9964-c75481081c36-konnectivity-ca\") pod \"konnectivity-agent-jj6qr\" (UID: \"d9f40078-4c30-4766-9964-c75481081c36\") " pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:05.931263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.928856    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.931263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.929190    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d9f40078-4c30-4766-9964-c75481081c36-agent-certs\") pod \"konnectivity-agent-jj6qr\" (UID: \"d9f40078-4c30-4766-9964-c75481081c36\") " pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:05.931263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.930043    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/205bc652-451f-483f-8ef3-c736c1b8078e-ovn-node-metrics-cert\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.931263 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.930590    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-node-exporter-tls\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.948536 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.948509    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:44:05.948536 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.948538    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:44:05.948673 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.948549    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nrw77 for pod openshift-network-diagnostics/network-check-target-5rsr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:05.948673 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:05.948662    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77 podName:761a0949-beec-4697-8f72-c03e252b6acb nodeName:}" failed. No retries permitted until 2026-09-17 16:44:06.448649656 +0000 UTC m=+3.747396372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nrw77" (UniqueName: "kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77") pod "network-check-target-5rsr7" (UID: "761a0949-beec-4697-8f72-c03e252b6acb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:05.953140 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.953114    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmch8\" (UniqueName: \"kubernetes.io/projected/51156d1b-1753-4c4b-98d9-4d6c7f72d8ec-kube-api-access-vmch8\") pod \"node-exporter-f55vr\" (UID: \"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec\") " pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:05.953233 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.953182    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx2g7\" (UniqueName: \"kubernetes.io/projected/205bc652-451f-483f-8ef3-c736c1b8078e-kube-api-access-lx2g7\") pod \"ovnkube-node-jtwdg\" (UID: \"205bc652-451f-483f-8ef3-c736c1b8078e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:05.953233 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.953189    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf952\" (UniqueName: \"kubernetes.io/projected/2c4df0ad-6bfa-4618-96e2-ccdfb53fc446-kube-api-access-sf952\") pod \"iptables-alerter-dpzks\" (UID: \"2c4df0ad-6bfa-4618-96e2-ccdfb53fc446\") " pod="openshift-network-operator/iptables-alerter-dpzks"
Sep 17 16:44:05.953233 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.953182    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlbh6\" (UniqueName: \"kubernetes.io/projected/26fae68a-5b43-4922-80b0-85e02d657dcb-kube-api-access-jlbh6\") pod \"multus-additional-cni-plugins-2hnmt\" (UID: \"26fae68a-5b43-4922-80b0-85e02d657dcb\") " pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:05.955752 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.955726    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tq7v\" (UniqueName: \"kubernetes.io/projected/7740d182-6376-444a-815f-d023d12adb99-kube-api-access-8tq7v\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:05.956170 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.956140    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctvtw\" (UniqueName: \"kubernetes.io/projected/edd7139d-c5f9-4116-9874-81a64a742b90-kube-api-access-ctvtw\") pod \"multus-2k258\" (UID: \"edd7139d-c5f9-4116-9874-81a64a742b90\") " pod="openshift-multus/multus-2k258"
Sep 17 16:44:05.956356 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.956340    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mnj4\" (UniqueName: \"kubernetes.io/projected/92c8b0e9-8317-4b4f-afb0-7d9e4df469ea-kube-api-access-2mnj4\") pod \"node-ca-cm58d\" (UID: \"92c8b0e9-8317-4b4f-afb0-7d9e4df469ea\") " pod="openshift-image-registry/node-ca-cm58d"
Sep 17 16:44:05.956410 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.956344    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5fbq\" (UniqueName: \"kubernetes.io/projected/ac611a20-2b8c-4759-90ef-30897c5a2c7f-kube-api-access-m5fbq\") pod \"aws-ebs-csi-driver-node-fwchd\" (UID: \"ac611a20-2b8c-4759-90ef-30897c5a2c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:05.957129 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:05.957114    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f248r\" (UniqueName: \"kubernetes.io/projected/ebfe5a84-b861-42d0-8872-a150201e5f06-kube-api-access-f248r\") pod \"node-resolver-qrbkk\" (UID: \"ebfe5a84-b861-42d0-8872-a150201e5f06\") " pod="openshift-dns/node-resolver-qrbkk"
Sep 17 16:44:06.050496 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.050410    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7g7mq"
Sep 17 16:44:06.064520 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.064488    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:06.084502 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.084473    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd"
Sep 17 16:44:06.088382 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.088364    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qrbkk"
Sep 17 16:44:06.101225 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.101204    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cm58d"
Sep 17 16:44:06.114854 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.114832    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:06.133573 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.133552    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f55vr"
Sep 17 16:44:06.152045 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.152027    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2k258"
Sep 17 16:44:06.169982 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.169955    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2hnmt"
Sep 17 16:44:06.174852 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.174830    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpzks"
Sep 17 16:44:06.200457 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:06.200413    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd7139d_c5f9_4116_9874_81a64a742b90.slice/crio-7d0257207d9f431e7bd525a29be74cdc78d3bd9220a8a17f6a47ef33286ebbcd WatchSource:0}: Error finding container 7d0257207d9f431e7bd525a29be74cdc78d3bd9220a8a17f6a47ef33286ebbcd: Status 404 returned error can't find the container with id 7d0257207d9f431e7bd525a29be74cdc78d3bd9220a8a17f6a47ef33286ebbcd
Sep 17 16:44:06.201672 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:06.201625    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4df0ad_6bfa_4618_96e2_ccdfb53fc446.slice/crio-cd765050456b6f0b9ac97984ac8a40e23a7880581ae9d37ed775c623a9a1cc9a WatchSource:0}: Error finding container cd765050456b6f0b9ac97984ac8a40e23a7880581ae9d37ed775c623a9a1cc9a: Status 404 returned error can't find the container with id cd765050456b6f0b9ac97984ac8a40e23a7880581ae9d37ed775c623a9a1cc9a
Sep 17 16:44:06.202254 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:06.202214    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1aba493d65d32cf9925e6f47a0671c.slice/crio-4099536de0cacaada4735a05ad60ace734345157aecf1109a2bac3371bbbfdd2 WatchSource:0}: Error finding container 4099536de0cacaada4735a05ad60ace734345157aecf1109a2bac3371bbbfdd2: Status 404 returned error can't find the container with id 4099536de0cacaada4735a05ad60ace734345157aecf1109a2bac3371bbbfdd2
Sep 17 16:44:06.202984 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:06.202934    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e70fcf4e6b756809a2612ebd8cc6497.slice/crio-3115d2adaf00cca04efa55e2afb1c7f8680d65ed77f9d9204bb99240498d5f6d WatchSource:0}: Error finding container 3115d2adaf00cca04efa55e2afb1c7f8680d65ed77f9d9204bb99240498d5f6d: Status 404 returned error can't find the container with id 3115d2adaf00cca04efa55e2afb1c7f8680d65ed77f9d9204bb99240498d5f6d
Sep 17 16:44:06.203577 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:06.203560    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fae68a_5b43_4922_80b0_85e02d657dcb.slice/crio-503d2c811b8e48ee3ad408b65bc2a66d396311aa09b698733d1742e2ab66888f WatchSource:0}: Error finding container 503d2c811b8e48ee3ad408b65bc2a66d396311aa09b698733d1742e2ab66888f: Status 404 returned error can't find the container with id 503d2c811b8e48ee3ad408b65bc2a66d396311aa09b698733d1742e2ab66888f
Sep 17 16:44:06.205404 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.205383    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 16:44:06.437327 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.437225    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:06.437327 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.437302    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:06.437548 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:06.437381    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:06.437548 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:06.437396    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:06.437548 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:06.437450    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs podName:7740d182-6376-444a-815f-d023d12adb99 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:07.437434499 +0000 UTC m=+4.736181216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs") pod "network-metrics-daemon-pbvnw" (UID: "7740d182-6376-444a-815f-d023d12adb99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:06.437548 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:06.437469    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret podName:cbf5729d-3ed3-4da0-b9b9-45a5d851a373 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:07.437458159 +0000 UTC m=+4.736204875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret") pod "global-pull-secret-syncer-klgkp" (UID: "cbf5729d-3ed3-4da0-b9b9-45a5d851a373") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:06.483902 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:06.483877    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c8b0e9_8317_4b4f_afb0_7d9e4df469ea.slice/crio-105055c197913b7b215b4945956145c46bfffad5f86ab3f5bf9c518c79ac7076 WatchSource:0}: Error finding container 105055c197913b7b215b4945956145c46bfffad5f86ab3f5bf9c518c79ac7076: Status 404 returned error can't find the container with id 105055c197913b7b215b4945956145c46bfffad5f86ab3f5bf9c518c79ac7076
Sep 17 16:44:06.538745 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.538716    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrw77\" (UniqueName: \"kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77\") pod \"network-check-target-5rsr7\" (UID: \"761a0949-beec-4697-8f72-c03e252b6acb\") " pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:06.538927 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:06.538828    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:44:06.538927 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:06.538841    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:44:06.538927 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:06.538850    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nrw77 for pod openshift-network-diagnostics/network-check-target-5rsr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:06.538927 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:06.538898    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77 podName:761a0949-beec-4697-8f72-c03e252b6acb nodeName:}" failed. No retries permitted until 2026-09-17 16:44:07.538883507 +0000 UTC m=+4.837630243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrw77" (UniqueName: "kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77") pod "network-check-target-5rsr7" (UID: "761a0949-beec-4697-8f72-c03e252b6acb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:06.584418 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:06.584387    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f40078_4c30_4766_9964_c75481081c36.slice/crio-acd6dc56adef352670059af58c5c83d68f4d2a8ee69637fb0e43294091c90ea6 WatchSource:0}: Error finding container acd6dc56adef352670059af58c5c83d68f4d2a8ee69637fb0e43294091c90ea6: Status 404 returned error can't find the container with id acd6dc56adef352670059af58c5c83d68f4d2a8ee69637fb0e43294091c90ea6
Sep 17 16:44:06.604913 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:06.604885    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205bc652_451f_483f_8ef3_c736c1b8078e.slice/crio-8603a27148418f4051d847415a688ab808796be436a6ba39074640541f768bfe WatchSource:0}: Error finding container 8603a27148418f4051d847415a688ab808796be436a6ba39074640541f768bfe: Status 404 returned error can't find the container with id 8603a27148418f4051d847415a688ab808796be436a6ba39074640541f768bfe
Sep 17 16:44:06.644963 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:06.644932    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875335d5_a53b_482b_aef5_2fb2363bfa9d.slice/crio-4de1f46e9b89ee69e1c0b3ff1e7f7fa50d3e8f5656ed0d2c3afb0f9f93f8d19b WatchSource:0}: Error finding container 4de1f46e9b89ee69e1c0b3ff1e7f7fa50d3e8f5656ed0d2c3afb0f9f93f8d19b: Status 404 returned error can't find the container with id 4de1f46e9b89ee69e1c0b3ff1e7f7fa50d3e8f5656ed0d2c3afb0f9f93f8d19b
Sep 17 16:44:06.654189 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:06.654167    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac611a20_2b8c_4759_90ef_30897c5a2c7f.slice/crio-ffc8a74e4ddf3f0cfe324afb35d0d482c06fd9649f2ae1e6805f38ff7564f863 WatchSource:0}: Error finding container ffc8a74e4ddf3f0cfe324afb35d0d482c06fd9649f2ae1e6805f38ff7564f863: Status 404 returned error can't find the container with id ffc8a74e4ddf3f0cfe324afb35d0d482c06fd9649f2ae1e6805f38ff7564f863
Sep 17 16:44:06.681944 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:06.681920    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebfe5a84_b861_42d0_8872_a150201e5f06.slice/crio-6ec6746eae317d773d06602e4c57aff312f94890b1676599f2fb944365da0516 WatchSource:0}: Error finding container 6ec6746eae317d773d06602e4c57aff312f94890b1676599f2fb944365da0516: Status 404 returned error can't find the container with id 6ec6746eae317d773d06602e4c57aff312f94890b1676599f2fb944365da0516
Sep 17 16:44:06.813296 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.813164    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 16:39:05 +0000 UTC" deadline="2028-05-08 11:37:24.894532467 +0000 UTC"
Sep 17 16:44:06.813296 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.813254    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14370h53m18.081287507s"
Sep 17 16:44:06.824775 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.824745    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:44:06.895451 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.895387    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7g7mq" event={"ID":"875335d5-a53b-482b-aef5-2fb2363bfa9d","Type":"ContainerStarted","Data":"4de1f46e9b89ee69e1c0b3ff1e7f7fa50d3e8f5656ed0d2c3afb0f9f93f8d19b"}
Sep 17 16:44:06.897056 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.897023    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg" event={"ID":"205bc652-451f-483f-8ef3-c736c1b8078e","Type":"ContainerStarted","Data":"8603a27148418f4051d847415a688ab808796be436a6ba39074640541f768bfe"}
Sep 17 16:44:06.898645 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.898601    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpzks" event={"ID":"2c4df0ad-6bfa-4618-96e2-ccdfb53fc446","Type":"ContainerStarted","Data":"cd765050456b6f0b9ac97984ac8a40e23a7880581ae9d37ed775c623a9a1cc9a"}
Sep 17 16:44:06.899940 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.899921    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"7b1aba493d65d32cf9925e6f47a0671c","Type":"ContainerStarted","Data":"4099536de0cacaada4735a05ad60ace734345157aecf1109a2bac3371bbbfdd2"}
Sep 17 16:44:06.901120 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.901091    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" event={"ID":"9e70fcf4e6b756809a2612ebd8cc6497","Type":"ContainerStarted","Data":"3115d2adaf00cca04efa55e2afb1c7f8680d65ed77f9d9204bb99240498d5f6d"}
Sep 17 16:44:06.902820 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.902798    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2k258" event={"ID":"edd7139d-c5f9-4116-9874-81a64a742b90","Type":"ContainerStarted","Data":"7d0257207d9f431e7bd525a29be74cdc78d3bd9220a8a17f6a47ef33286ebbcd"}
Sep 17 16:44:06.904262 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.904234    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jj6qr" event={"ID":"d9f40078-4c30-4766-9964-c75481081c36","Type":"ContainerStarted","Data":"acd6dc56adef352670059af58c5c83d68f4d2a8ee69637fb0e43294091c90ea6"}
Sep 17 16:44:06.905902 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.905865    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cm58d" event={"ID":"92c8b0e9-8317-4b4f-afb0-7d9e4df469ea","Type":"ContainerStarted","Data":"105055c197913b7b215b4945956145c46bfffad5f86ab3f5bf9c518c79ac7076"}
Sep 17 16:44:06.907093 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.907067    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hnmt" event={"ID":"26fae68a-5b43-4922-80b0-85e02d657dcb","Type":"ContainerStarted","Data":"503d2c811b8e48ee3ad408b65bc2a66d396311aa09b698733d1742e2ab66888f"}
Sep 17 16:44:06.908677 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.908655    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qrbkk" event={"ID":"ebfe5a84-b861-42d0-8872-a150201e5f06","Type":"ContainerStarted","Data":"6ec6746eae317d773d06602e4c57aff312f94890b1676599f2fb944365da0516"}
Sep 17 16:44:06.910110 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:06.910085    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd" event={"ID":"ac611a20-2b8c-4759-90ef-30897c5a2c7f","Type":"ContainerStarted","Data":"ffc8a74e4ddf3f0cfe324afb35d0d482c06fd9649f2ae1e6805f38ff7564f863"}
Sep 17 16:44:07.298176 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:07.298138    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51156d1b_1753_4c4b_98d9_4d6c7f72d8ec.slice/crio-575162b21ce1a6bfb4bc8a6cca967e969aaa28758a0ae09365897e9b7491b3a2 WatchSource:0}: Error finding container 575162b21ce1a6bfb4bc8a6cca967e969aaa28758a0ae09365897e9b7491b3a2: Status 404 returned error can't find the container with id 575162b21ce1a6bfb4bc8a6cca967e969aaa28758a0ae09365897e9b7491b3a2
Sep 17 16:44:07.445462 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:07.445428    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:07.445651 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:07.445497    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:07.445745 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:07.445680    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:07.445745 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:07.445744    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret podName:cbf5729d-3ed3-4da0-b9b9-45a5d851a373 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:09.44572542 +0000 UTC m=+6.744472141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret") pod "global-pull-secret-syncer-klgkp" (UID: "cbf5729d-3ed3-4da0-b9b9-45a5d851a373") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:07.445857 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:07.445816    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:07.445857 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:07.445850    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs podName:7740d182-6376-444a-815f-d023d12adb99 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:09.445837648 +0000 UTC m=+6.744584370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs") pod "network-metrics-daemon-pbvnw" (UID: "7740d182-6376-444a-815f-d023d12adb99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:07.546910 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:07.546737    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrw77\" (UniqueName: \"kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77\") pod \"network-check-target-5rsr7\" (UID: \"761a0949-beec-4697-8f72-c03e252b6acb\") " pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:07.547080 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:07.546918    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:44:07.547080 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:07.546938    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:44:07.547080 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:07.546950    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nrw77 for pod openshift-network-diagnostics/network-check-target-5rsr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:07.547080 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:07.547033    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77 podName:761a0949-beec-4697-8f72-c03e252b6acb nodeName:}" failed. No retries permitted until 2026-09-17 16:44:09.546990664 +0000 UTC m=+6.845737381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrw77" (UniqueName: "kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77") pod "network-check-target-5rsr7" (UID: "761a0949-beec-4697-8f72-c03e252b6acb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:07.719037 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:07.718991    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:44:07.813550 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:07.813468    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 16:39:05 +0000 UTC" deadline="2028-04-19 12:05:00.669134034 +0000 UTC"
Sep 17 16:44:07.813550 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:07.813492    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13915h20m52.855644809s"
Sep 17 16:44:07.885893 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:07.885856    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:07.886091 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:07.885983    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:07.886423 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:07.886400    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:07.886552 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:07.886522    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:07.886671 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:07.886591    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:07.886726 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:07.886683    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:07.946008 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:07.945958    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f55vr" event={"ID":"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec","Type":"ContainerStarted","Data":"575162b21ce1a6bfb4bc8a6cca967e969aaa28758a0ae09365897e9b7491b3a2"}
Sep 17 16:44:09.463330 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:09.463053    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:09.463330 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:09.463128    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:09.463929 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:09.463355    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:09.463929 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:09.463479    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret podName:cbf5729d-3ed3-4da0-b9b9-45a5d851a373 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:13.46342548 +0000 UTC m=+10.762172245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret") pod "global-pull-secret-syncer-klgkp" (UID: "cbf5729d-3ed3-4da0-b9b9-45a5d851a373") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:09.463929 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:09.463567    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:09.463929 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:09.463601    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs podName:7740d182-6376-444a-815f-d023d12adb99 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:13.463590224 +0000 UTC m=+10.762336946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs") pod "network-metrics-daemon-pbvnw" (UID: "7740d182-6376-444a-815f-d023d12adb99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:09.569655 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:09.564212    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrw77\" (UniqueName: \"kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77\") pod \"network-check-target-5rsr7\" (UID: \"761a0949-beec-4697-8f72-c03e252b6acb\") " pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:09.573125 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:09.570203    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:44:09.573125 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:09.570239    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:44:09.573125 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:09.570262    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nrw77 for pod openshift-network-diagnostics/network-check-target-5rsr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:09.573125 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:09.570393    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77 podName:761a0949-beec-4697-8f72-c03e252b6acb nodeName:}" failed. No retries permitted until 2026-09-17 16:44:13.570360863 +0000 UTC m=+10.869107585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrw77" (UniqueName: "kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77") pod "network-check-target-5rsr7" (UID: "761a0949-beec-4697-8f72-c03e252b6acb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:09.886171 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:09.886093    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:09.886336 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:09.886214    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:09.886336 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:09.886106    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:09.886336 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:09.886240    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:09.886336 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:09.886286    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:09.886537 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:09.886339    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:11.886203 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:11.886168    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:11.886701 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:11.886297    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:11.886701 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:11.886431    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:11.886701 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:11.886513    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:11.886701 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:11.886565    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:11.886701 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:11.886665    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:13.499430 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:13.499373    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:13.499908 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:13.499467    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:13.499908 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:13.499624    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:13.499908 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:13.499709    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs podName:7740d182-6376-444a-815f-d023d12adb99 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:21.499693131 +0000 UTC m=+18.798439847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs") pod "network-metrics-daemon-pbvnw" (UID: "7740d182-6376-444a-815f-d023d12adb99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:13.500083 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:13.500004    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:13.500083 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:13.500039    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret podName:cbf5729d-3ed3-4da0-b9b9-45a5d851a373 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:21.500027013 +0000 UTC m=+18.798773729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret") pod "global-pull-secret-syncer-klgkp" (UID: "cbf5729d-3ed3-4da0-b9b9-45a5d851a373") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:13.600812 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:13.600772    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrw77\" (UniqueName: \"kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77\") pod \"network-check-target-5rsr7\" (UID: \"761a0949-beec-4697-8f72-c03e252b6acb\") " pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:13.601017 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:13.600994    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:44:13.601017 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:13.601017    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:44:13.601160 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:13.601030    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nrw77 for pod openshift-network-diagnostics/network-check-target-5rsr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:13.601160 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:13.601092    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77 podName:761a0949-beec-4697-8f72-c03e252b6acb nodeName:}" failed. No retries permitted until 2026-09-17 16:44:21.60107419 +0000 UTC m=+18.899820913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrw77" (UniqueName: "kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77") pod "network-check-target-5rsr7" (UID: "761a0949-beec-4697-8f72-c03e252b6acb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:13.886252 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:13.886168    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:13.886451 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:13.886424    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:13.886922 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:13.886903    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:13.887032 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:13.887008    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:13.887080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:13.887060    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:13.887146 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:13.887128    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:15.885858 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:15.885696    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:15.885858 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:15.885730    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:15.885858 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:15.885817    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:15.886419 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:15.885915    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:15.886419 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:15.885991    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:15.886419 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:15.886069    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:17.886590 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:17.886553    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:17.886590 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:17.886579    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:17.887159 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:17.886579    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:17.887159 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:17.886723    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:17.887159 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:17.886857    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:17.887159 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:17.886943    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:19.886276 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:19.885816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:19.886276 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:19.885853    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:19.886276 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:19.885923    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:19.886276 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:19.885939    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:19.886276 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:19.886013    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:19.886276 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:19.886092    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:21.564642 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:21.564582    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:21.565080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:21.564688    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:21.565080 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:21.564780    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:21.565080 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:21.564844    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:21.565080 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:21.564858    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs podName:7740d182-6376-444a-815f-d023d12adb99 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:37.5648409 +0000 UTC m=+34.863587620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs") pod "network-metrics-daemon-pbvnw" (UID: "7740d182-6376-444a-815f-d023d12adb99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:21.565080 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:21.564905    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret podName:cbf5729d-3ed3-4da0-b9b9-45a5d851a373 nodeName:}" failed. No retries permitted until 2026-09-17 16:44:37.564888588 +0000 UTC m=+34.863635320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret") pod "global-pull-secret-syncer-klgkp" (UID: "cbf5729d-3ed3-4da0-b9b9-45a5d851a373") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:21.665874 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:21.665837    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrw77\" (UniqueName: \"kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77\") pod \"network-check-target-5rsr7\" (UID: \"761a0949-beec-4697-8f72-c03e252b6acb\") " pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:21.666061 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:21.666035    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:44:21.666118 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:21.666067    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:44:21.666118 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:21.666082    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nrw77 for pod openshift-network-diagnostics/network-check-target-5rsr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:21.666190 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:21.666154    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77 podName:761a0949-beec-4697-8f72-c03e252b6acb nodeName:}" failed. No retries permitted until 2026-09-17 16:44:37.666134488 +0000 UTC m=+34.964881207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrw77" (UniqueName: "kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77") pod "network-check-target-5rsr7" (UID: "761a0949-beec-4697-8f72-c03e252b6acb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:21.886681 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:21.886648    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:21.886681 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:21.886675    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:21.886837 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:21.886685    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:21.886837 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:21.886799    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:21.886953 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:21.886934    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:21.887036 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:21.887014    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:23.886259 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:23.886224    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:23.886259 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:23.886267    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:23.886798 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:23.886233    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:23.886798 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:23.886371    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:23.886798 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:23.886461    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:23.886798 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:23.886538    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:25.885960 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:25.885796    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:25.886264 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:25.885869    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:25.886264 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:25.886027    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:25.886264 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:25.886114    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:25.886264 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:25.885867    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:25.886264 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:25.886182    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:25.993169 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:25.993134    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7g7mq" event={"ID":"875335d5-a53b-482b-aef5-2fb2363bfa9d","Type":"ContainerStarted","Data":"a72b7ec718ee14e4326867af1793c60bc899c30a99cd901504c7b9f0a4fcdc8c"}
Sep 17 16:44:26.002219 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:26.002194    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" event={"ID":"9e70fcf4e6b756809a2612ebd8cc6497","Type":"ContainerStarted","Data":"62f07269144eaab9bfe01f3ecd1ed6a69d91eec3ac3854aba1bff41cdd3bd503"}
Sep 17 16:44:26.003942 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:26.003921    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2k258" event={"ID":"edd7139d-c5f9-4116-9874-81a64a742b90","Type":"ContainerStarted","Data":"d44f8ad116a80c7688369ac05d436102ad2a0e9d02b6b16a8f9f29056a96d01d"}
Sep 17 16:44:26.007743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:26.007726    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f55vr" event={"ID":"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec","Type":"ContainerStarted","Data":"ebd9ea44f7e1404cc46f95b9620f45f4677ecb17fcd19b618b7eb3b9e64162fa"}
Sep 17 16:44:26.043933 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:26.043891    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7g7mq" podStartSLOduration=3.096288987 podStartE2EDuration="22.043877429s" totalImagesPullingTime="18.947588442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:26.01856249 +0000 UTC m=+23.317309240" watchObservedRunningTime="2026-09-17 16:44:26.043877429 +0000 UTC m=+23.342624166"
Sep 17 16:44:26.044099 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:26.044071    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2k258" podStartSLOduration=1.578335605 podStartE2EDuration="21.04406416s" totalImagesPullingTime="19.465728555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:26.044008544 +0000 UTC m=+23.342755264" watchObservedRunningTime="2026-09-17 16:44:26.04406416 +0000 UTC m=+23.342810898"
Sep 17 16:44:26.060816 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:26.060770    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" podStartSLOduration=21.060750344 podStartE2EDuration="21.060750344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:26.060734742 +0000 UTC m=+23.359481480" watchObservedRunningTime="2026-09-17 16:44:26.060750344 +0000 UTC m=+23.359497083"
Sep 17 16:44:27.014395 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.014196    2571 generic.go:356] "Generic (PLEG): container finished" podID="51156d1b-1753-4c4b-98d9-4d6c7f72d8ec" containerID="ebd9ea44f7e1404cc46f95b9620f45f4677ecb17fcd19b618b7eb3b9e64162fa" exitCode=0
Sep 17 16:44:27.015131 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.014249    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f55vr" event={"ID":"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec","Type":"ContainerDied","Data":"ebd9ea44f7e1404cc46f95b9620f45f4677ecb17fcd19b618b7eb3b9e64162fa"}
Sep 17 16:44:27.018552 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.018520    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 16:44:27.018954 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.018932    2571 generic.go:356] "Generic (PLEG): container finished" podID="205bc652-451f-483f-8ef3-c736c1b8078e" containerID="269a4d5df0155887e57602f59b0af61be541df79bc4ea9efa344d9e8188e4be9" exitCode=1
Sep 17 16:44:27.019043 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.018964    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg" event={"ID":"205bc652-451f-483f-8ef3-c736c1b8078e","Type":"ContainerStarted","Data":"bfbecbad5f56a3cb1c15faebd1caab87c23684b0e618c9c105b7f69d65af03fd"}
Sep 17 16:44:27.019129 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.019110    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg" event={"ID":"205bc652-451f-483f-8ef3-c736c1b8078e","Type":"ContainerStarted","Data":"26ff994d1055252dd38528b2f6223a70c8ec7d8192d3521a0106bf73a482bdd9"}
Sep 17 16:44:27.019186 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.019173    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg" event={"ID":"205bc652-451f-483f-8ef3-c736c1b8078e","Type":"ContainerStarted","Data":"82d74dcfea26237fcf91a910d563f03568999bbb543ee9608b8ab15f28576577"}
Sep 17 16:44:27.019269 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.019224    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg" event={"ID":"205bc652-451f-483f-8ef3-c736c1b8078e","Type":"ContainerStarted","Data":"b64a45b3cbe8f814feccbb84202860968288bca7deed407992f33bf83a4cb1b2"}
Sep 17 16:44:27.019325 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.019276    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg" event={"ID":"205bc652-451f-483f-8ef3-c736c1b8078e","Type":"ContainerDied","Data":"269a4d5df0155887e57602f59b0af61be541df79bc4ea9efa344d9e8188e4be9"}
Sep 17 16:44:27.019380 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.019339    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg" event={"ID":"205bc652-451f-483f-8ef3-c736c1b8078e","Type":"ContainerStarted","Data":"5859ac33ffc0d04c532c7f1d6ce46ebe6048191b04614170ce6b1ec45da45381"}
Sep 17 16:44:27.886343 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.886146    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:27.886552 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:27.886442    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:27.886552 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.886194    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:27.886552 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:27.886541    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:27.886552 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:27.886147    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:27.886726 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:27.886595    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:28.023865 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.023828    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f55vr" event={"ID":"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec","Type":"ContainerStarted","Data":"9d8176731ce8e056c83110e2aac55403e7d82086e8e06c7f033e250a7481e8ac"}
Sep 17 16:44:28.024444 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.023895    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f55vr" event={"ID":"51156d1b-1753-4c4b-98d9-4d6c7f72d8ec","Type":"ContainerStarted","Data":"46e528e71058a8644a59245103600708c3fd8d3ce17e858a55e08173d3885c4b"}
Sep 17 16:44:28.026363 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.026331    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qrbkk" event={"ID":"ebfe5a84-b861-42d0-8872-a150201e5f06","Type":"ContainerStarted","Data":"6a3e4a1b2895287e083893cca0a9bdafeddf41aaed1d0f980abd2da686a6c3ab"}
Sep 17 16:44:28.028252 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.028228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd" event={"ID":"ac611a20-2b8c-4759-90ef-30897c5a2c7f","Type":"ContainerStarted","Data":"2bfab49153da7c77afb9d9470bdf469304f14156cda07451013d8720ca836638"}
Sep 17 16:44:28.030072 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.030039    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpzks" event={"ID":"2c4df0ad-6bfa-4618-96e2-ccdfb53fc446","Type":"ContainerStarted","Data":"03e8759b276929cc994f06afb702f8dc520bbb998cb60f65a29459564a969813"}
Sep 17 16:44:28.031746 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.031723    2571 generic.go:356] "Generic (PLEG): container finished" podID="7b1aba493d65d32cf9925e6f47a0671c" containerID="d81f5bedc46be520bba89b3245e22eb2c4c8a76ba7c871e5a30e141f6665735d" exitCode=0
Sep 17 16:44:28.031890 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.031816    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"7b1aba493d65d32cf9925e6f47a0671c","Type":"ContainerDied","Data":"d81f5bedc46be520bba89b3245e22eb2c4c8a76ba7c871e5a30e141f6665735d"}
Sep 17 16:44:28.033491 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.033466    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jj6qr" event={"ID":"d9f40078-4c30-4766-9964-c75481081c36","Type":"ContainerStarted","Data":"4be37a7786257d63d62dc7da2984073cfec899aa9f8555c0f5c2ed118f099611"}
Sep 17 16:44:28.035405 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.035384    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cm58d" event={"ID":"92c8b0e9-8317-4b4f-afb0-7d9e4df469ea","Type":"ContainerStarted","Data":"d147447922ce1fce246bb2ab338dab02dab61201471a13f64976f1904d25a113"}
Sep 17 16:44:28.037239 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.037212    2571 generic.go:356] "Generic (PLEG): container finished" podID="26fae68a-5b43-4922-80b0-85e02d657dcb" containerID="54bd26f05820c53716a1d54b27a86a18ec3b445bc44c12e65713cc82b44725e5" exitCode=0
Sep 17 16:44:28.037333 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.037253    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hnmt" event={"ID":"26fae68a-5b43-4922-80b0-85e02d657dcb","Type":"ContainerDied","Data":"54bd26f05820c53716a1d54b27a86a18ec3b445bc44c12e65713cc82b44725e5"}
Sep 17 16:44:28.050073 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.050006    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f55vr" podStartSLOduration=4.277403873 podStartE2EDuration="23.049991419s" totalImagesPullingTime="18.367437159s" totalInitContainerRuntime="405.150387ms" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:28.049057323 +0000 UTC m=+25.347804061" watchObservedRunningTime="2026-09-17 16:44:28.049991419 +0000 UTC m=+25.348738156"
Sep 17 16:44:28.064789 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.064737    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qrbkk" podStartSLOduration=4.075748444 podStartE2EDuration="23.06472327s" totalImagesPullingTime="18.988974826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:28.064507597 +0000 UTC m=+25.363254335" watchObservedRunningTime="2026-09-17 16:44:28.06472327 +0000 UTC m=+25.363470009"
Sep 17 16:44:28.081187 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.081130    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cm58d" podStartSLOduration=3.97003091 podStartE2EDuration="23.081114749s" totalImagesPullingTime="19.111083839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:28.080731863 +0000 UTC m=+25.379478602" watchObservedRunningTime="2026-09-17 16:44:28.081114749 +0000 UTC m=+25.379861491"
Sep 17 16:44:28.138899 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.138812    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dpzks" podStartSLOduration=3.674309295 podStartE2EDuration="23.138791942s" totalImagesPullingTime="19.464482647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:28.121583084 +0000 UTC m=+25.420329831" watchObservedRunningTime="2026-09-17 16:44:28.138791942 +0000 UTC m=+25.437538679"
Sep 17 16:44:28.155695 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.155650    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jj6qr" podStartSLOduration=5.07207018 podStartE2EDuration="24.155609059s" totalImagesPullingTime="19.083538879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:28.155529447 +0000 UTC m=+25.454276186" watchObservedRunningTime="2026-09-17 16:44:28.155609059 +0000 UTC m=+25.454355941"
Sep 17 16:44:28.769553 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.769531    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 16:44:28.802228 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.802155    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T16:44:28.769547902Z","UUID":"095cc751-92bf-4264-9c2a-484c13e26fee","Handler":null,"Name":"","Endpoint":""}
Sep 17 16:44:28.803458 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.803441    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 16:44:28.803546 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:28.803472    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 16:44:29.040766 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:29.040733    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd" event={"ID":"ac611a20-2b8c-4759-90ef-30897c5a2c7f","Type":"ContainerStarted","Data":"e05b4f4ec75e6e55fef36214a9f9827afd87feb8c89961085bb1f682b3edb398"}
Sep 17 16:44:29.043614 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:29.043591    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 16:44:29.044015 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:29.043986    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg" event={"ID":"205bc652-451f-483f-8ef3-c736c1b8078e","Type":"ContainerStarted","Data":"4a19f88ea03a86cb5f150dc5836c949787f9bd5767b1e0dac10ee934a8bb9947"}
Sep 17 16:44:29.045788 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:29.045765    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"7b1aba493d65d32cf9925e6f47a0671c","Type":"ContainerStarted","Data":"d0e7316acd5ee99fc5e9d1507d1a4c7f31d7fabc940e9ac317fb15ac9191e23d"}
Sep 17 16:44:29.066759 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:29.066715    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" podStartSLOduration=24.066700372 podStartE2EDuration="24.066700372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:29.06631322 +0000 UTC m=+26.365059958" watchObservedRunningTime="2026-09-17 16:44:29.066700372 +0000 UTC m=+26.365447110"
Sep 17 16:44:29.886744 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:29.886558    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:29.886932 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:29.886567    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:29.886932 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:29.886831    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:29.886932 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:29.886625    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:29.886932 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:29.886904    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:29.887137 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:29.886978    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:30.051051 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:30.050961    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd" event={"ID":"ac611a20-2b8c-4759-90ef-30897c5a2c7f","Type":"ContainerStarted","Data":"cbad2dcc41913c014ff988af36397c3bc13a3b243521d6d83d7e7ed4e072f377"}
Sep 17 16:44:30.073734 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:30.073681    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwchd" podStartSLOduration=3.745087512 podStartE2EDuration="25.073662426s" totalImagesPullingTime="21.328574914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:30.073576189 +0000 UTC m=+27.372322952" watchObservedRunningTime="2026-09-17 16:44:30.073662426 +0000 UTC m=+27.372409163"
Sep 17 16:44:30.284489 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:30.284453    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:30.285344 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:30.285327    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:31.059643 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:31.059598    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 16:44:31.060527 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:31.060402    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg" event={"ID":"205bc652-451f-483f-8ef3-c736c1b8078e","Type":"ContainerStarted","Data":"c74cf3f2554117acfb3f9c5cba39b88f04d8bef406035974fac0cd8234f340bb"}
Sep 17 16:44:31.060963 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:31.060944    2571 scope.go:117] "RemoveContainer" containerID="269a4d5df0155887e57602f59b0af61be541df79bc4ea9efa344d9e8188e4be9"
Sep 17 16:44:31.061448 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:31.061195    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:31.061448 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:31.061322    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:31.061774 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:31.061501    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:31.082009 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:31.081981    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:31.083532 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:31.083510    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:44:31.886148 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:31.885972    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:31.886327 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:31.885977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:31.886327 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:31.886230    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:31.886432 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:31.886336    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:31.886432 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:31.885981    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:31.886522 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:31.886436    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:32.067833 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:32.067799    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 16:44:32.068264 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:32.068238    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg" event={"ID":"205bc652-451f-483f-8ef3-c736c1b8078e","Type":"ContainerStarted","Data":"c8c4a473532a9f06b87fcfa2eaf6cd971aa3dc4ac583b6a31a7ea5a07746df4f"}
Sep 17 16:44:32.107163 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:32.107114    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg" podStartSLOduration=7.8033405 podStartE2EDuration="27.107100067s" totalImagesPullingTime="19.303759567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:32.10707759 +0000 UTC m=+29.405824339" watchObservedRunningTime="2026-09-17 16:44:32.107100067 +0000 UTC m=+29.405846805"
Sep 17 16:44:32.875419 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:32.875387    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5rsr7"]
Sep 17 16:44:32.875592 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:32.875554    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:32.875709 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:32.875686    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:32.879172 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:32.879141    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klgkp"]
Sep 17 16:44:32.879304 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:32.879294    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:32.879427 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:32.879398    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:32.880833 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:32.880545    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pbvnw"]
Sep 17 16:44:32.880833 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:32.880682    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:32.880833 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:32.880780    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:34.074454 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:34.074419    2571 generic.go:356] "Generic (PLEG): container finished" podID="26fae68a-5b43-4922-80b0-85e02d657dcb" containerID="e0d10582d4065d832fb097711855e4da728feac5cb3ae21997ba113cc84f775c" exitCode=0
Sep 17 16:44:34.074454 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:34.074458    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hnmt" event={"ID":"26fae68a-5b43-4922-80b0-85e02d657dcb","Type":"ContainerDied","Data":"e0d10582d4065d832fb097711855e4da728feac5cb3ae21997ba113cc84f775c"}
Sep 17 16:44:34.889058 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:34.889021    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:34.889219 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:34.889125    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:34.889219 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:34.889137    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:34.889219 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:34.889153    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:34.889380 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:34.889228    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:34.889380 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:34.889287    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:35.767737 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:35.767558    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:35.768135 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:35.767851    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 17 16:44:35.768307 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:35.768289    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jj6qr"
Sep 17 16:44:36.080845 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:36.080812    2571 generic.go:356] "Generic (PLEG): container finished" podID="26fae68a-5b43-4922-80b0-85e02d657dcb" containerID="25da56707b888ede5394c724c654ecb6f5bbaba404a50e06fb04233ee551e599" exitCode=0
Sep 17 16:44:36.081041 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:36.080887    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hnmt" event={"ID":"26fae68a-5b43-4922-80b0-85e02d657dcb","Type":"ContainerDied","Data":"25da56707b888ede5394c724c654ecb6f5bbaba404a50e06fb04233ee551e599"}
Sep 17 16:44:36.889819 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:36.889790    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:36.890205 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:36.889831    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:36.890205 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:36.889835    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:36.890205 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:36.889915    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:36.890205 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:36.889978    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:36.890205 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:36.890070    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:37.085224 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:37.085193    2571 generic.go:356] "Generic (PLEG): container finished" podID="26fae68a-5b43-4922-80b0-85e02d657dcb" containerID="148a689b931b875611e53e8f942beb0e1eb34adaaf05571e3fcd37bf5cd2a0f7" exitCode=0
Sep 17 16:44:37.085487 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:37.085263    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hnmt" event={"ID":"26fae68a-5b43-4922-80b0-85e02d657dcb","Type":"ContainerDied","Data":"148a689b931b875611e53e8f942beb0e1eb34adaaf05571e3fcd37bf5cd2a0f7"}
Sep 17 16:44:37.585221 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:37.585186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:37.585435 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:37.585249    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:37.585435 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:37.585344    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:37.585435 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:37.585388    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:37.585435 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:37.585414    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs podName:7740d182-6376-444a-815f-d023d12adb99 nodeName:}" failed. No retries permitted until 2026-09-17 16:45:09.585393424 +0000 UTC m=+66.884140161 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs") pod "network-metrics-daemon-pbvnw" (UID: "7740d182-6376-444a-815f-d023d12adb99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:44:37.585435 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:37.585435    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret podName:cbf5729d-3ed3-4da0-b9b9-45a5d851a373 nodeName:}" failed. No retries permitted until 2026-09-17 16:45:09.585421351 +0000 UTC m=+66.884168083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret") pod "global-pull-secret-syncer-klgkp" (UID: "cbf5729d-3ed3-4da0-b9b9-45a5d851a373") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:44:37.685780 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:37.685748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrw77\" (UniqueName: \"kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77\") pod \"network-check-target-5rsr7\" (UID: \"761a0949-beec-4697-8f72-c03e252b6acb\") " pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:37.685928 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:37.685884    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:44:37.685928 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:37.685897    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:44:37.685928 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:37.685906    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nrw77 for pod openshift-network-diagnostics/network-check-target-5rsr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:37.686073 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:37.685953    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77 podName:761a0949-beec-4697-8f72-c03e252b6acb nodeName:}" failed. No retries permitted until 2026-09-17 16:45:09.68594096 +0000 UTC m=+66.984687680 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrw77" (UniqueName: "kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77") pod "network-check-target-5rsr7" (UID: "761a0949-beec-4697-8f72-c03e252b6acb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:44:38.886487 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:38.886453    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:38.887068 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:38.886498    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:38.887068 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:38.886453    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:38.887068 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:38.886656    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbvnw" podUID="7740d182-6376-444a-815f-d023d12adb99"
Sep 17 16:44:38.887068 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:38.886750    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klgkp" podUID="cbf5729d-3ed3-4da0-b9b9-45a5d851a373"
Sep 17 16:44:38.887068 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:44:38.886841    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rsr7" podUID="761a0949-beec-4697-8f72-c03e252b6acb"
Sep 17 16:44:39.108550 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.108515    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeReady"
Sep 17 16:44:39.108767 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.108700    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 16:44:39.164750 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.164648    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fvsld"]
Sep 17 16:44:39.168280 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.168261    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l2m4k"]
Sep 17 16:44:39.168465 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.168437    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvsld"
Sep 17 16:44:39.171039 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.171014    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rc4fv\""
Sep 17 16:44:39.171232 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.171219    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 16:44:39.171295 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.171235    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 16:44:39.171545 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.171510    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 16:44:39.172802 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.172453    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.176901 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.176874    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 16:44:39.179232 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.177101    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 16:44:39.179232 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.177345    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 16:44:39.179232 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.177517    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 16:44:39.179232 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.178870    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvsld"]
Sep 17 16:44:39.179232 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.179044    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jqstw\""
Sep 17 16:44:39.183824 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.183802    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l2m4k"]
Sep 17 16:44:39.259353 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.259317    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6qlrj"]
Sep 17 16:44:39.263686 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.263663    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.267124 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.267098    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 16:44:39.267124 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.267103    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 16:44:39.267914 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.267895    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdrbl\""
Sep 17 16:44:39.277228 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.277202    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6qlrj"]
Sep 17 16:44:39.298861 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.298827    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp5d7\" (UniqueName: \"kubernetes.io/projected/2566a007-9e99-4d74-ab9c-a11f95f45478-kube-api-access-vp5d7\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.299043 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.298885    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8def3d02-2c1e-442a-9eae-a5aab4c47610-cert\") pod \"ingress-canary-fvsld\" (UID: \"8def3d02-2c1e-442a-9eae-a5aab4c47610\") " pod="openshift-ingress-canary/ingress-canary-fvsld"
Sep 17 16:44:39.299043 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.298933    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2566a007-9e99-4d74-ab9c-a11f95f45478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.299043 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.298961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2566a007-9e99-4d74-ab9c-a11f95f45478-crio-socket\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.299043 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.298988    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkwd5\" (UniqueName: \"kubernetes.io/projected/8def3d02-2c1e-442a-9eae-a5aab4c47610-kube-api-access-lkwd5\") pod \"ingress-canary-fvsld\" (UID: \"8def3d02-2c1e-442a-9eae-a5aab4c47610\") " pod="openshift-ingress-canary/ingress-canary-fvsld"
Sep 17 16:44:39.299245 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.299125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2566a007-9e99-4d74-ab9c-a11f95f45478-data-volume\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.299245 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.299184    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2566a007-9e99-4d74-ab9c-a11f95f45478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.400129 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400088    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2566a007-9e99-4d74-ab9c-a11f95f45478-crio-socket\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.400129 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59248255-9996-415e-893a-5c55f072a164-metrics-tls\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.400390 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400146    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkwd5\" (UniqueName: \"kubernetes.io/projected/8def3d02-2c1e-442a-9eae-a5aab4c47610-kube-api-access-lkwd5\") pod \"ingress-canary-fvsld\" (UID: \"8def3d02-2c1e-442a-9eae-a5aab4c47610\") " pod="openshift-ingress-canary/ingress-canary-fvsld"
Sep 17 16:44:39.400390 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400182    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2566a007-9e99-4d74-ab9c-a11f95f45478-data-volume\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.400390 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400203    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59248255-9996-415e-893a-5c55f072a164-tmp-dir\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.400390 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400222    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2566a007-9e99-4d74-ab9c-a11f95f45478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.400390 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400338    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2566a007-9e99-4d74-ab9c-a11f95f45478-crio-socket\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.400661 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400381    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rktdd\" (UniqueName: \"kubernetes.io/projected/59248255-9996-415e-893a-5c55f072a164-kube-api-access-rktdd\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.400661 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400477    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp5d7\" (UniqueName: \"kubernetes.io/projected/2566a007-9e99-4d74-ab9c-a11f95f45478-kube-api-access-vp5d7\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.400661 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400524    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8def3d02-2c1e-442a-9eae-a5aab4c47610-cert\") pod \"ingress-canary-fvsld\" (UID: \"8def3d02-2c1e-442a-9eae-a5aab4c47610\") " pod="openshift-ingress-canary/ingress-canary-fvsld"
Sep 17 16:44:39.400661 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400556    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59248255-9996-415e-893a-5c55f072a164-config-volume\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.400661 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400605    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2566a007-9e99-4d74-ab9c-a11f95f45478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.400661 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400612    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2566a007-9e99-4d74-ab9c-a11f95f45478-data-volume\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.400955 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.400835    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2566a007-9e99-4d74-ab9c-a11f95f45478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.404750 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.404724    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2566a007-9e99-4d74-ab9c-a11f95f45478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.404750 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.404739    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8def3d02-2c1e-442a-9eae-a5aab4c47610-cert\") pod \"ingress-canary-fvsld\" (UID: \"8def3d02-2c1e-442a-9eae-a5aab4c47610\") " pod="openshift-ingress-canary/ingress-canary-fvsld"
Sep 17 16:44:39.411216 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.411196    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkwd5\" (UniqueName: \"kubernetes.io/projected/8def3d02-2c1e-442a-9eae-a5aab4c47610-kube-api-access-lkwd5\") pod \"ingress-canary-fvsld\" (UID: \"8def3d02-2c1e-442a-9eae-a5aab4c47610\") " pod="openshift-ingress-canary/ingress-canary-fvsld"
Sep 17 16:44:39.411805 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.411781    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp5d7\" (UniqueName: \"kubernetes.io/projected/2566a007-9e99-4d74-ab9c-a11f95f45478-kube-api-access-vp5d7\") pod \"insights-runtime-extractor-l2m4k\" (UID: \"2566a007-9e99-4d74-ab9c-a11f95f45478\") " pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.483873 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.483833    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvsld"
Sep 17 16:44:39.490377 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.490351    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l2m4k"
Sep 17 16:44:39.501471 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.501430    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59248255-9996-415e-893a-5c55f072a164-tmp-dir\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.501588 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.501496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rktdd\" (UniqueName: \"kubernetes.io/projected/59248255-9996-415e-893a-5c55f072a164-kube-api-access-rktdd\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.501588 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.501566    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59248255-9996-415e-893a-5c55f072a164-config-volume\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.501718 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.501603    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59248255-9996-415e-893a-5c55f072a164-metrics-tls\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.502608 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.502529    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59248255-9996-415e-893a-5c55f072a164-tmp-dir\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.502857 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.502830    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59248255-9996-415e-893a-5c55f072a164-config-volume\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.504245 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.504223    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59248255-9996-415e-893a-5c55f072a164-metrics-tls\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.511529 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.511504    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rktdd\" (UniqueName: \"kubernetes.io/projected/59248255-9996-415e-893a-5c55f072a164-kube-api-access-rktdd\") pod \"dns-default-6qlrj\" (UID: \"59248255-9996-415e-893a-5c55f072a164\") " pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.575054 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.575007    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:39.781911 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.781612    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l2m4k"]
Sep 17 16:44:39.784621 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.784593    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvsld"]
Sep 17 16:44:39.786057 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:39.786026    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2566a007_9e99_4d74_ab9c_a11f95f45478.slice/crio-ea3f66383c7f6d4c2af9782aed8d7c690be0df25e990a298791d0a87613a13b5 WatchSource:0}: Error finding container ea3f66383c7f6d4c2af9782aed8d7c690be0df25e990a298791d0a87613a13b5: Status 404 returned error can't find the container with id ea3f66383c7f6d4c2af9782aed8d7c690be0df25e990a298791d0a87613a13b5
Sep 17 16:44:39.787422 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:39.787386    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8def3d02_2c1e_442a_9eae_a5aab4c47610.slice/crio-43832a6cacfaa32b57a640f63cf4978d5cab49cc7638fb2654c8878a75919a6b WatchSource:0}: Error finding container 43832a6cacfaa32b57a640f63cf4978d5cab49cc7638fb2654c8878a75919a6b: Status 404 returned error can't find the container with id 43832a6cacfaa32b57a640f63cf4978d5cab49cc7638fb2654c8878a75919a6b
Sep 17 16:44:39.854219 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:39.854194    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6qlrj"]
Sep 17 16:44:39.859482 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:44:39.859452    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59248255_9996_415e_893a_5c55f072a164.slice/crio-b80eced6612a488e24a5218d5af77f9b4042cac606df86776c02a69971bbff10 WatchSource:0}: Error finding container b80eced6612a488e24a5218d5af77f9b4042cac606df86776c02a69971bbff10: Status 404 returned error can't find the container with id b80eced6612a488e24a5218d5af77f9b4042cac606df86776c02a69971bbff10
Sep 17 16:44:40.094982 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.094865    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qlrj" event={"ID":"59248255-9996-415e-893a-5c55f072a164","Type":"ContainerStarted","Data":"b80eced6612a488e24a5218d5af77f9b4042cac606df86776c02a69971bbff10"}
Sep 17 16:44:40.096645 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.096605    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l2m4k" event={"ID":"2566a007-9e99-4d74-ab9c-a11f95f45478","Type":"ContainerStarted","Data":"b2799cc9f005a035b0002024dbbc0ef1e765317b1bd0ecdd73281639090874c3"}
Sep 17 16:44:40.096771 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.096686    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l2m4k" event={"ID":"2566a007-9e99-4d74-ab9c-a11f95f45478","Type":"ContainerStarted","Data":"ea3f66383c7f6d4c2af9782aed8d7c690be0df25e990a298791d0a87613a13b5"}
Sep 17 16:44:40.097871 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.097846    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvsld" event={"ID":"8def3d02-2c1e-442a-9eae-a5aab4c47610","Type":"ContainerStarted","Data":"43832a6cacfaa32b57a640f63cf4978d5cab49cc7638fb2654c8878a75919a6b"}
Sep 17 16:44:40.886405 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.886365    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:44:40.886758 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.886365    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:44:40.887078 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.886365    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:44:40.890829 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.890805    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 16:44:40.890829 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.890817    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 16:44:40.891033 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.890936    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 16:44:40.891033 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.890988    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfgr8\""
Sep 17 16:44:40.891176 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.891162    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n5btm\""
Sep 17 16:44:40.891219 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:40.891182    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 16:44:43.108538 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:43.108448    2571 generic.go:356] "Generic (PLEG): container finished" podID="26fae68a-5b43-4922-80b0-85e02d657dcb" containerID="63289ec0bbbad39dbf066fe07e7b2b7274def6516454b6d93c3f93aaea27568d" exitCode=0
Sep 17 16:44:43.109063 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:43.108537    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hnmt" event={"ID":"26fae68a-5b43-4922-80b0-85e02d657dcb","Type":"ContainerDied","Data":"63289ec0bbbad39dbf066fe07e7b2b7274def6516454b6d93c3f93aaea27568d"}
Sep 17 16:44:43.110908 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:43.110881    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l2m4k" event={"ID":"2566a007-9e99-4d74-ab9c-a11f95f45478","Type":"ContainerStarted","Data":"7efd0452e2b6f1712a38d24cd51eca7d049e137834e6fcbe3e3e189e9ff4c277"}
Sep 17 16:44:44.120069 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:44.119883    2571 generic.go:356] "Generic (PLEG): container finished" podID="26fae68a-5b43-4922-80b0-85e02d657dcb" containerID="54b6e60732f4176533a2b2c91f397f1fbd426057d1b947c4f053d41a1c90be90" exitCode=0
Sep 17 16:44:44.120069 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:44.119974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hnmt" event={"ID":"26fae68a-5b43-4922-80b0-85e02d657dcb","Type":"ContainerDied","Data":"54b6e60732f4176533a2b2c91f397f1fbd426057d1b947c4f053d41a1c90be90"}
Sep 17 16:44:46.128934 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:46.128896    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qlrj" event={"ID":"59248255-9996-415e-893a-5c55f072a164","Type":"ContainerStarted","Data":"02340e51be37943cb83ad868439ff8ea37152623a5f2570acc4d4ed5bc706b6a"}
Sep 17 16:44:46.129363 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:46.128977    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qlrj" event={"ID":"59248255-9996-415e-893a-5c55f072a164","Type":"ContainerStarted","Data":"c00dd5d7dbbce0b1a430a8b82a3fbf74bf8dacb1db97d36dc30813edfd5cbca8"}
Sep 17 16:44:46.129363 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:46.129016    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:44:46.131238 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:46.131211    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l2m4k" event={"ID":"2566a007-9e99-4d74-ab9c-a11f95f45478","Type":"ContainerStarted","Data":"6c09758333ff6b01636541231e90fa374ec57e6a82d5dbcee00291344fdbc2e0"}
Sep 17 16:44:46.132759 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:46.132721    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvsld" event={"ID":"8def3d02-2c1e-442a-9eae-a5aab4c47610","Type":"ContainerStarted","Data":"7a1bf4bf5970b7c132055c8325e4cd6f250f67ccdb35e3dbee76e7882e81c6a8"}
Sep 17 16:44:46.136058 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:46.136035    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hnmt" event={"ID":"26fae68a-5b43-4922-80b0-85e02d657dcb","Type":"ContainerStarted","Data":"9015462aca3e2ccfdb90e3ad178fd0b4871019d6e86d662e90153ffc61d7628d"}
Sep 17 16:44:46.147508 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:46.147453    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6qlrj" podStartSLOduration=1.625834844 podStartE2EDuration="7.147438321s" totalImagesPullingTime="5.521603477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:44:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:46.147135249 +0000 UTC m=+43.445881987" watchObservedRunningTime="2026-09-17 16:44:46.147438321 +0000 UTC m=+43.446185057"
Sep 17 16:44:46.165083 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:46.165025    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fvsld" podStartSLOduration=1.5640849829999999 podStartE2EDuration="7.165007322s" totalImagesPullingTime="5.600922339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:44:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:46.164654073 +0000 UTC m=+43.463400811" watchObservedRunningTime="2026-09-17 16:44:46.165007322 +0000 UTC m=+43.463754064"
Sep 17 16:44:46.188500 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:46.188443    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2hnmt" podStartSLOduration=8.965865399 podStartE2EDuration="41.188422582s" totalImagesPullingTime="32.222557183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:46.186563373 +0000 UTC m=+43.485310110" watchObservedRunningTime="2026-09-17 16:44:46.188422582 +0000 UTC m=+43.487169322"
Sep 17 16:44:46.205471 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:46.205410    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l2m4k" podStartSLOduration=1.522844509 podStartE2EDuration="7.20539635s" totalImagesPullingTime="5.682551841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:46.204296275 +0000 UTC m=+43.503043013" watchObservedRunningTime="2026-09-17 16:44:46.20539635 +0000 UTC m=+43.504143133"
Sep 17 16:44:56.141411 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:44:56.141380    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6qlrj"
Sep 17 16:45:03.081319 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:03.081285    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtwdg"
Sep 17 16:45:09.635890 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.635833    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:45:09.635890 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.635891    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:45:09.640836 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.640813    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 16:45:09.640961 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.640910    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 16:45:09.650160 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.650129    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7740d182-6376-444a-815f-d023d12adb99-metrics-certs\") pod \"network-metrics-daemon-pbvnw\" (UID: \"7740d182-6376-444a-815f-d023d12adb99\") " pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:45:09.650281 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.650202    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbf5729d-3ed3-4da0-b9b9-45a5d851a373-original-pull-secret\") pod \"global-pull-secret-syncer-klgkp\" (UID: \"cbf5729d-3ed3-4da0-b9b9-45a5d851a373\") " pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:45:09.705732 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.705696    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klgkp"
Sep 17 16:45:09.713341 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.713306    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n5btm\""
Sep 17 16:45:09.721033 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.721006    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbvnw"
Sep 17 16:45:09.736644 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.736590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrw77\" (UniqueName: \"kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77\") pod \"network-check-target-5rsr7\" (UID: \"761a0949-beec-4697-8f72-c03e252b6acb\") " pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:45:09.740022 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.739998    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 16:45:09.750694 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.750668    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 16:45:09.762814 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.762782    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrw77\" (UniqueName: \"kubernetes.io/projected/761a0949-beec-4697-8f72-c03e252b6acb-kube-api-access-nrw77\") pod \"network-check-target-5rsr7\" (UID: \"761a0949-beec-4697-8f72-c03e252b6acb\") " pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:45:09.998179 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:09.996244    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klgkp"]
Sep 17 16:45:10.002613 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:10.002585    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfgr8\""
Sep 17 16:45:10.008814 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:10.008793    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:45:10.027552 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:10.027477    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pbvnw"]
Sep 17 16:45:10.031091 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:45:10.031059    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7740d182_6376_444a_815f_d023d12adb99.slice/crio-238b70eff95fc73a0aba537bf4de9b334c95bfc8a5d74c899bd49328a2716ccf WatchSource:0}: Error finding container 238b70eff95fc73a0aba537bf4de9b334c95bfc8a5d74c899bd49328a2716ccf: Status 404 returned error can't find the container with id 238b70eff95fc73a0aba537bf4de9b334c95bfc8a5d74c899bd49328a2716ccf
Sep 17 16:45:10.212051 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:10.212011    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klgkp" event={"ID":"cbf5729d-3ed3-4da0-b9b9-45a5d851a373","Type":"ContainerStarted","Data":"d0f750eafebc6fef68c4fcb5e1fdf958980fb38cf72a6d3af0fdf17a5ecafcb1"}
Sep 17 16:45:10.213271 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:10.213236    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pbvnw" event={"ID":"7740d182-6376-444a-815f-d023d12adb99","Type":"ContainerStarted","Data":"238b70eff95fc73a0aba537bf4de9b334c95bfc8a5d74c899bd49328a2716ccf"}
Sep 17 16:45:10.280480 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:10.280386    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5rsr7"]
Sep 17 16:45:10.284503 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:45:10.284474    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761a0949_beec_4697_8f72_c03e252b6acb.slice/crio-6cedb6112f272a33bae4577e0a76c6251915d815bae21083611d5c4d0303d8f7 WatchSource:0}: Error finding container 6cedb6112f272a33bae4577e0a76c6251915d815bae21083611d5c4d0303d8f7: Status 404 returned error can't find the container with id 6cedb6112f272a33bae4577e0a76c6251915d815bae21083611d5c4d0303d8f7
Sep 17 16:45:11.220801 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.220752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5rsr7" event={"ID":"761a0949-beec-4697-8f72-c03e252b6acb","Type":"ContainerStarted","Data":"6cedb6112f272a33bae4577e0a76c6251915d815bae21083611d5c4d0303d8f7"}
Sep 17 16:45:11.603540 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.603511    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 16:45:11.608765 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.608738    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.612031 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.612007    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 16:45:11.612149 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.612052    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xz84k\""
Sep 17 16:45:11.612268 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.612249    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 16:45:11.612405 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.612352    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 16:45:11.612880 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.612771    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 16:45:11.612880 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.612780    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 16:45:11.612880 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.612786    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 16:45:11.612880 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.612792    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 16:45:11.613089 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.612933    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 16:45:11.621779 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.621758    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 16:45:11.628757 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.626937    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 16:45:11.751316 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751223    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751316 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751259    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751316 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751290    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751592 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751320    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751592 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-web-config\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751592 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751592 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751467    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751592 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751528    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-config-volume\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751592 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751572    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-config-out\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751882 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvcdd\" (UniqueName: \"kubernetes.io/projected/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-kube-api-access-bvcdd\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751882 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751686    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751882 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751732    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.751882 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.751761    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853042 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.852762    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvcdd\" (UniqueName: \"kubernetes.io/projected/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-kube-api-access-bvcdd\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853042 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.852975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853042 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.853007    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853042 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.853037    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853356 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.853089    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853356 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.853122    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853356 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.853145    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853356 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.853178    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853356 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.853210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-web-config\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853356 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.853235    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853356 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.853261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853356 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.853286    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-config-volume\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.853356 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.853312    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-config-out\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.854454 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.854421    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.855729 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.855699    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.858615 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.857657    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-config-out\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.858615 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.858222    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.858615 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.858571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.859151 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.858843    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.859151 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.859079    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.859151 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.859120    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.859330 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.859260    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-web-config\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.859866 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.859841    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.861411 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.861367    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.862234 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.862213    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-config-volume\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.863103 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.863062    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvcdd\" (UniqueName: \"kubernetes.io/projected/72014ec0-2fca-413c-b7d1-5c2e61b87ea3-kube-api-access-bvcdd\") pod \"alertmanager-main-0\" (UID: \"72014ec0-2fca-413c-b7d1-5c2e61b87ea3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:11.920042 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:11.920008    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 16:45:12.219493 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:12.219465    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 16:45:12.221702 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:45:12.221673    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72014ec0_2fca_413c_b7d1_5c2e61b87ea3.slice/crio-47ea67ece7cf8dd7e7d5daa8426d4e84fe68117befc331cfd546107bf6db92a6 WatchSource:0}: Error finding container 47ea67ece7cf8dd7e7d5daa8426d4e84fe68117befc331cfd546107bf6db92a6: Status 404 returned error can't find the container with id 47ea67ece7cf8dd7e7d5daa8426d4e84fe68117befc331cfd546107bf6db92a6
Sep 17 16:45:12.228077 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:12.228047    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pbvnw" event={"ID":"7740d182-6376-444a-815f-d023d12adb99","Type":"ContainerStarted","Data":"d316a9359a18bf92e3582c515f5f36f4e0870b16c4a8cd6edafd15b6450e88f2"}
Sep 17 16:45:12.228187 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:12.228107    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pbvnw" event={"ID":"7740d182-6376-444a-815f-d023d12adb99","Type":"ContainerStarted","Data":"53821489cadee2fd2f3759493d458722b644307f9d7a6fad344f3416e7c705f8"}
Sep 17 16:45:12.245499 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:12.245422    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pbvnw" podStartSLOduration=65.912714962 podStartE2EDuration="1m7.245398859s" totalImagesPullingTime="1.332683897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:45:12.244190016 +0000 UTC m=+69.542936754" watchObservedRunningTime="2026-09-17 16:45:12.245398859 +0000 UTC m=+69.544145612"
Sep 17 16:45:13.234376 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:13.234334    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72014ec0-2fca-413c-b7d1-5c2e61b87ea3","Type":"ContainerStarted","Data":"47ea67ece7cf8dd7e7d5daa8426d4e84fe68117befc331cfd546107bf6db92a6"}
Sep 17 16:45:16.246262 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:16.246227    2571 generic.go:356] "Generic (PLEG): container finished" podID="72014ec0-2fca-413c-b7d1-5c2e61b87ea3" containerID="f6fa6f5e73971d822910d7fe03f6a96fcf7b5bd4f2f4df1884e1a3be54fd65bc" exitCode=0
Sep 17 16:45:16.246739 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:16.246318    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72014ec0-2fca-413c-b7d1-5c2e61b87ea3","Type":"ContainerDied","Data":"f6fa6f5e73971d822910d7fe03f6a96fcf7b5bd4f2f4df1884e1a3be54fd65bc"}
Sep 17 16:45:16.248199 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:16.248174    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5rsr7" event={"ID":"761a0949-beec-4697-8f72-c03e252b6acb","Type":"ContainerStarted","Data":"713cb94be7ee1661536a7be5f82606091210ee4530631eccee90c80b80e82af0"}
Sep 17 16:45:16.248316 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:16.248296    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:45:16.249689 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:16.249672    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klgkp" event={"ID":"cbf5729d-3ed3-4da0-b9b9-45a5d851a373","Type":"ContainerStarted","Data":"099f692f78f26af326da487055d6b6587e5e18424eee60800c8d7fc6ff327fd8"}
Sep 17 16:45:16.293527 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:16.293459    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5rsr7" podStartSLOduration=66.027240864 podStartE2EDuration="1m11.293443271s" totalImagesPullingTime="5.266202407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:45:16.293224165 +0000 UTC m=+73.591970907" watchObservedRunningTime="2026-09-17 16:45:16.293443271 +0000 UTC m=+73.592190010"
Sep 17 16:45:16.310130 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:16.310073    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-klgkp" podStartSLOduration=65.749916378 podStartE2EDuration="1m11.310055463s" totalImagesPullingTime="5.560139085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:45:16.309105071 +0000 UTC m=+73.607851811" watchObservedRunningTime="2026-09-17 16:45:16.310055463 +0000 UTC m=+73.608802201"
Sep 17 16:45:19.266335 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:19.266296    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72014ec0-2fca-413c-b7d1-5c2e61b87ea3","Type":"ContainerStarted","Data":"5908750a48abe40042c67f301653c68e32ba48c343a3bfe1857a3a7f022f7602"}
Sep 17 16:45:19.266741 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:19.266366    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72014ec0-2fca-413c-b7d1-5c2e61b87ea3","Type":"ContainerStarted","Data":"72825ff01b1e7f0178202376915b16991ff12bc460754b32ae98122d7fc15725"}
Sep 17 16:45:19.266741 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:19.266393    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72014ec0-2fca-413c-b7d1-5c2e61b87ea3","Type":"ContainerStarted","Data":"c222ae138699103a75f6882142e8c38985533582b8313237791e43ed24962de2"}
Sep 17 16:45:19.266741 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:19.266418    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72014ec0-2fca-413c-b7d1-5c2e61b87ea3","Type":"ContainerStarted","Data":"9031c998a2bf08959a28abd516c843ccadaf19d42a222c6eeaf26289777c3926"}
Sep 17 16:45:19.266741 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:19.266442    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72014ec0-2fca-413c-b7d1-5c2e61b87ea3","Type":"ContainerStarted","Data":"d7f7c015a3126dfbd0f76b9b4f78b49f83921d0729cf875ddcc3415a0fe605bc"}
Sep 17 16:45:20.273217 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:20.273173    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72014ec0-2fca-413c-b7d1-5c2e61b87ea3","Type":"ContainerStarted","Data":"b753fedeba38e70dace8da17842609642e3429fe0ac23071b5bd6f002f4533cc"}
Sep 17 16:45:20.304371 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:20.304305    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.968608859 podStartE2EDuration="9.304288422s" totalImagesPullingTime="6.315163555s" totalInitContainerRuntime="20.516008ms" isStatefulPod=false podCreationTimestamp="2026-09-17 16:45:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:45:20.302065249 +0000 UTC m=+77.600811986" watchObservedRunningTime="2026-09-17 16:45:20.304288422 +0000 UTC m=+77.603035159"
Sep 17 16:45:47.255652 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:45:47.255605    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5rsr7"
Sep 17 16:47:05.342207 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.342113    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"]
Sep 17 16:47:05.345470 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.345447    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:05.348334 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.348311    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 16:47:05.349373 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.349356    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 16:47:05.349475 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.349360    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gc9x\""
Sep 17 16:47:05.355998 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.355970    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"]
Sep 17 16:47:05.408952 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.408908    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-285mp\" (UniqueName: \"kubernetes.io/projected/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-kube-api-access-285mp\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:05.408952 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.408957    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:05.409181 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.408980    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:05.510193 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.510157    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-285mp\" (UniqueName: \"kubernetes.io/projected/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-kube-api-access-285mp\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:05.510331 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.510200    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:05.510331 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.510219    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:05.510572 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.510558    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:05.510609 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.510587    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:05.519780 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.519753    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-285mp\" (UniqueName: \"kubernetes.io/projected/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-kube-api-access-285mp\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:05.655084 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.654979    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:05.926386 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:05.926307    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"]
Sep 17 16:47:05.930551 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:47:05.930521    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc5bc1e_fa69_4654_bc9c_c171658a5df9.slice/crio-a82a02f16d7b334233c39495205d542182b0e046cd903328ab62cd5e2b65928d WatchSource:0}: Error finding container a82a02f16d7b334233c39495205d542182b0e046cd903328ab62cd5e2b65928d: Status 404 returned error can't find the container with id a82a02f16d7b334233c39495205d542182b0e046cd903328ab62cd5e2b65928d
Sep 17 16:47:06.615249 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:06.615199    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5" event={"ID":"9bc5bc1e-fa69-4654-bc9c-c171658a5df9","Type":"ContainerStarted","Data":"a82a02f16d7b334233c39495205d542182b0e046cd903328ab62cd5e2b65928d"}
Sep 17 16:47:12.639849 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:12.639805    2571 generic.go:356] "Generic (PLEG): container finished" podID="9bc5bc1e-fa69-4654-bc9c-c171658a5df9" containerID="c6ab427784643a720af9b420cda949cd284a66c1188eb24404d476dc83f50ee5" exitCode=0
Sep 17 16:47:12.640286 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:12.639899    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5" event={"ID":"9bc5bc1e-fa69-4654-bc9c-c171658a5df9","Type":"ContainerDied","Data":"c6ab427784643a720af9b420cda949cd284a66c1188eb24404d476dc83f50ee5"}
Sep 17 16:47:15.655249 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:15.655210    2571 generic.go:356] "Generic (PLEG): container finished" podID="9bc5bc1e-fa69-4654-bc9c-c171658a5df9" containerID="9aad21ef1d6e5d79a00398d20a7f5196e2df15df2a0df1d463136a01383df34f" exitCode=0
Sep 17 16:47:15.655666 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:15.655257    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5" event={"ID":"9bc5bc1e-fa69-4654-bc9c-c171658a5df9","Type":"ContainerDied","Data":"9aad21ef1d6e5d79a00398d20a7f5196e2df15df2a0df1d463136a01383df34f"}
Sep 17 16:47:22.683715 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:22.683674    2571 generic.go:356] "Generic (PLEG): container finished" podID="9bc5bc1e-fa69-4654-bc9c-c171658a5df9" containerID="181880c7bf1ba504214787f7fefca34cfa1757b904952fff7b3c8f989b6a1d75" exitCode=0
Sep 17 16:47:22.683715 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:22.683719    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5" event={"ID":"9bc5bc1e-fa69-4654-bc9c-c171658a5df9","Type":"ContainerDied","Data":"181880c7bf1ba504214787f7fefca34cfa1757b904952fff7b3c8f989b6a1d75"}
Sep 17 16:47:23.813043 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:23.813011    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:23.955232 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:23.955126    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-util\") pod \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") "
Sep 17 16:47:23.955232 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:23.955194    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-bundle\") pod \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") "
Sep 17 16:47:23.955232 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:23.955236    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-285mp\" (UniqueName: \"kubernetes.io/projected/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-kube-api-access-285mp\") pod \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\" (UID: \"9bc5bc1e-fa69-4654-bc9c-c171658a5df9\") "
Sep 17 16:47:23.956056 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:23.956014    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-bundle" (OuterVolumeSpecName: "bundle") pod "9bc5bc1e-fa69-4654-bc9c-c171658a5df9" (UID: "9bc5bc1e-fa69-4654-bc9c-c171658a5df9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:47:23.957607 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:23.957576    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-kube-api-access-285mp" (OuterVolumeSpecName: "kube-api-access-285mp") pod "9bc5bc1e-fa69-4654-bc9c-c171658a5df9" (UID: "9bc5bc1e-fa69-4654-bc9c-c171658a5df9"). InnerVolumeSpecName "kube-api-access-285mp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:47:23.959545 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:23.959521    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-util" (OuterVolumeSpecName: "util") pod "9bc5bc1e-fa69-4654-bc9c-c171658a5df9" (UID: "9bc5bc1e-fa69-4654-bc9c-c171658a5df9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:47:24.056658 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:24.056600    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-285mp\" (UniqueName: \"kubernetes.io/projected/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-kube-api-access-285mp\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:47:24.056658 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:24.056655    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-util\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:47:24.056658 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:24.056667    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bc5bc1e-fa69-4654-bc9c-c171658a5df9-bundle\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:47:24.693273 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:24.693247    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5"
Sep 17 16:47:24.693447 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:24.693247    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aljdl5" event={"ID":"9bc5bc1e-fa69-4654-bc9c-c171658a5df9","Type":"ContainerDied","Data":"a82a02f16d7b334233c39495205d542182b0e046cd903328ab62cd5e2b65928d"}
Sep 17 16:47:24.693447 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:24.693373    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a82a02f16d7b334233c39495205d542182b0e046cd903328ab62cd5e2b65928d"
Sep 17 16:47:29.399124 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.399092    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"]
Sep 17 16:47:29.399492 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.399335    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc5bc1e-fa69-4654-bc9c-c171658a5df9" containerName="util"
Sep 17 16:47:29.399492 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.399346    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc5bc1e-fa69-4654-bc9c-c171658a5df9" containerName="util"
Sep 17 16:47:29.399492 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.399353    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc5bc1e-fa69-4654-bc9c-c171658a5df9" containerName="pull"
Sep 17 16:47:29.399492 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.399359    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc5bc1e-fa69-4654-bc9c-c171658a5df9" containerName="pull"
Sep 17 16:47:29.399492 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.399364    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc5bc1e-fa69-4654-bc9c-c171658a5df9" containerName="extract"
Sep 17 16:47:29.399492 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.399370    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc5bc1e-fa69-4654-bc9c-c171658a5df9" containerName="extract"
Sep 17 16:47:29.399492 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.399405    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc5bc1e-fa69-4654-bc9c-c171658a5df9" containerName="extract"
Sep 17 16:47:29.402754 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.402725    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"
Sep 17 16:47:29.409595 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.409557    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Sep 17 16:47:29.410304 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.410285    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Sep 17 16:47:29.412063 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.412029    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Sep 17 16:47:29.412304 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.412268    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-f8zw6\""
Sep 17 16:47:29.493116 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.493079    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7g6z\" (UniqueName: \"kubernetes.io/projected/241faadb-27c4-4bce-b608-3214af36c4e8-kube-api-access-p7g6z\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-55bmj\" (UID: \"241faadb-27c4-4bce-b608-3214af36c4e8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"
Sep 17 16:47:29.493116 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.493127    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/241faadb-27c4-4bce-b608-3214af36c4e8-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-55bmj\" (UID: \"241faadb-27c4-4bce-b608-3214af36c4e8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"
Sep 17 16:47:29.508964 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.508929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"]
Sep 17 16:47:29.594341 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.594300    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7g6z\" (UniqueName: \"kubernetes.io/projected/241faadb-27c4-4bce-b608-3214af36c4e8-kube-api-access-p7g6z\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-55bmj\" (UID: \"241faadb-27c4-4bce-b608-3214af36c4e8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"
Sep 17 16:47:29.594341 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.594343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/241faadb-27c4-4bce-b608-3214af36c4e8-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-55bmj\" (UID: \"241faadb-27c4-4bce-b608-3214af36c4e8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"
Sep 17 16:47:29.596961 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.596925    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/241faadb-27c4-4bce-b608-3214af36c4e8-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-55bmj\" (UID: \"241faadb-27c4-4bce-b608-3214af36c4e8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"
Sep 17 16:47:29.603417 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.603389    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7g6z\" (UniqueName: \"kubernetes.io/projected/241faadb-27c4-4bce-b608-3214af36c4e8-kube-api-access-p7g6z\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-55bmj\" (UID: \"241faadb-27c4-4bce-b608-3214af36c4e8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"
Sep 17 16:47:29.716177 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.716150    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"
Sep 17 16:47:29.996161 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:29.996034    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"]
Sep 17 16:47:29.999351 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:47:29.999325    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241faadb_27c4_4bce_b608_3214af36c4e8.slice/crio-76b2310680579157c70a0ba7a26a14cd737b367c6867f1275232b43c10686a6d WatchSource:0}: Error finding container 76b2310680579157c70a0ba7a26a14cd737b367c6867f1275232b43c10686a6d: Status 404 returned error can't find the container with id 76b2310680579157c70a0ba7a26a14cd737b367c6867f1275232b43c10686a6d
Sep 17 16:47:30.716856 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:30.716817    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj" event={"ID":"241faadb-27c4-4bce-b608-3214af36c4e8","Type":"ContainerStarted","Data":"76b2310680579157c70a0ba7a26a14cd737b367c6867f1275232b43c10686a6d"}
Sep 17 16:47:33.455235 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.455195    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-4gf8x"]
Sep 17 16:47:33.458255 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.458235    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:33.460895 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.460863    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Sep 17 16:47:33.460998 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.460979    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Sep 17 16:47:33.461150 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.461136    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-kjnq9\""
Sep 17 16:47:33.468812 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.468788    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-4gf8x"]
Sep 17 16:47:33.626774 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.626731    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-cabundle0\") pod \"keda-operator-579c8958f7-4gf8x\" (UID: \"2f62aa37-678a-43f0-b9c8-4c3926f3e57d\") " pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:33.626774 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.626779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-certificates\") pod \"keda-operator-579c8958f7-4gf8x\" (UID: \"2f62aa37-678a-43f0-b9c8-4c3926f3e57d\") " pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:33.626983 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.626870    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wdkf\" (UniqueName: \"kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-kube-api-access-2wdkf\") pod \"keda-operator-579c8958f7-4gf8x\" (UID: \"2f62aa37-678a-43f0-b9c8-4c3926f3e57d\") " pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:33.728148 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.727961    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-certificates\") pod \"keda-operator-579c8958f7-4gf8x\" (UID: \"2f62aa37-678a-43f0-b9c8-4c3926f3e57d\") " pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:33.728404 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:33.728375    2571 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Sep 17 16:47:33.728489 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:33.728414    2571 secret.go:281] references non-existent secret key: ca.crt
Sep 17 16:47:33.728489 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:33.728427    2571 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Sep 17 16:47:33.728489 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:33.728452    2571 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-4gf8x: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Sep 17 16:47:33.728659 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:33.728526    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-certificates podName:2f62aa37-678a-43f0-b9c8-4c3926f3e57d nodeName:}" failed. No retries permitted until 2026-09-17 16:47:34.228504676 +0000 UTC m=+211.527251396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-certificates") pod "keda-operator-579c8958f7-4gf8x" (UID: "2f62aa37-678a-43f0-b9c8-4c3926f3e57d") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Sep 17 16:47:33.728875 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.728851    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wdkf\" (UniqueName: \"kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-kube-api-access-2wdkf\") pod \"keda-operator-579c8958f7-4gf8x\" (UID: \"2f62aa37-678a-43f0-b9c8-4c3926f3e57d\") " pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:33.729040 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.729026    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-cabundle0\") pod \"keda-operator-579c8958f7-4gf8x\" (UID: \"2f62aa37-678a-43f0-b9c8-4c3926f3e57d\") " pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:33.729963 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.729942    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-cabundle0\") pod \"keda-operator-579c8958f7-4gf8x\" (UID: \"2f62aa37-678a-43f0-b9c8-4c3926f3e57d\") " pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:33.733819 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.733790    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj" event={"ID":"241faadb-27c4-4bce-b608-3214af36c4e8","Type":"ContainerStarted","Data":"f2e4bdcc0f7447770ff98fe80ddb53bfc5c17b260f62b33e01445faef5ecf4b0"}
Sep 17 16:47:33.733972 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.733954    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"
Sep 17 16:47:33.747597 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:33.747565    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wdkf\" (UniqueName: \"kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-kube-api-access-2wdkf\") pod \"keda-operator-579c8958f7-4gf8x\" (UID: \"2f62aa37-678a-43f0-b9c8-4c3926f3e57d\") " pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:34.018490 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.018370    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj" podStartSLOduration=2.2480532269999998 podStartE2EDuration="5.0183489s" totalImagesPullingTime="2.770295673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:47:33.774329504 +0000 UTC m=+211.073076254" watchObservedRunningTime="2026-09-17 16:47:34.0183489 +0000 UTC m=+211.317095640"
Sep 17 16:47:34.019842 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.019821    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"]
Sep 17 16:47:34.023134 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.023118    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:34.025722 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.025703    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Sep 17 16:47:34.033300 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.033274    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"]
Sep 17 16:47:34.132586 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.132537    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/78153c7b-4815-4da6-820d-ed7d49c178e6-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-stjzc\" (UID: \"78153c7b-4815-4da6-820d-ed7d49c178e6\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:34.132586 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.132595    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/78153c7b-4815-4da6-820d-ed7d49c178e6-certificates\") pod \"keda-metrics-apiserver-77857b7b98-stjzc\" (UID: \"78153c7b-4815-4da6-820d-ed7d49c178e6\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:34.132847 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.132700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6rl6\" (UniqueName: \"kubernetes.io/projected/78153c7b-4815-4da6-820d-ed7d49c178e6-kube-api-access-v6rl6\") pod \"keda-metrics-apiserver-77857b7b98-stjzc\" (UID: \"78153c7b-4815-4da6-820d-ed7d49c178e6\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:34.233303 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.233246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6rl6\" (UniqueName: \"kubernetes.io/projected/78153c7b-4815-4da6-820d-ed7d49c178e6-kube-api-access-v6rl6\") pod \"keda-metrics-apiserver-77857b7b98-stjzc\" (UID: \"78153c7b-4815-4da6-820d-ed7d49c178e6\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:34.233303 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.233315    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-certificates\") pod \"keda-operator-579c8958f7-4gf8x\" (UID: \"2f62aa37-678a-43f0-b9c8-4c3926f3e57d\") " pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:34.233583 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.233363    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/78153c7b-4815-4da6-820d-ed7d49c178e6-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-stjzc\" (UID: \"78153c7b-4815-4da6-820d-ed7d49c178e6\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:34.233583 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.233397    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/78153c7b-4815-4da6-820d-ed7d49c178e6-certificates\") pod \"keda-metrics-apiserver-77857b7b98-stjzc\" (UID: \"78153c7b-4815-4da6-820d-ed7d49c178e6\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:34.233583 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:34.233415    2571 secret.go:281] references non-existent secret key: ca.crt
Sep 17 16:47:34.233583 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:34.233435    2571 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Sep 17 16:47:34.233583 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:34.233444    2571 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-4gf8x: references non-existent secret key: ca.crt
Sep 17 16:47:34.233583 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:34.233487    2571 secret.go:281] references non-existent secret key: tls.crt
Sep 17 16:47:34.233583 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:34.233500    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-certificates podName:2f62aa37-678a-43f0-b9c8-4c3926f3e57d nodeName:}" failed. No retries permitted until 2026-09-17 16:47:35.233483442 +0000 UTC m=+212.532230162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-certificates") pod "keda-operator-579c8958f7-4gf8x" (UID: "2f62aa37-678a-43f0-b9c8-4c3926f3e57d") : references non-existent secret key: ca.crt
Sep 17 16:47:34.233583 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:34.233502    2571 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Sep 17 16:47:34.233583 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:34.233523    2571 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc: references non-existent secret key: tls.crt
Sep 17 16:47:34.233583 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:34.233588    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78153c7b-4815-4da6-820d-ed7d49c178e6-certificates podName:78153c7b-4815-4da6-820d-ed7d49c178e6 nodeName:}" failed. No retries permitted until 2026-09-17 16:47:34.733569972 +0000 UTC m=+212.032316695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/78153c7b-4815-4da6-820d-ed7d49c178e6-certificates") pod "keda-metrics-apiserver-77857b7b98-stjzc" (UID: "78153c7b-4815-4da6-820d-ed7d49c178e6") : references non-existent secret key: tls.crt
Sep 17 16:47:34.233988 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.233748    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/78153c7b-4815-4da6-820d-ed7d49c178e6-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-stjzc\" (UID: \"78153c7b-4815-4da6-820d-ed7d49c178e6\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:34.243935 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.243915    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6rl6\" (UniqueName: \"kubernetes.io/projected/78153c7b-4815-4da6-820d-ed7d49c178e6-kube-api-access-v6rl6\") pod \"keda-metrics-apiserver-77857b7b98-stjzc\" (UID: \"78153c7b-4815-4da6-820d-ed7d49c178e6\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:34.533180 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.533144    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-rzqc8"]
Sep 17 16:47:34.536284 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.536266    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-rzqc8"
Sep 17 16:47:34.538891 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.538876    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Sep 17 16:47:34.546140 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.546115    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-rzqc8"]
Sep 17 16:47:34.635559 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.635523    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/29560d98-3eac-4e77-8132-f2daddf24f38-certificates\") pod \"keda-admission-6c4d864b86-rzqc8\" (UID: \"29560d98-3eac-4e77-8132-f2daddf24f38\") " pod="openshift-keda/keda-admission-6c4d864b86-rzqc8"
Sep 17 16:47:34.635559 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.635563    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cq5f\" (UniqueName: \"kubernetes.io/projected/29560d98-3eac-4e77-8132-f2daddf24f38-kube-api-access-8cq5f\") pod \"keda-admission-6c4d864b86-rzqc8\" (UID: \"29560d98-3eac-4e77-8132-f2daddf24f38\") " pod="openshift-keda/keda-admission-6c4d864b86-rzqc8"
Sep 17 16:47:34.736288 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.736258    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/29560d98-3eac-4e77-8132-f2daddf24f38-certificates\") pod \"keda-admission-6c4d864b86-rzqc8\" (UID: \"29560d98-3eac-4e77-8132-f2daddf24f38\") " pod="openshift-keda/keda-admission-6c4d864b86-rzqc8"
Sep 17 16:47:34.736491 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.736308    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cq5f\" (UniqueName: \"kubernetes.io/projected/29560d98-3eac-4e77-8132-f2daddf24f38-kube-api-access-8cq5f\") pod \"keda-admission-6c4d864b86-rzqc8\" (UID: \"29560d98-3eac-4e77-8132-f2daddf24f38\") " pod="openshift-keda/keda-admission-6c4d864b86-rzqc8"
Sep 17 16:47:34.736491 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.736336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/78153c7b-4815-4da6-820d-ed7d49c178e6-certificates\") pod \"keda-metrics-apiserver-77857b7b98-stjzc\" (UID: \"78153c7b-4815-4da6-820d-ed7d49c178e6\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:34.736491 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:34.736414    2571 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Sep 17 16:47:34.736491 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:34.736440    2571 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-6c4d864b86-rzqc8: secret "keda-admission-webhooks-certs" not found
Sep 17 16:47:34.736736 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:47:34.736508    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29560d98-3eac-4e77-8132-f2daddf24f38-certificates podName:29560d98-3eac-4e77-8132-f2daddf24f38 nodeName:}" failed. No retries permitted until 2026-09-17 16:47:35.236488653 +0000 UTC m=+212.535235372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/29560d98-3eac-4e77-8132-f2daddf24f38-certificates") pod "keda-admission-6c4d864b86-rzqc8" (UID: "29560d98-3eac-4e77-8132-f2daddf24f38") : secret "keda-admission-webhooks-certs" not found
Sep 17 16:47:34.739177 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.739145    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/78153c7b-4815-4da6-820d-ed7d49c178e6-certificates\") pod \"keda-metrics-apiserver-77857b7b98-stjzc\" (UID: \"78153c7b-4815-4da6-820d-ed7d49c178e6\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:34.746177 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.746155    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cq5f\" (UniqueName: \"kubernetes.io/projected/29560d98-3eac-4e77-8132-f2daddf24f38-kube-api-access-8cq5f\") pod \"keda-admission-6c4d864b86-rzqc8\" (UID: \"29560d98-3eac-4e77-8132-f2daddf24f38\") " pod="openshift-keda/keda-admission-6c4d864b86-rzqc8"
Sep 17 16:47:34.934522 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:34.934429    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:35.206125 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.206099    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"]
Sep 17 16:47:35.208456 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:47:35.208417    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78153c7b_4815_4da6_820d_ed7d49c178e6.slice/crio-014e01b9cf4d07580504e36ff57e158a803e24201db83a93828d0bdf1494e90d WatchSource:0}: Error finding container 014e01b9cf4d07580504e36ff57e158a803e24201db83a93828d0bdf1494e90d: Status 404 returned error can't find the container with id 014e01b9cf4d07580504e36ff57e158a803e24201db83a93828d0bdf1494e90d
Sep 17 16:47:35.240676 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.240603    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/29560d98-3eac-4e77-8132-f2daddf24f38-certificates\") pod \"keda-admission-6c4d864b86-rzqc8\" (UID: \"29560d98-3eac-4e77-8132-f2daddf24f38\") " pod="openshift-keda/keda-admission-6c4d864b86-rzqc8"
Sep 17 16:47:35.240849 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.240760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-certificates\") pod \"keda-operator-579c8958f7-4gf8x\" (UID: \"2f62aa37-678a-43f0-b9c8-4c3926f3e57d\") " pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:35.243301 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.243277    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/29560d98-3eac-4e77-8132-f2daddf24f38-certificates\") pod \"keda-admission-6c4d864b86-rzqc8\" (UID: \"29560d98-3eac-4e77-8132-f2daddf24f38\") " pod="openshift-keda/keda-admission-6c4d864b86-rzqc8"
Sep 17 16:47:35.243448 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.243277    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2f62aa37-678a-43f0-b9c8-4c3926f3e57d-certificates\") pod \"keda-operator-579c8958f7-4gf8x\" (UID: \"2f62aa37-678a-43f0-b9c8-4c3926f3e57d\") " pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:35.269163 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.269108    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:35.446456 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.446416    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-rzqc8"
Sep 17 16:47:35.543784 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.543687    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-4gf8x"]
Sep 17 16:47:35.546191 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:47:35.546167    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f62aa37_678a_43f0_b9c8_4c3926f3e57d.slice/crio-455325d3fe052bd4cda2cc5a1c88dcaaa0af3b80fdca322b802f84c811f63744 WatchSource:0}: Error finding container 455325d3fe052bd4cda2cc5a1c88dcaaa0af3b80fdca322b802f84c811f63744: Status 404 returned error can't find the container with id 455325d3fe052bd4cda2cc5a1c88dcaaa0af3b80fdca322b802f84c811f63744
Sep 17 16:47:35.725591 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.725553    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-rzqc8"]
Sep 17 16:47:35.728391 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:47:35.728366    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29560d98_3eac_4e77_8132_f2daddf24f38.slice/crio-dbe6d6430a108af4ba205dee44275d0c343251a9a9b0aebe19f9b4d384112cc8 WatchSource:0}: Error finding container dbe6d6430a108af4ba205dee44275d0c343251a9a9b0aebe19f9b4d384112cc8: Status 404 returned error can't find the container with id dbe6d6430a108af4ba205dee44275d0c343251a9a9b0aebe19f9b4d384112cc8
Sep 17 16:47:35.741322 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.741285    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-4gf8x" event={"ID":"2f62aa37-678a-43f0-b9c8-4c3926f3e57d","Type":"ContainerStarted","Data":"455325d3fe052bd4cda2cc5a1c88dcaaa0af3b80fdca322b802f84c811f63744"}
Sep 17 16:47:35.742376 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.742345    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-rzqc8" event={"ID":"29560d98-3eac-4e77-8132-f2daddf24f38","Type":"ContainerStarted","Data":"dbe6d6430a108af4ba205dee44275d0c343251a9a9b0aebe19f9b4d384112cc8"}
Sep 17 16:47:35.743426 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:35.743406    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc" event={"ID":"78153c7b-4815-4da6-820d-ed7d49c178e6","Type":"ContainerStarted","Data":"014e01b9cf4d07580504e36ff57e158a803e24201db83a93828d0bdf1494e90d"}
Sep 17 16:47:39.765167 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:39.765124    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-4gf8x" event={"ID":"2f62aa37-678a-43f0-b9c8-4c3926f3e57d","Type":"ContainerStarted","Data":"0e9a145f6e1949a82ca9a2dee7eb0ef48758144bae0d73fd3a1df22940c37fc3"}
Sep 17 16:47:39.765600 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:39.765286    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:47:39.767276 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:39.767245    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-rzqc8" event={"ID":"29560d98-3eac-4e77-8132-f2daddf24f38","Type":"ContainerStarted","Data":"e1c9ba06f8a95fda72bf71d2667b1a063e960f7aca87640ed3f94d23261a1154"}
Sep 17 16:47:39.767416 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:39.767305    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-6c4d864b86-rzqc8"
Sep 17 16:47:39.769163 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:39.769136    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc" event={"ID":"78153c7b-4815-4da6-820d-ed7d49c178e6","Type":"ContainerStarted","Data":"5bca8dcd940fb4c92df408305ec32439ab6e0bd84004d6aca22af8c6009c497f"}
Sep 17 16:47:39.769273 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:39.769239    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:39.785514 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:39.785466    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-4gf8x" podStartSLOduration=2.835596839 podStartE2EDuration="6.785449178s" totalImagesPullingTime="3.949852339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:47:39.785428441 +0000 UTC m=+217.084175181" watchObservedRunningTime="2026-09-17 16:47:39.785449178 +0000 UTC m=+217.084195914"
Sep 17 16:47:39.804262 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:39.804201    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-6c4d864b86-rzqc8" podStartSLOduration=2.046625981 podStartE2EDuration="5.804182802s" totalImagesPullingTime="3.757556821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:47:39.803324627 +0000 UTC m=+217.102071367" watchObservedRunningTime="2026-09-17 16:47:39.804182802 +0000 UTC m=+217.102929541"
Sep 17 16:47:39.822680 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:39.822612    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc" podStartSLOduration=1.540219035 podStartE2EDuration="5.822595541s" totalImagesPullingTime="4.282376506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:47:39.822212573 +0000 UTC m=+217.120959313" watchObservedRunningTime="2026-09-17 16:47:39.822595541 +0000 UTC m=+217.121342302"
Sep 17 16:47:50.777868 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:50.777794    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-stjzc"
Sep 17 16:47:54.739363 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:47:54.739334    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-55bmj"
Sep 17 16:48:00.775144 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:00.775107    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-4gf8x"
Sep 17 16:48:00.775584 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:00.775224    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-6c4d864b86-rzqc8"
Sep 17 16:48:52.385176 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.385137    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-846cf5d849-qg8qh"]
Sep 17 16:48:52.391060 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.391028    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:48:52.391703 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.391679    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"]
Sep 17 16:48:52.393602 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.393580    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-8nfj6\""
Sep 17 16:48:52.394498 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.394445    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:48:52.394671 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.394649    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Sep 17 16:48:52.394744 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.394659    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 17 16:48:52.394744 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.394714    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 17 16:48:52.396887 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.396868    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Sep 17 16:48:52.396988 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.396945    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-2mv9r\""
Sep 17 16:48:52.399647 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.399613    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-846cf5d849-qg8qh"]
Sep 17 16:48:52.405595 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.405557    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"]
Sep 17 16:48:52.420803 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.420782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmvkm\" (UniqueName: \"kubernetes.io/projected/4016c45c-052d-46d7-9897-ecfb22999029-kube-api-access-vmvkm\") pod \"llmisvc-controller-manager-645f9c8fd6-kwt62\" (UID: \"4016c45c-052d-46d7-9897-ecfb22999029\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:48:52.420917 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.420820    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4016c45c-052d-46d7-9897-ecfb22999029-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-kwt62\" (UID: \"4016c45c-052d-46d7-9897-ecfb22999029\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:48:52.420917 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.420845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a24f1082-df9f-4f40-9308-8ba4b3508e86-cert\") pod \"kserve-controller-manager-846cf5d849-qg8qh\" (UID: \"a24f1082-df9f-4f40-9308-8ba4b3508e86\") " pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:48:52.420917 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.420884    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hzqc\" (UniqueName: \"kubernetes.io/projected/a24f1082-df9f-4f40-9308-8ba4b3508e86-kube-api-access-4hzqc\") pod \"kserve-controller-manager-846cf5d849-qg8qh\" (UID: \"a24f1082-df9f-4f40-9308-8ba4b3508e86\") " pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:48:52.429872 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.429848    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-z2xq6"]
Sep 17 16:48:52.432949 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.432923    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-z2xq6"
Sep 17 16:48:52.437985 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.437964    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 17 16:48:52.438104 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.437967    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-qn42n\""
Sep 17 16:48:52.444408 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.444388    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-z2xq6"]
Sep 17 16:48:52.521308 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.521264    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmvkm\" (UniqueName: \"kubernetes.io/projected/4016c45c-052d-46d7-9897-ecfb22999029-kube-api-access-vmvkm\") pod \"llmisvc-controller-manager-645f9c8fd6-kwt62\" (UID: \"4016c45c-052d-46d7-9897-ecfb22999029\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:48:52.521485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.521320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4016c45c-052d-46d7-9897-ecfb22999029-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-kwt62\" (UID: \"4016c45c-052d-46d7-9897-ecfb22999029\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:48:52.521485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.521360    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxcdw\" (UniqueName: \"kubernetes.io/projected/0ca5f46f-4958-4e0b-8caf-1e08af43d961-kube-api-access-mxcdw\") pod \"seaweedfs-64568bcd49-z2xq6\" (UID: \"0ca5f46f-4958-4e0b-8caf-1e08af43d961\") " pod="kserve/seaweedfs-64568bcd49-z2xq6"
Sep 17 16:48:52.521485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.521388    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ca5f46f-4958-4e0b-8caf-1e08af43d961-data\") pod \"seaweedfs-64568bcd49-z2xq6\" (UID: \"0ca5f46f-4958-4e0b-8caf-1e08af43d961\") " pod="kserve/seaweedfs-64568bcd49-z2xq6"
Sep 17 16:48:52.521485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.521411    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a24f1082-df9f-4f40-9308-8ba4b3508e86-cert\") pod \"kserve-controller-manager-846cf5d849-qg8qh\" (UID: \"a24f1082-df9f-4f40-9308-8ba4b3508e86\") " pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:48:52.521485 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:48:52.521431    2571 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 17 16:48:52.521801 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.521488    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzqc\" (UniqueName: \"kubernetes.io/projected/a24f1082-df9f-4f40-9308-8ba4b3508e86-kube-api-access-4hzqc\") pod \"kserve-controller-manager-846cf5d849-qg8qh\" (UID: \"a24f1082-df9f-4f40-9308-8ba4b3508e86\") " pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:48:52.521801 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:48:52.521510    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4016c45c-052d-46d7-9897-ecfb22999029-cert podName:4016c45c-052d-46d7-9897-ecfb22999029 nodeName:}" failed. No retries permitted until 2026-09-17 16:48:53.021488303 +0000 UTC m=+290.320235021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4016c45c-052d-46d7-9897-ecfb22999029-cert") pod "llmisvc-controller-manager-645f9c8fd6-kwt62" (UID: "4016c45c-052d-46d7-9897-ecfb22999029") : secret "llmisvc-webhook-server-cert" not found
Sep 17 16:48:52.524088 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.524063    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a24f1082-df9f-4f40-9308-8ba4b3508e86-cert\") pod \"kserve-controller-manager-846cf5d849-qg8qh\" (UID: \"a24f1082-df9f-4f40-9308-8ba4b3508e86\") " pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:48:52.530673 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.530647    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmvkm\" (UniqueName: \"kubernetes.io/projected/4016c45c-052d-46d7-9897-ecfb22999029-kube-api-access-vmvkm\") pod \"llmisvc-controller-manager-645f9c8fd6-kwt62\" (UID: \"4016c45c-052d-46d7-9897-ecfb22999029\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:48:52.531188 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.531160    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hzqc\" (UniqueName: \"kubernetes.io/projected/a24f1082-df9f-4f40-9308-8ba4b3508e86-kube-api-access-4hzqc\") pod \"kserve-controller-manager-846cf5d849-qg8qh\" (UID: \"a24f1082-df9f-4f40-9308-8ba4b3508e86\") " pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:48:52.622713 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.622669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxcdw\" (UniqueName: \"kubernetes.io/projected/0ca5f46f-4958-4e0b-8caf-1e08af43d961-kube-api-access-mxcdw\") pod \"seaweedfs-64568bcd49-z2xq6\" (UID: \"0ca5f46f-4958-4e0b-8caf-1e08af43d961\") " pod="kserve/seaweedfs-64568bcd49-z2xq6"
Sep 17 16:48:52.622713 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.622712    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ca5f46f-4958-4e0b-8caf-1e08af43d961-data\") pod \"seaweedfs-64568bcd49-z2xq6\" (UID: \"0ca5f46f-4958-4e0b-8caf-1e08af43d961\") " pod="kserve/seaweedfs-64568bcd49-z2xq6"
Sep 17 16:48:52.623080 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.623065    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ca5f46f-4958-4e0b-8caf-1e08af43d961-data\") pod \"seaweedfs-64568bcd49-z2xq6\" (UID: \"0ca5f46f-4958-4e0b-8caf-1e08af43d961\") " pod="kserve/seaweedfs-64568bcd49-z2xq6"
Sep 17 16:48:52.633007 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.632975    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxcdw\" (UniqueName: \"kubernetes.io/projected/0ca5f46f-4958-4e0b-8caf-1e08af43d961-kube-api-access-mxcdw\") pod \"seaweedfs-64568bcd49-z2xq6\" (UID: \"0ca5f46f-4958-4e0b-8caf-1e08af43d961\") " pod="kserve/seaweedfs-64568bcd49-z2xq6"
Sep 17 16:48:52.703176 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.703097    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:48:52.741789 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.741755    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-z2xq6"
Sep 17 16:48:52.976013 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:52.975978    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-846cf5d849-qg8qh"]
Sep 17 16:48:52.978977 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:48:52.978951    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24f1082_df9f_4f40_9308_8ba4b3508e86.slice/crio-5a81ed1425805fbe5ee4b34bdcec20b8fea2488fadd5a12af1a9141bcd46e354 WatchSource:0}: Error finding container 5a81ed1425805fbe5ee4b34bdcec20b8fea2488fadd5a12af1a9141bcd46e354: Status 404 returned error can't find the container with id 5a81ed1425805fbe5ee4b34bdcec20b8fea2488fadd5a12af1a9141bcd46e354
Sep 17 16:48:53.025815 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:53.025787    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4016c45c-052d-46d7-9897-ecfb22999029-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-kwt62\" (UID: \"4016c45c-052d-46d7-9897-ecfb22999029\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:48:53.025962 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:48:53.025906    2571 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 17 16:48:53.026001 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:48:53.025971    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4016c45c-052d-46d7-9897-ecfb22999029-cert podName:4016c45c-052d-46d7-9897-ecfb22999029 nodeName:}" failed. No retries permitted until 2026-09-17 16:48:54.025956257 +0000 UTC m=+291.324702974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4016c45c-052d-46d7-9897-ecfb22999029-cert") pod "llmisvc-controller-manager-645f9c8fd6-kwt62" (UID: "4016c45c-052d-46d7-9897-ecfb22999029") : secret "llmisvc-webhook-server-cert" not found
Sep 17 16:48:53.026045 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:53.026025    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-z2xq6"]
Sep 17 16:48:53.029064 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:48:53.029035    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca5f46f_4958_4e0b_8caf_1e08af43d961.slice/crio-3d1ea56b47cd71d179b0ff283cb8cff118080901970be665d623114850fe244c WatchSource:0}: Error finding container 3d1ea56b47cd71d179b0ff283cb8cff118080901970be665d623114850fe244c: Status 404 returned error can't find the container with id 3d1ea56b47cd71d179b0ff283cb8cff118080901970be665d623114850fe244c
Sep 17 16:48:53.044950 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:53.044918    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-z2xq6" event={"ID":"0ca5f46f-4958-4e0b-8caf-1e08af43d961","Type":"ContainerStarted","Data":"3d1ea56b47cd71d179b0ff283cb8cff118080901970be665d623114850fe244c"}
Sep 17 16:48:53.046004 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:53.045981    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh" event={"ID":"a24f1082-df9f-4f40-9308-8ba4b3508e86","Type":"ContainerStarted","Data":"5a81ed1425805fbe5ee4b34bdcec20b8fea2488fadd5a12af1a9141bcd46e354"}
Sep 17 16:48:54.033974 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:54.033932    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4016c45c-052d-46d7-9897-ecfb22999029-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-kwt62\" (UID: \"4016c45c-052d-46d7-9897-ecfb22999029\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:48:54.038789 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:54.038728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4016c45c-052d-46d7-9897-ecfb22999029-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-kwt62\" (UID: \"4016c45c-052d-46d7-9897-ecfb22999029\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:48:54.210805 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:54.210767    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:48:56.661161 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:56.661117    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"]
Sep 17 16:48:56.664433 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:48:56.664399    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4016c45c_052d_46d7_9897_ecfb22999029.slice/crio-1baa2e6940e4ccf89fb1c95b1b82915003c8583da239708b75025c74ddf958ce WatchSource:0}: Error finding container 1baa2e6940e4ccf89fb1c95b1b82915003c8583da239708b75025c74ddf958ce: Status 404 returned error can't find the container with id 1baa2e6940e4ccf89fb1c95b1b82915003c8583da239708b75025c74ddf958ce
Sep 17 16:48:57.070280 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:57.070241    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-z2xq6" event={"ID":"0ca5f46f-4958-4e0b-8caf-1e08af43d961","Type":"ContainerStarted","Data":"f103a22986537ea02c44b6d5eed026fd21d5ddc746bfc3bf5e7278e47178a044"}
Sep 17 16:48:57.070608 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:57.070315    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-z2xq6"
Sep 17 16:48:57.071959 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:57.071934    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh" event={"ID":"a24f1082-df9f-4f40-9308-8ba4b3508e86","Type":"ContainerStarted","Data":"33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336"}
Sep 17 16:48:57.072084 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:57.072059    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:48:57.073186 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:57.073163    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62" event={"ID":"4016c45c-052d-46d7-9897-ecfb22999029","Type":"ContainerStarted","Data":"1baa2e6940e4ccf89fb1c95b1b82915003c8583da239708b75025c74ddf958ce"}
Sep 17 16:48:57.100120 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:57.100063    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-z2xq6" podStartSLOduration=1.53960396 podStartE2EDuration="5.100046154s" totalImagesPullingTime="3.560442194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:48:57.098180788 +0000 UTC m=+294.396927553" watchObservedRunningTime="2026-09-17 16:48:57.100046154 +0000 UTC m=+294.398792887"
Sep 17 16:48:57.121734 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:57.121677    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh" podStartSLOduration=1.733016645 podStartE2EDuration="5.121658522s" totalImagesPullingTime="3.388641877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:48:57.120469814 +0000 UTC m=+294.419216554" watchObservedRunningTime="2026-09-17 16:48:57.121658522 +0000 UTC m=+294.420405262"
Sep 17 16:48:59.082378 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:59.082341    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62" event={"ID":"4016c45c-052d-46d7-9897-ecfb22999029","Type":"ContainerStarted","Data":"e9d222845a45606464b37101ddc4be87f6504c15b4fcd184ee049844191a2565"}
Sep 17 16:48:59.082777 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:59.082481    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:48:59.106004 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:48:59.105949    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62" podStartSLOduration=5.122646079 podStartE2EDuration="7.105932638s" totalImagesPullingTime="1.983286559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:48:59.104724085 +0000 UTC m=+296.403470825" watchObservedRunningTime="2026-09-17 16:48:59.105932638 +0000 UTC m=+296.404679377"
Sep 17 16:49:03.079886 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:03.079841    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-z2xq6"
Sep 17 16:49:04.736007 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:04.735979    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 16:49:04.738041 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:04.738018    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 16:49:04.742378 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:04.742355    2571 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 16:49:28.082530 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:28.082499    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:49:30.090073 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:30.090042    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-kwt62"
Sep 17 16:49:38.366616 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.366572    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-846cf5d849-qg8qh"]
Sep 17 16:49:38.367111 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.366865    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh" podUID="a24f1082-df9f-4f40-9308-8ba4b3508e86" containerName="manager" containerID="cri-o://33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336" gracePeriod=10
Sep 17 16:49:38.399577 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.399546    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-846cf5d849-kg2qx"]
Sep 17 16:49:38.401691 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.401669    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-846cf5d849-kg2qx"
Sep 17 16:49:38.414154 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.414131    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-846cf5d849-kg2qx"]
Sep 17 16:49:38.483481 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.483442    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bd8f2f7-c4d3-48a5-90ef-1acc084dde03-cert\") pod \"kserve-controller-manager-846cf5d849-kg2qx\" (UID: \"7bd8f2f7-c4d3-48a5-90ef-1acc084dde03\") " pod="kserve/kserve-controller-manager-846cf5d849-kg2qx"
Sep 17 16:49:38.483625 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.483533    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbhf4\" (UniqueName: \"kubernetes.io/projected/7bd8f2f7-c4d3-48a5-90ef-1acc084dde03-kube-api-access-vbhf4\") pod \"kserve-controller-manager-846cf5d849-kg2qx\" (UID: \"7bd8f2f7-c4d3-48a5-90ef-1acc084dde03\") " pod="kserve/kserve-controller-manager-846cf5d849-kg2qx"
Sep 17 16:49:38.584200 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.584166    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bd8f2f7-c4d3-48a5-90ef-1acc084dde03-cert\") pod \"kserve-controller-manager-846cf5d849-kg2qx\" (UID: \"7bd8f2f7-c4d3-48a5-90ef-1acc084dde03\") " pod="kserve/kserve-controller-manager-846cf5d849-kg2qx"
Sep 17 16:49:38.584345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.584218    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbhf4\" (UniqueName: \"kubernetes.io/projected/7bd8f2f7-c4d3-48a5-90ef-1acc084dde03-kube-api-access-vbhf4\") pod \"kserve-controller-manager-846cf5d849-kg2qx\" (UID: \"7bd8f2f7-c4d3-48a5-90ef-1acc084dde03\") " pod="kserve/kserve-controller-manager-846cf5d849-kg2qx"
Sep 17 16:49:38.586779 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.586751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bd8f2f7-c4d3-48a5-90ef-1acc084dde03-cert\") pod \"kserve-controller-manager-846cf5d849-kg2qx\" (UID: \"7bd8f2f7-c4d3-48a5-90ef-1acc084dde03\") " pod="kserve/kserve-controller-manager-846cf5d849-kg2qx"
Sep 17 16:49:38.594502 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.594477    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbhf4\" (UniqueName: \"kubernetes.io/projected/7bd8f2f7-c4d3-48a5-90ef-1acc084dde03-kube-api-access-vbhf4\") pod \"kserve-controller-manager-846cf5d849-kg2qx\" (UID: \"7bd8f2f7-c4d3-48a5-90ef-1acc084dde03\") " pod="kserve/kserve-controller-manager-846cf5d849-kg2qx"
Sep 17 16:49:38.605575 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.605542    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:49:38.685243 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.685156    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a24f1082-df9f-4f40-9308-8ba4b3508e86-cert\") pod \"a24f1082-df9f-4f40-9308-8ba4b3508e86\" (UID: \"a24f1082-df9f-4f40-9308-8ba4b3508e86\") "
Sep 17 16:49:38.685243 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.685201    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hzqc\" (UniqueName: \"kubernetes.io/projected/a24f1082-df9f-4f40-9308-8ba4b3508e86-kube-api-access-4hzqc\") pod \"a24f1082-df9f-4f40-9308-8ba4b3508e86\" (UID: \"a24f1082-df9f-4f40-9308-8ba4b3508e86\") "
Sep 17 16:49:38.687573 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.687543    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24f1082-df9f-4f40-9308-8ba4b3508e86-kube-api-access-4hzqc" (OuterVolumeSpecName: "kube-api-access-4hzqc") pod "a24f1082-df9f-4f40-9308-8ba4b3508e86" (UID: "a24f1082-df9f-4f40-9308-8ba4b3508e86"). InnerVolumeSpecName "kube-api-access-4hzqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:49:38.687739 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.687578    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a24f1082-df9f-4f40-9308-8ba4b3508e86-cert" (OuterVolumeSpecName: "cert") pod "a24f1082-df9f-4f40-9308-8ba4b3508e86" (UID: "a24f1082-df9f-4f40-9308-8ba4b3508e86"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:49:38.751768 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.751731    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-846cf5d849-kg2qx"
Sep 17 16:49:38.785704 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.785672    2571 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a24f1082-df9f-4f40-9308-8ba4b3508e86-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:49:38.785704 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:38.785702    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hzqc\" (UniqueName: \"kubernetes.io/projected/a24f1082-df9f-4f40-9308-8ba4b3508e86-kube-api-access-4hzqc\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:49:39.021388 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.021351    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-846cf5d849-kg2qx"]
Sep 17 16:49:39.026469 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:49:39.026442    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd8f2f7_c4d3_48a5_90ef_1acc084dde03.slice/crio-46db4448e613c2c90b0e8599731d559c319131d6d17fde249562a58f4e605dec WatchSource:0}: Error finding container 46db4448e613c2c90b0e8599731d559c319131d6d17fde249562a58f4e605dec: Status 404 returned error can't find the container with id 46db4448e613c2c90b0e8599731d559c319131d6d17fde249562a58f4e605dec
Sep 17 16:49:39.027838 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.027819    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 16:49:39.229966 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.229935    2571 generic.go:356] "Generic (PLEG): container finished" podID="a24f1082-df9f-4f40-9308-8ba4b3508e86" containerID="33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336" exitCode=0
Sep 17 16:49:39.230142 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.229979    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh"
Sep 17 16:49:39.230142 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.230025    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh" event={"ID":"a24f1082-df9f-4f40-9308-8ba4b3508e86","Type":"ContainerDied","Data":"33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336"}
Sep 17 16:49:39.230142 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.230093    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-846cf5d849-qg8qh" event={"ID":"a24f1082-df9f-4f40-9308-8ba4b3508e86","Type":"ContainerDied","Data":"5a81ed1425805fbe5ee4b34bdcec20b8fea2488fadd5a12af1a9141bcd46e354"}
Sep 17 16:49:39.230142 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.230127    2571 scope.go:117] "RemoveContainer" containerID="33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336"
Sep 17 16:49:39.231436 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.231395    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-846cf5d849-kg2qx" event={"ID":"7bd8f2f7-c4d3-48a5-90ef-1acc084dde03","Type":"ContainerStarted","Data":"46db4448e613c2c90b0e8599731d559c319131d6d17fde249562a58f4e605dec"}
Sep 17 16:49:39.238779 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.238759    2571 scope.go:117] "RemoveContainer" containerID="33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336"
Sep 17 16:49:39.239085 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:49:39.239062    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336\": container with ID starting with 33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336 not found: ID does not exist" containerID="33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336"
Sep 17 16:49:39.239178 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.239091    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336"} err="failed to get container status \"33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336\": rpc error: code = NotFound desc = could not find container \"33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336\": container with ID starting with 33f1b99a291f643cbb6fce25eb1e29b06334265af682e02f9a23f5dc2e16c336 not found: ID does not exist"
Sep 17 16:49:39.247909 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.247882    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-846cf5d849-qg8qh"]
Sep 17 16:49:39.251680 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:39.251657    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-846cf5d849-qg8qh"]
Sep 17 16:49:40.237889 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:40.237853    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-846cf5d849-kg2qx" event={"ID":"7bd8f2f7-c4d3-48a5-90ef-1acc084dde03","Type":"ContainerStarted","Data":"922ec85e4cf6292286c23d0b393306628b23dfbee446e2eeb2601197ac0b41a8"}
Sep 17 16:49:40.238272 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:40.237945    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-846cf5d849-kg2qx"
Sep 17 16:49:40.257144 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:40.257099    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-846cf5d849-kg2qx" podStartSLOduration=1.778520914 podStartE2EDuration="2.257082643s" totalImagesPullingTime="478.561729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:49:40.256179068 +0000 UTC m=+337.554925809" watchObservedRunningTime="2026-09-17 16:49:40.257082643 +0000 UTC m=+337.555829399"
Sep 17 16:49:40.891062 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:49:40.891025    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a24f1082-df9f-4f40-9308-8ba4b3508e86" path="/var/lib/kubelet/pods/a24f1082-df9f-4f40-9308-8ba4b3508e86/volumes"
Sep 17 16:50:11.247716 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:11.247682    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-846cf5d849-kg2qx"
Sep 17 16:50:12.518994 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.518960    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-76bk9"]
Sep 17 16:50:12.519345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.519267    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24f1082-df9f-4f40-9308-8ba4b3508e86" containerName="manager"
Sep 17 16:50:12.519345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.519279    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24f1082-df9f-4f40-9308-8ba4b3508e86" containerName="manager"
Sep 17 16:50:12.519345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.519327    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a24f1082-df9f-4f40-9308-8ba4b3508e86" containerName="manager"
Sep 17 16:50:12.523506 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.523483    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-76bk9"
Sep 17 16:50:12.526257 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.526233    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Sep 17 16:50:12.526512 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.526498    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-vkxb4\""
Sep 17 16:50:12.534799 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.534777    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-76bk9"]
Sep 17 16:50:12.538601 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.538580    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-7b966d7984-nbw44"]
Sep 17 16:50:12.541333 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.541311    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a43a361-2548-4a4e-872d-af1f34f7a713-tls-certs\") pod \"model-serving-api-7b954ffc95-76bk9\" (UID: \"8a43a361-2548-4a4e-872d-af1f34f7a713\") " pod="kserve/model-serving-api-7b954ffc95-76bk9"
Sep 17 16:50:12.541426 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.541342    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gtrc\" (UniqueName: \"kubernetes.io/projected/8a43a361-2548-4a4e-872d-af1f34f7a713-kube-api-access-6gtrc\") pod \"model-serving-api-7b954ffc95-76bk9\" (UID: \"8a43a361-2548-4a4e-872d-af1f34f7a713\") " pod="kserve/model-serving-api-7b954ffc95-76bk9"
Sep 17 16:50:12.541860 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.541843    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:12.544726 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.544704    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\""
Sep 17 16:50:12.544726 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.544719    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Sep 17 16:50:12.544854 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.544791    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-d55jj\""
Sep 17 16:50:12.552528 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.552510    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-nbw44"]
Sep 17 16:50:12.642079 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.642046    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8b7293c-7891-4902-b475-0af08c17c6f5-cert\") pod \"odh-model-controller-7b966d7984-nbw44\" (UID: \"c8b7293c-7891-4902-b475-0af08c17c6f5\") " pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:12.642293 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.642088    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a43a361-2548-4a4e-872d-af1f34f7a713-tls-certs\") pod \"model-serving-api-7b954ffc95-76bk9\" (UID: \"8a43a361-2548-4a4e-872d-af1f34f7a713\") " pod="kserve/model-serving-api-7b954ffc95-76bk9"
Sep 17 16:50:12.642293 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.642113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gtrc\" (UniqueName: \"kubernetes.io/projected/8a43a361-2548-4a4e-872d-af1f34f7a713-kube-api-access-6gtrc\") pod \"model-serving-api-7b954ffc95-76bk9\" (UID: \"8a43a361-2548-4a4e-872d-af1f34f7a713\") " pod="kserve/model-serving-api-7b954ffc95-76bk9"
Sep 17 16:50:12.642293 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.642179    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgcp2\" (UniqueName: \"kubernetes.io/projected/c8b7293c-7891-4902-b475-0af08c17c6f5-kube-api-access-cgcp2\") pod \"odh-model-controller-7b966d7984-nbw44\" (UID: \"c8b7293c-7891-4902-b475-0af08c17c6f5\") " pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:12.642293 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.642236    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b7293c-7891-4902-b475-0af08c17c6f5-metrics-certs\") pod \"odh-model-controller-7b966d7984-nbw44\" (UID: \"c8b7293c-7891-4902-b475-0af08c17c6f5\") " pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:12.645054 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.645022    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a43a361-2548-4a4e-872d-af1f34f7a713-tls-certs\") pod \"model-serving-api-7b954ffc95-76bk9\" (UID: \"8a43a361-2548-4a4e-872d-af1f34f7a713\") " pod="kserve/model-serving-api-7b954ffc95-76bk9"
Sep 17 16:50:12.651825 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.651800    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gtrc\" (UniqueName: \"kubernetes.io/projected/8a43a361-2548-4a4e-872d-af1f34f7a713-kube-api-access-6gtrc\") pod \"model-serving-api-7b954ffc95-76bk9\" (UID: \"8a43a361-2548-4a4e-872d-af1f34f7a713\") " pod="kserve/model-serving-api-7b954ffc95-76bk9"
Sep 17 16:50:12.742786 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.742748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b7293c-7891-4902-b475-0af08c17c6f5-metrics-certs\") pod \"odh-model-controller-7b966d7984-nbw44\" (UID: \"c8b7293c-7891-4902-b475-0af08c17c6f5\") " pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:12.742986 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.742813    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8b7293c-7891-4902-b475-0af08c17c6f5-cert\") pod \"odh-model-controller-7b966d7984-nbw44\" (UID: \"c8b7293c-7891-4902-b475-0af08c17c6f5\") " pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:12.742986 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.742864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgcp2\" (UniqueName: \"kubernetes.io/projected/c8b7293c-7891-4902-b475-0af08c17c6f5-kube-api-access-cgcp2\") pod \"odh-model-controller-7b966d7984-nbw44\" (UID: \"c8b7293c-7891-4902-b475-0af08c17c6f5\") " pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:12.745420 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.745397    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8b7293c-7891-4902-b475-0af08c17c6f5-cert\") pod \"odh-model-controller-7b966d7984-nbw44\" (UID: \"c8b7293c-7891-4902-b475-0af08c17c6f5\") " pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:12.745522 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.745481    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b7293c-7891-4902-b475-0af08c17c6f5-metrics-certs\") pod \"odh-model-controller-7b966d7984-nbw44\" (UID: \"c8b7293c-7891-4902-b475-0af08c17c6f5\") " pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:12.752896 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.752869    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgcp2\" (UniqueName: \"kubernetes.io/projected/c8b7293c-7891-4902-b475-0af08c17c6f5-kube-api-access-cgcp2\") pod \"odh-model-controller-7b966d7984-nbw44\" (UID: \"c8b7293c-7891-4902-b475-0af08c17c6f5\") " pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:12.833758 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.833654    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-76bk9"
Sep 17 16:50:12.852238 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:12.852205    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:13.111507 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:13.111480    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-76bk9"]
Sep 17 16:50:13.114050 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:50:13.114020    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a43a361_2548_4a4e_872d_af1f34f7a713.slice/crio-bc52c78f86ca6f610deae1713d3585a8effb6961b03a91d12273ec4bb8ca5229 WatchSource:0}: Error finding container bc52c78f86ca6f610deae1713d3585a8effb6961b03a91d12273ec4bb8ca5229: Status 404 returned error can't find the container with id bc52c78f86ca6f610deae1713d3585a8effb6961b03a91d12273ec4bb8ca5229
Sep 17 16:50:13.139809 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:13.139784    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-nbw44"]
Sep 17 16:50:13.141832 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:50:13.141810    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b7293c_7891_4902_b475_0af08c17c6f5.slice/crio-b913173abd090151fcf90256a9299dd72976201ff2304b249195349e010167c5 WatchSource:0}: Error finding container b913173abd090151fcf90256a9299dd72976201ff2304b249195349e010167c5: Status 404 returned error can't find the container with id b913173abd090151fcf90256a9299dd72976201ff2304b249195349e010167c5
Sep 17 16:50:13.366663 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:13.366542    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-76bk9" event={"ID":"8a43a361-2548-4a4e-872d-af1f34f7a713","Type":"ContainerStarted","Data":"bc52c78f86ca6f610deae1713d3585a8effb6961b03a91d12273ec4bb8ca5229"}
Sep 17 16:50:13.367734 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:13.367710    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-nbw44" event={"ID":"c8b7293c-7891-4902-b475-0af08c17c6f5","Type":"ContainerStarted","Data":"b913173abd090151fcf90256a9299dd72976201ff2304b249195349e010167c5"}
Sep 17 16:50:17.387237 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:17.387199    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-76bk9" event={"ID":"8a43a361-2548-4a4e-872d-af1f34f7a713","Type":"ContainerStarted","Data":"a88367664cd83853ee8cde6ba7df3d5db732da79e860a16ca1c19af1f75b2c13"}
Sep 17 16:50:17.387721 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:17.387294    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-76bk9"
Sep 17 16:50:17.388887 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:17.388853    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-nbw44" event={"ID":"c8b7293c-7891-4902-b475-0af08c17c6f5","Type":"ContainerStarted","Data":"29f02233389d6afed31be6f1ee441381f3c3dc07fcd0a2674a29abbcd145c871"}
Sep 17 16:50:17.389026 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:17.389010    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:17.408617 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:17.408551    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-76bk9" podStartSLOduration=1.9011905850000002 podStartE2EDuration="5.408535518s" totalImagesPullingTime="3.507344933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:50:17.408175688 +0000 UTC m=+374.706922426" watchObservedRunningTime="2026-09-17 16:50:17.408535518 +0000 UTC m=+374.707282257"
Sep 17 16:50:17.428126 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:17.428071    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-7b966d7984-nbw44" podStartSLOduration=1.902885844 podStartE2EDuration="5.428050335s" totalImagesPullingTime="3.525164491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:50:17.426845732 +0000 UTC m=+374.725592471" watchObservedRunningTime="2026-09-17 16:50:17.428050335 +0000 UTC m=+374.726797072"
Sep 17 16:50:28.394420 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:28.394388    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-7b966d7984-nbw44"
Sep 17 16:50:28.396433 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:50:28.396409    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-76bk9"
Sep 17 16:52:00.308206 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.308166    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"]
Sep 17 16:52:00.311736 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.311716    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.315775 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.315747    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Sep 17 16:52:00.315917 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.315823    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 16:52:00.315917 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.315891    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 16:52:00.315917 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.315890    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Sep 17 16:52:00.316076 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.315961    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-77dxf\""
Sep 17 16:52:00.316878 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.316860    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 16:52:00.316878 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.316862    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 16:52:00.325204 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.325172    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"]
Sep 17 16:52:00.388171 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.388138    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edc74e49-9763-4b49-8e58-7a3cf148400c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.388372 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.388176    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8dvw\" (UniqueName: \"kubernetes.io/projected/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-api-access-s8dvw\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.388372 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.388213    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edc74e49-9763-4b49-8e58-7a3cf148400c-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.388372 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.388256    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.388372 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.388286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.477693 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.477656    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"]
Sep 17 16:52:00.481340 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.481319    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:00.484487 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.484456    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-eb976-kube-rbac-proxy-sar-config\""
Sep 17 16:52:00.484784 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.484764    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-eb976-predictor-serving-cert\""
Sep 17 16:52:00.488899 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.488868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edc74e49-9763-4b49-8e58-7a3cf148400c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.489015 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.488911    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8dvw\" (UniqueName: \"kubernetes.io/projected/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-api-access-s8dvw\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.489015 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.488962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edc74e49-9763-4b49-8e58-7a3cf148400c-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.489015 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.489009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.489166 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.489031    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.489454 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.489435    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edc74e49-9763-4b49-8e58-7a3cf148400c-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.489836 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.489818    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.490024 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.490003    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.491548 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.491531    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edc74e49-9763-4b49-8e58-7a3cf148400c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.495187 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.495166    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"]
Sep 17 16:52:00.498525 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.498501    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8dvw\" (UniqueName: \"kubernetes.io/projected/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-api-access-s8dvw\") pod \"isvc-sklearn-graph-1-predictor-75998957b8-hsmvn\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.589924 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.589830    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") " pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:00.589924 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.589896    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dnc9\" (UniqueName: \"kubernetes.io/projected/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-api-access-9dnc9\") pod \"success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") " pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:00.590115 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.589974    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9808b70d-67f5-462c-8992-41aaf964f1d1-proxy-tls\") pod \"success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") " pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:00.621794 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.621762    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:00.690506 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.690473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") " pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:00.690689 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.690535    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dnc9\" (UniqueName: \"kubernetes.io/projected/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-api-access-9dnc9\") pod \"success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") " pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:00.690689 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.690579    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9808b70d-67f5-462c-8992-41aaf964f1d1-proxy-tls\") pod \"success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") " pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:00.691324 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.691296    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") " pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:00.694233 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.694182    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9808b70d-67f5-462c-8992-41aaf964f1d1-proxy-tls\") pod \"success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") " pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:00.703749 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.703698    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dnc9\" (UniqueName: \"kubernetes.io/projected/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-api-access-9dnc9\") pod \"success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") " pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:00.792000 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.791954    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:00.899575 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:00.899549    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"]
Sep 17 16:52:00.902742 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:52:00.902692    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc74e49_9763_4b49_8e58_7a3cf148400c.slice/crio-b31fcfc35fa5648ca6e090d74e6ce5722ec49a9ae8ddfa7c8d1a9c53b9b159f0 WatchSource:0}: Error finding container b31fcfc35fa5648ca6e090d74e6ce5722ec49a9ae8ddfa7c8d1a9c53b9b159f0: Status 404 returned error can't find the container with id b31fcfc35fa5648ca6e090d74e6ce5722ec49a9ae8ddfa7c8d1a9c53b9b159f0
Sep 17 16:52:01.076015 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:01.075983    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"]
Sep 17 16:52:01.078642 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:52:01.078593    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9808b70d_67f5_462c_8992_41aaf964f1d1.slice/crio-29252b7c584592c6c05eef983923ac107a8c8e899af77977900fc4e817039c62 WatchSource:0}: Error finding container 29252b7c584592c6c05eef983923ac107a8c8e899af77977900fc4e817039c62: Status 404 returned error can't find the container with id 29252b7c584592c6c05eef983923ac107a8c8e899af77977900fc4e817039c62
Sep 17 16:52:01.803519 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:01.803469    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" event={"ID":"edc74e49-9763-4b49-8e58-7a3cf148400c","Type":"ContainerStarted","Data":"b31fcfc35fa5648ca6e090d74e6ce5722ec49a9ae8ddfa7c8d1a9c53b9b159f0"}
Sep 17 16:52:01.805743 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:01.805695    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" event={"ID":"9808b70d-67f5-462c-8992-41aaf964f1d1","Type":"ContainerStarted","Data":"29252b7c584592c6c05eef983923ac107a8c8e899af77977900fc4e817039c62"}
Sep 17 16:52:14.544831 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:14.544805    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 16:52:14.896913 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:14.896824    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" event={"ID":"9808b70d-67f5-462c-8992-41aaf964f1d1","Type":"ContainerStarted","Data":"82e9f1d4cf73b536fdafd4d7a46aafac8f2e3debd3fb2038de516614a38950f8"}
Sep 17 16:52:14.898587 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:14.898550    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" event={"ID":"edc74e49-9763-4b49-8e58-7a3cf148400c","Type":"ContainerStarted","Data":"58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab"}
Sep 17 16:52:17.915908 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:17.915868    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" event={"ID":"9808b70d-67f5-462c-8992-41aaf964f1d1","Type":"ContainerStarted","Data":"a52723499c2f5e2062eec011a5e500cea5867a9beabe4afb9653d75637f23589"}
Sep 17 16:52:17.916322 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:17.915978    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:17.944236 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:17.944179    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" podStartSLOduration=2.086364499 podStartE2EDuration="17.944162115s" totalImagesPullingTime="15.857797616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:52:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:52:17.941356746 +0000 UTC m=+495.240103487" watchObservedRunningTime="2026-09-17 16:52:17.944162115 +0000 UTC m=+495.242908854"
Sep 17 16:52:18.921520 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:18.921480    2571 generic.go:356] "Generic (PLEG): container finished" podID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerID="58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab" exitCode=0
Sep 17 16:52:18.921975 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:18.921550    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" event={"ID":"edc74e49-9763-4b49-8e58-7a3cf148400c","Type":"ContainerDied","Data":"58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab"}
Sep 17 16:52:18.921975 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:18.921807    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:18.923427 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:18.923396    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:52:19.927409 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:19.927356    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:52:24.932157 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:24.932124    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:52:24.932674 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:24.932650    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:52:25.961619 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:25.961584    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" event={"ID":"edc74e49-9763-4b49-8e58-7a3cf148400c","Type":"ContainerStarted","Data":"4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c"}
Sep 17 16:52:25.962189 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:25.961678    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" event={"ID":"edc74e49-9763-4b49-8e58-7a3cf148400c","Type":"ContainerStarted","Data":"b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b"}
Sep 17 16:52:25.962189 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:25.961973    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:25.962189 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:25.962144    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:25.963394 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:25.963370    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused"
Sep 17 16:52:25.987158 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:25.987104    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podStartSLOduration=2.036367247 podStartE2EDuration="25.987089001s" totalImagesPullingTime="19.696349528s" totalInitContainerRuntime="4.254372226s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:52:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:52:25.985454056 +0000 UTC m=+503.284200840" watchObservedRunningTime="2026-09-17 16:52:25.987089001 +0000 UTC m=+503.285835741"
Sep 17 16:52:26.966222 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:26.966183    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused"
Sep 17 16:52:31.971475 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:31.971442    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:52:31.972018 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:31.971989    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused"
Sep 17 16:52:34.932653 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:34.932592    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:52:41.972559 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:41.972521    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused"
Sep 17 16:52:44.932838 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:44.932754    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:52:51.972137 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:51.972094    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused"
Sep 17 16:52:54.933480 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:52:54.933431    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:53:01.972660 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:01.972598    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused"
Sep 17 16:53:04.933825 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:04.933790    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:53:11.972223 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:11.972175    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused"
Sep 17 16:53:21.972708 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:21.972665    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused"
Sep 17 16:53:30.654580 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.654542    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"]
Sep 17 16:53:30.655039 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.654789    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kserve-container" containerID="cri-o://82e9f1d4cf73b536fdafd4d7a46aafac8f2e3debd3fb2038de516614a38950f8" gracePeriod=30
Sep 17 16:53:30.655039 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.654844    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kube-rbac-proxy" containerID="cri-o://a52723499c2f5e2062eec011a5e500cea5867a9beabe4afb9653d75637f23589" gracePeriod=30
Sep 17 16:53:30.800558 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.800520    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"]
Sep 17 16:53:30.803879 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.803862    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:30.807580 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.807554    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-b5187-predictor-serving-cert\""
Sep 17 16:53:30.808405 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.808383    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-b5187-kube-rbac-proxy-sar-config\""
Sep 17 16:53:30.816765 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.816743    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"]
Sep 17 16:53:30.863525 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.863495    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b5187-predictor-59c96b8b97-nzkvb\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") " pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:30.863726 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.863540    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bntm\" (UniqueName: \"kubernetes.io/projected/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-api-access-8bntm\") pod \"success-200-isvc-b5187-predictor-59c96b8b97-nzkvb\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") " pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:30.863726 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.863591    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26f6fe1e-88f6-4063-ab18-e15376f37b65-proxy-tls\") pod \"success-200-isvc-b5187-predictor-59c96b8b97-nzkvb\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") " pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:30.964135 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.964058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b5187-predictor-59c96b8b97-nzkvb\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") " pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:30.964135 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.964112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bntm\" (UniqueName: \"kubernetes.io/projected/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-api-access-8bntm\") pod \"success-200-isvc-b5187-predictor-59c96b8b97-nzkvb\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") " pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:30.964348 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.964169    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26f6fe1e-88f6-4063-ab18-e15376f37b65-proxy-tls\") pod \"success-200-isvc-b5187-predictor-59c96b8b97-nzkvb\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") " pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:30.964484 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:53:30.964462    2571 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-b5187-predictor-serving-cert: secret "success-200-isvc-b5187-predictor-serving-cert" not found
Sep 17 16:53:30.964566 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:53:30.964537    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f6fe1e-88f6-4063-ab18-e15376f37b65-proxy-tls podName:26f6fe1e-88f6-4063-ab18-e15376f37b65 nodeName:}" failed. No retries permitted until 2026-09-17 16:53:31.464515609 +0000 UTC m=+568.763262346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/26f6fe1e-88f6-4063-ab18-e15376f37b65-proxy-tls") pod "success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" (UID: "26f6fe1e-88f6-4063-ab18-e15376f37b65") : secret "success-200-isvc-b5187-predictor-serving-cert" not found
Sep 17 16:53:30.964921 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.964900    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b5187-predictor-59c96b8b97-nzkvb\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") " pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:30.982845 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:30.982815    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bntm\" (UniqueName: \"kubernetes.io/projected/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-api-access-8bntm\") pod \"success-200-isvc-b5187-predictor-59c96b8b97-nzkvb\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") " pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:31.247873 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:31.247838    2571 generic.go:356] "Generic (PLEG): container finished" podID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerID="a52723499c2f5e2062eec011a5e500cea5867a9beabe4afb9653d75637f23589" exitCode=2
Sep 17 16:53:31.248053 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:31.247897    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" event={"ID":"9808b70d-67f5-462c-8992-41aaf964f1d1","Type":"ContainerDied","Data":"a52723499c2f5e2062eec011a5e500cea5867a9beabe4afb9653d75637f23589"}
Sep 17 16:53:31.468811 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:31.468756    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26f6fe1e-88f6-4063-ab18-e15376f37b65-proxy-tls\") pod \"success-200-isvc-b5187-predictor-59c96b8b97-nzkvb\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") " pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:31.471416 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:31.471393    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26f6fe1e-88f6-4063-ab18-e15376f37b65-proxy-tls\") pod \"success-200-isvc-b5187-predictor-59c96b8b97-nzkvb\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") " pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:31.713786 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:31.713685    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:31.972485 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:31.972440    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused"
Sep 17 16:53:31.999331 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:31.999305    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"]
Sep 17 16:53:32.001673 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:53:32.001646    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f6fe1e_88f6_4063_ab18_e15376f37b65.slice/crio-b01f50055b814e4d29959248a835b1f6c1bcec3610cd683c877d0998af981eb7 WatchSource:0}: Error finding container b01f50055b814e4d29959248a835b1f6c1bcec3610cd683c877d0998af981eb7: Status 404 returned error can't find the container with id b01f50055b814e4d29959248a835b1f6c1bcec3610cd683c877d0998af981eb7
Sep 17 16:53:32.255036 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:32.254930    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" event={"ID":"26f6fe1e-88f6-4063-ab18-e15376f37b65","Type":"ContainerStarted","Data":"f0cebffdd35beb91d26870955f9bb9b7db1a38faf67237d996da4a6cc66e93af"}
Sep 17 16:53:32.255036 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:32.255011    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" event={"ID":"26f6fe1e-88f6-4063-ab18-e15376f37b65","Type":"ContainerStarted","Data":"bac6ba803f0baaa883748784b96ffae5980d79adb3ccae51556652a101e866f3"}
Sep 17 16:53:32.255272 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:32.255044    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" event={"ID":"26f6fe1e-88f6-4063-ab18-e15376f37b65","Type":"ContainerStarted","Data":"b01f50055b814e4d29959248a835b1f6c1bcec3610cd683c877d0998af981eb7"}
Sep 17 16:53:32.255272 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:32.255228    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:32.284481 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:32.284416    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" podStartSLOduration=2.284399146 podStartE2EDuration="2.284399146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:53:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:53:32.283537266 +0000 UTC m=+569.582284005" watchObservedRunningTime="2026-09-17 16:53:32.284399146 +0000 UTC m=+569.583145885"
Sep 17 16:53:33.261025 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:33.260988    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:33.262749 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:33.262714    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:53:34.268268 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.268227    2571 generic.go:356] "Generic (PLEG): container finished" podID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerID="82e9f1d4cf73b536fdafd4d7a46aafac8f2e3debd3fb2038de516614a38950f8" exitCode=0
Sep 17 16:53:34.268643 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.268277    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" event={"ID":"9808b70d-67f5-462c-8992-41aaf964f1d1","Type":"ContainerDied","Data":"82e9f1d4cf73b536fdafd4d7a46aafac8f2e3debd3fb2038de516614a38950f8"}
Sep 17 16:53:34.268791 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.268770    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:53:34.315975 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.315907    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:53:34.396010 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.395960    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9808b70d-67f5-462c-8992-41aaf964f1d1-proxy-tls\") pod \"9808b70d-67f5-462c-8992-41aaf964f1d1\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") "
Sep 17 16:53:34.396211 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.396023    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dnc9\" (UniqueName: \"kubernetes.io/projected/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-api-access-9dnc9\") pod \"9808b70d-67f5-462c-8992-41aaf964f1d1\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") "
Sep 17 16:53:34.396211 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.396097    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-rbac-proxy-sar-config\") pod \"9808b70d-67f5-462c-8992-41aaf964f1d1\" (UID: \"9808b70d-67f5-462c-8992-41aaf964f1d1\") "
Sep 17 16:53:34.396495 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.396460    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9808b70d-67f5-462c-8992-41aaf964f1d1" (UID: "9808b70d-67f5-462c-8992-41aaf964f1d1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:53:34.398382 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.398347    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9808b70d-67f5-462c-8992-41aaf964f1d1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9808b70d-67f5-462c-8992-41aaf964f1d1" (UID: "9808b70d-67f5-462c-8992-41aaf964f1d1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:53:34.398491 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.398409    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-api-access-9dnc9" (OuterVolumeSpecName: "kube-api-access-9dnc9") pod "9808b70d-67f5-462c-8992-41aaf964f1d1" (UID: "9808b70d-67f5-462c-8992-41aaf964f1d1"). InnerVolumeSpecName "kube-api-access-9dnc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:53:34.496985 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.496924    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9808b70d-67f5-462c-8992-41aaf964f1d1-proxy-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:53:34.496985 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.496978    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dnc9\" (UniqueName: \"kubernetes.io/projected/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-api-access-9dnc9\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:53:34.496985 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:34.496992    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9808b70d-67f5-462c-8992-41aaf964f1d1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:53:35.274748 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:35.274721    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"
Sep 17 16:53:35.274748 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:35.274735    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx" event={"ID":"9808b70d-67f5-462c-8992-41aaf964f1d1","Type":"ContainerDied","Data":"29252b7c584592c6c05eef983923ac107a8c8e899af77977900fc4e817039c62"}
Sep 17 16:53:35.275237 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:35.274802    2571 scope.go:117] "RemoveContainer" containerID="a52723499c2f5e2062eec011a5e500cea5867a9beabe4afb9653d75637f23589"
Sep 17 16:53:35.282793 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:35.282775    2571 scope.go:117] "RemoveContainer" containerID="82e9f1d4cf73b536fdafd4d7a46aafac8f2e3debd3fb2038de516614a38950f8"
Sep 17 16:53:35.292266 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:35.292242    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"]
Sep 17 16:53:35.296059 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:35.296036    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eb976-predictor-5c8648d4bf-v8nkx"]
Sep 17 16:53:36.891068 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:36.891034    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" path="/var/lib/kubelet/pods/9808b70d-67f5-462c-8992-41aaf964f1d1/volumes"
Sep 17 16:53:37.887178 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:37.887123    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused"
Sep 17 16:53:39.272952 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:39.272919    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:53:39.273582 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:39.273551    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:53:47.888688 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:47.888655    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:53:49.273655 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:49.273592    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:53:59.273482 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:53:59.273442    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:54:04.765995 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:04.765964    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 16:54:04.767143 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:04.767122    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 16:54:09.273650 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:09.273582    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:54:19.275300 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:19.275258    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 16:54:20.917792 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:20.917708    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"]
Sep 17 16:54:20.918431 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:20.918074    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container" containerID="cri-o://b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b" gracePeriod=30
Sep 17 16:54:20.918431 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:20.918073    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kube-rbac-proxy" containerID="cri-o://4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c" gracePeriod=30
Sep 17 16:54:21.008616 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.008577    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"]
Sep 17 16:54:21.008926 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.008913    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kube-rbac-proxy"
Sep 17 16:54:21.008926 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.008928    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kube-rbac-proxy"
Sep 17 16:54:21.009003 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.008944    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kserve-container"
Sep 17 16:54:21.009003 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.008949    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kserve-container"
Sep 17 16:54:21.009060 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.009007    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kube-rbac-proxy"
Sep 17 16:54:21.009060 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.009017    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9808b70d-67f5-462c-8992-41aaf964f1d1" containerName="kserve-container"
Sep 17 16:54:21.012123 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.012100    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.014610 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.014585    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-f3946-predictor-serving-cert\""
Sep 17 16:54:21.014610 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.014602    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-f3946-kube-rbac-proxy-sar-config\""
Sep 17 16:54:21.025535 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.025504    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"]
Sep 17 16:54:21.068838 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.068802    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-proxy-tls\") pod \"success-200-isvc-f3946-predictor-8f678845f-54nlw\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") " pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.069011 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.068947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f3946-predictor-8f678845f-54nlw\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") " pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.069011 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.069007    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ws7x\" (UniqueName: \"kubernetes.io/projected/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-api-access-8ws7x\") pod \"success-200-isvc-f3946-predictor-8f678845f-54nlw\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") " pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.169817 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.169722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f3946-predictor-8f678845f-54nlw\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") " pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.169817 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.169774    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ws7x\" (UniqueName: \"kubernetes.io/projected/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-api-access-8ws7x\") pod \"success-200-isvc-f3946-predictor-8f678845f-54nlw\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") " pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.169817 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.169819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-proxy-tls\") pod \"success-200-isvc-f3946-predictor-8f678845f-54nlw\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") " pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.170098 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:54:21.169931    2571 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-f3946-predictor-serving-cert: secret "success-200-isvc-f3946-predictor-serving-cert" not found
Sep 17 16:54:21.170098 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:54:21.170003    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-proxy-tls podName:2fe0e37d-3a22-46e6-816e-c10daaa1a9c9 nodeName:}" failed. No retries permitted until 2026-09-17 16:54:21.66998169 +0000 UTC m=+618.968728421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-proxy-tls") pod "success-200-isvc-f3946-predictor-8f678845f-54nlw" (UID: "2fe0e37d-3a22-46e6-816e-c10daaa1a9c9") : secret "success-200-isvc-f3946-predictor-serving-cert" not found
Sep 17 16:54:21.170429 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.170404    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f3946-predictor-8f678845f-54nlw\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") " pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.182436 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.182383    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ws7x\" (UniqueName: \"kubernetes.io/projected/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-api-access-8ws7x\") pod \"success-200-isvc-f3946-predictor-8f678845f-54nlw\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") " pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.477333 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.477298    2571 generic.go:356] "Generic (PLEG): container finished" podID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerID="4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c" exitCode=2
Sep 17 16:54:21.477507 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.477353    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" event={"ID":"edc74e49-9763-4b49-8e58-7a3cf148400c","Type":"ContainerDied","Data":"4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c"}
Sep 17 16:54:21.674724 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.674673    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-proxy-tls\") pod \"success-200-isvc-f3946-predictor-8f678845f-54nlw\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") " pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.677287 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.677265    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-proxy-tls\") pod \"success-200-isvc-f3946-predictor-8f678845f-54nlw\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") " pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.922071 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.921982    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:21.967075 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:21.967031    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.21:8643/healthz\": dial tcp 10.134.0.21:8643: connect: connection refused"
Sep 17 16:54:22.202598 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:22.202571    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"]
Sep 17 16:54:22.205301 ip-10-0-143-228 kubenswrapper[2571]: W0917 16:54:22.205274    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe0e37d_3a22_46e6_816e_c10daaa1a9c9.slice/crio-f97a4bb541e6a5a880742329964468b41e616fd84ed17fa757014b54656eb7d0 WatchSource:0}: Error finding container f97a4bb541e6a5a880742329964468b41e616fd84ed17fa757014b54656eb7d0: Status 404 returned error can't find the container with id f97a4bb541e6a5a880742329964468b41e616fd84ed17fa757014b54656eb7d0
Sep 17 16:54:22.483139 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:22.483094    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" event={"ID":"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9","Type":"ContainerStarted","Data":"ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f"}
Sep 17 16:54:22.483345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:22.483167    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" event={"ID":"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9","Type":"ContainerStarted","Data":"7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e"}
Sep 17 16:54:22.483345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:22.483198    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:22.483345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:22.483229    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" event={"ID":"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9","Type":"ContainerStarted","Data":"f97a4bb541e6a5a880742329964468b41e616fd84ed17fa757014b54656eb7d0"}
Sep 17 16:54:22.483345 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:22.483301    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:22.484682 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:22.484651    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:54:22.503353 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:22.503297    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" podStartSLOduration=2.503255042 podStartE2EDuration="2.503255042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:54:22.502886961 +0000 UTC m=+619.801633700" watchObservedRunningTime="2026-09-17 16:54:22.503255042 +0000 UTC m=+619.802001780"
Sep 17 16:54:23.488379 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:23.488339    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:54:25.960404 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:25.960378    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:54:26.013685 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.013576    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edc74e49-9763-4b49-8e58-7a3cf148400c-proxy-tls\") pod \"edc74e49-9763-4b49-8e58-7a3cf148400c\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") "
Sep 17 16:54:26.013685 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.013614    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-rbac-proxy-sar-config\") pod \"edc74e49-9763-4b49-8e58-7a3cf148400c\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") "
Sep 17 16:54:26.013685 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.013676    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edc74e49-9763-4b49-8e58-7a3cf148400c-kserve-provision-location\") pod \"edc74e49-9763-4b49-8e58-7a3cf148400c\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") "
Sep 17 16:54:26.013960 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.013706    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8dvw\" (UniqueName: \"kubernetes.io/projected/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-api-access-s8dvw\") pod \"edc74e49-9763-4b49-8e58-7a3cf148400c\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") "
Sep 17 16:54:26.013960 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.013737    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-cabundle-cert\") pod \"edc74e49-9763-4b49-8e58-7a3cf148400c\" (UID: \"edc74e49-9763-4b49-8e58-7a3cf148400c\") "
Sep 17 16:54:26.014093 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.014064    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edc74e49-9763-4b49-8e58-7a3cf148400c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "edc74e49-9763-4b49-8e58-7a3cf148400c" (UID: "edc74e49-9763-4b49-8e58-7a3cf148400c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:54:26.014147 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.014104    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "edc74e49-9763-4b49-8e58-7a3cf148400c" (UID: "edc74e49-9763-4b49-8e58-7a3cf148400c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:54:26.014147 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.014128    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "edc74e49-9763-4b49-8e58-7a3cf148400c" (UID: "edc74e49-9763-4b49-8e58-7a3cf148400c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:54:26.015992 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.015963    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-api-access-s8dvw" (OuterVolumeSpecName: "kube-api-access-s8dvw") pod "edc74e49-9763-4b49-8e58-7a3cf148400c" (UID: "edc74e49-9763-4b49-8e58-7a3cf148400c"). InnerVolumeSpecName "kube-api-access-s8dvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:54:26.015992 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.015971    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc74e49-9763-4b49-8e58-7a3cf148400c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "edc74e49-9763-4b49-8e58-7a3cf148400c" (UID: "edc74e49-9763-4b49-8e58-7a3cf148400c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:54:26.115164 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.115127    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edc74e49-9763-4b49-8e58-7a3cf148400c-proxy-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:54:26.115164 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.115154    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:54:26.115164 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.115163    2571 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edc74e49-9763-4b49-8e58-7a3cf148400c-kserve-provision-location\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:54:26.115164 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.115173    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8dvw\" (UniqueName: \"kubernetes.io/projected/edc74e49-9763-4b49-8e58-7a3cf148400c-kube-api-access-s8dvw\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:54:26.115422 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.115183    2571 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/edc74e49-9763-4b49-8e58-7a3cf148400c-cabundle-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 16:54:26.503442 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.503403    2571 generic.go:356] "Generic (PLEG): container finished" podID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerID="b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b" exitCode=0
Sep 17 16:54:26.503608 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.503457    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"
Sep 17 16:54:26.503608 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.503502    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" event={"ID":"edc74e49-9763-4b49-8e58-7a3cf148400c","Type":"ContainerDied","Data":"b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b"}
Sep 17 16:54:26.503608 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.503566    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn" event={"ID":"edc74e49-9763-4b49-8e58-7a3cf148400c","Type":"ContainerDied","Data":"b31fcfc35fa5648ca6e090d74e6ce5722ec49a9ae8ddfa7c8d1a9c53b9b159f0"}
Sep 17 16:54:26.503608 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.503596    2571 scope.go:117] "RemoveContainer" containerID="4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c"
Sep 17 16:54:26.513687 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.513611    2571 scope.go:117] "RemoveContainer" containerID="b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b"
Sep 17 16:54:26.522163 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.522144    2571 scope.go:117] "RemoveContainer" containerID="58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab"
Sep 17 16:54:26.526811 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.526787    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"]
Sep 17 16:54:26.530103 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.530085    2571 scope.go:117] "RemoveContainer" containerID="4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c"
Sep 17 16:54:26.530433 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:54:26.530412    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c\": container with ID starting with 4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c not found: ID does not exist" containerID="4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c"
Sep 17 16:54:26.530479 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.530445    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c"} err="failed to get container status \"4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c\": rpc error: code = NotFound desc = could not find container \"4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c\": container with ID starting with 4868a470374f00cefd303292f7d172442c9afb2464f81d6ac6de989ab327ce2c not found: ID does not exist"
Sep 17 16:54:26.530479 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.530465    2571 scope.go:117] "RemoveContainer" containerID="b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b"
Sep 17 16:54:26.530751 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:54:26.530733    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b\": container with ID starting with b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b not found: ID does not exist" containerID="b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b"
Sep 17 16:54:26.530802 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.530757    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b"} err="failed to get container status \"b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b\": rpc error: code = NotFound desc = could not find container \"b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b\": container with ID starting with b37acd732fa232b9d539c7ddb874c5c0831ea4cb1445628c5cb4b541ef0f7f7b not found: ID does not exist"
Sep 17 16:54:26.530802 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.530773    2571 scope.go:117] "RemoveContainer" containerID="58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab"
Sep 17 16:54:26.531030 ip-10-0-143-228 kubenswrapper[2571]: E0917 16:54:26.531013    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab\": container with ID starting with 58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab not found: ID does not exist" containerID="58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab"
Sep 17 16:54:26.531081 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.531037    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab"} err="failed to get container status \"58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab\": rpc error: code = NotFound desc = could not find container \"58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab\": container with ID starting with 58224690cdf355a790337c9c7af14563d23203c4fa580bba4e28917866661eab not found: ID does not exist"
Sep 17 16:54:26.535458 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.535436    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-75998957b8-hsmvn"]
Sep 17 16:54:26.894968 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:26.894893    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" path="/var/lib/kubelet/pods/edc74e49-9763-4b49-8e58-7a3cf148400c/volumes"
Sep 17 16:54:28.493145 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:28.493116    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:54:28.495439 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:28.493759    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:54:38.494330 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:38.494288    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:54:48.494504 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:48.494459    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:54:58.494436 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:54:58.494394    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:55:08.494419 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:55:08.494390    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 16:59:04.791534 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:59:04.791461    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 16:59:04.794160 ip-10-0-143-228 kubenswrapper[2571]: I0917 16:59:04.794138    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:02:45.382525 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.382491    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"]
Sep 17 17:02:45.385154 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.382728    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kserve-container" containerID="cri-o://bac6ba803f0baaa883748784b96ffae5980d79adb3ccae51556652a101e866f3" gracePeriod=30
Sep 17 17:02:45.385154 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.382837    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kube-rbac-proxy" containerID="cri-o://f0cebffdd35beb91d26870955f9bb9b7db1a38faf67237d996da4a6cc66e93af" gracePeriod=30
Sep 17 17:02:45.524500 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.524460    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"]
Sep 17 17:02:45.524892 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.524871    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kube-rbac-proxy"
Sep 17 17:02:45.524968 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.524896    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kube-rbac-proxy"
Sep 17 17:02:45.524968 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.524920    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="storage-initializer"
Sep 17 17:02:45.524968 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.524929    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="storage-initializer"
Sep 17 17:02:45.524968 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.524942    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container"
Sep 17 17:02:45.524968 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.524949    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container"
Sep 17 17:02:45.525121 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.525022    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kube-rbac-proxy"
Sep 17 17:02:45.525121 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.525034    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="edc74e49-9763-4b49-8e58-7a3cf148400c" containerName="kserve-container"
Sep 17 17:02:45.527827 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.527812    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:45.530478 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.530455    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-93f48-kube-rbac-proxy-sar-config\""
Sep 17 17:02:45.530478 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.530477    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-93f48-predictor-serving-cert\""
Sep 17 17:02:45.539674 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.539619    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"]
Sep 17 17:02:45.577558 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.577529    2571 generic.go:356] "Generic (PLEG): container finished" podID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerID="f0cebffdd35beb91d26870955f9bb9b7db1a38faf67237d996da4a6cc66e93af" exitCode=2
Sep 17 17:02:45.577751 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.577603    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" event={"ID":"26f6fe1e-88f6-4063-ab18-e15376f37b65","Type":"ContainerDied","Data":"f0cebffdd35beb91d26870955f9bb9b7db1a38faf67237d996da4a6cc66e93af"}
Sep 17 17:02:45.691174 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.691095    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-93f48-predictor-695cd6968c-m8g6m\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") " pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:45.691174 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.691162    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3fb0e18a-973b-42ea-8f06-c99080d22768-proxy-tls\") pod \"success-200-isvc-93f48-predictor-695cd6968c-m8g6m\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") " pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:45.691357 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.691189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns6tv\" (UniqueName: \"kubernetes.io/projected/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-api-access-ns6tv\") pod \"success-200-isvc-93f48-predictor-695cd6968c-m8g6m\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") " pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:45.791805 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.791771    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3fb0e18a-973b-42ea-8f06-c99080d22768-proxy-tls\") pod \"success-200-isvc-93f48-predictor-695cd6968c-m8g6m\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") " pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:45.791977 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.791814    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns6tv\" (UniqueName: \"kubernetes.io/projected/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-api-access-ns6tv\") pod \"success-200-isvc-93f48-predictor-695cd6968c-m8g6m\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") " pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:45.791977 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.791850    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-93f48-predictor-695cd6968c-m8g6m\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") " pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:45.791977 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:02:45.791936    2571 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-93f48-predictor-serving-cert: secret "success-200-isvc-93f48-predictor-serving-cert" not found
Sep 17 17:02:45.792112 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:02:45.792002    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fb0e18a-973b-42ea-8f06-c99080d22768-proxy-tls podName:3fb0e18a-973b-42ea-8f06-c99080d22768 nodeName:}" failed. No retries permitted until 2026-09-17 17:02:46.291984504 +0000 UTC m=+1123.590731220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3fb0e18a-973b-42ea-8f06-c99080d22768-proxy-tls") pod "success-200-isvc-93f48-predictor-695cd6968c-m8g6m" (UID: "3fb0e18a-973b-42ea-8f06-c99080d22768") : secret "success-200-isvc-93f48-predictor-serving-cert" not found
Sep 17 17:02:45.792539 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.792522    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-93f48-predictor-695cd6968c-m8g6m\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") " pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:45.801085 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:45.801061    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns6tv\" (UniqueName: \"kubernetes.io/projected/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-api-access-ns6tv\") pod \"success-200-isvc-93f48-predictor-695cd6968c-m8g6m\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") " pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:46.296271 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:46.296235    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3fb0e18a-973b-42ea-8f06-c99080d22768-proxy-tls\") pod \"success-200-isvc-93f48-predictor-695cd6968c-m8g6m\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") " pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:46.298770 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:46.298748    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3fb0e18a-973b-42ea-8f06-c99080d22768-proxy-tls\") pod \"success-200-isvc-93f48-predictor-695cd6968c-m8g6m\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") " pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:46.438739 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:46.438702    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:46.711123 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:46.711072    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"]
Sep 17 17:02:46.713814 ip-10-0-143-228 kubenswrapper[2571]: W0917 17:02:46.713772    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb0e18a_973b_42ea_8f06_c99080d22768.slice/crio-3647049eeb36cc5252eb211c83c6afbbdcb2017e3df7851845f5c8c5986bd63c WatchSource:0}: Error finding container 3647049eeb36cc5252eb211c83c6afbbdcb2017e3df7851845f5c8c5986bd63c: Status 404 returned error can't find the container with id 3647049eeb36cc5252eb211c83c6afbbdcb2017e3df7851845f5c8c5986bd63c
Sep 17 17:02:47.588005 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:47.587963    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" event={"ID":"3fb0e18a-973b-42ea-8f06-c99080d22768","Type":"ContainerStarted","Data":"70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2"}
Sep 17 17:02:47.588388 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:47.588032    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" event={"ID":"3fb0e18a-973b-42ea-8f06-c99080d22768","Type":"ContainerStarted","Data":"046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677"}
Sep 17 17:02:47.588388 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:47.588064    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:47.588388 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:47.588094    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" event={"ID":"3fb0e18a-973b-42ea-8f06-c99080d22768","Type":"ContainerStarted","Data":"3647049eeb36cc5252eb211c83c6afbbdcb2017e3df7851845f5c8c5986bd63c"}
Sep 17 17:02:47.588388 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:47.588131    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:47.589424 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:47.589395    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 17:02:47.608065 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:47.608022    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" podStartSLOduration=2.608007898 podStartE2EDuration="2.608007898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:02:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:02:47.606701016 +0000 UTC m=+1124.905447755" watchObservedRunningTime="2026-09-17 17:02:47.608007898 +0000 UTC m=+1124.906754636"
Sep 17 17:02:48.594921 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.594888    2571 generic.go:356] "Generic (PLEG): container finished" podID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerID="bac6ba803f0baaa883748784b96ffae5980d79adb3ccae51556652a101e866f3" exitCode=0
Sep 17 17:02:48.595269 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.594963    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" event={"ID":"26f6fe1e-88f6-4063-ab18-e15376f37b65","Type":"ContainerDied","Data":"bac6ba803f0baaa883748784b96ffae5980d79adb3ccae51556652a101e866f3"}
Sep 17 17:02:48.595269 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.595222    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 17:02:48.634600 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.634578    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 17:02:48.714361 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.714288    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bntm\" (UniqueName: \"kubernetes.io/projected/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-api-access-8bntm\") pod \"26f6fe1e-88f6-4063-ab18-e15376f37b65\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") "
Sep 17 17:02:48.714361 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.714329    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26f6fe1e-88f6-4063-ab18-e15376f37b65-proxy-tls\") pod \"26f6fe1e-88f6-4063-ab18-e15376f37b65\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") "
Sep 17 17:02:48.714535 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.714383    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-rbac-proxy-sar-config\") pod \"26f6fe1e-88f6-4063-ab18-e15376f37b65\" (UID: \"26f6fe1e-88f6-4063-ab18-e15376f37b65\") "
Sep 17 17:02:48.714890 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.714861    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "26f6fe1e-88f6-4063-ab18-e15376f37b65" (UID: "26f6fe1e-88f6-4063-ab18-e15376f37b65"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:02:48.716531 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.716509    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f6fe1e-88f6-4063-ab18-e15376f37b65-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "26f6fe1e-88f6-4063-ab18-e15376f37b65" (UID: "26f6fe1e-88f6-4063-ab18-e15376f37b65"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:02:48.716531 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.716513    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-api-access-8bntm" (OuterVolumeSpecName: "kube-api-access-8bntm") pod "26f6fe1e-88f6-4063-ab18-e15376f37b65" (UID: "26f6fe1e-88f6-4063-ab18-e15376f37b65"). InnerVolumeSpecName "kube-api-access-8bntm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:02:48.815880 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.815830    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:02:48.815880 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.815872    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bntm\" (UniqueName: \"kubernetes.io/projected/26f6fe1e-88f6-4063-ab18-e15376f37b65-kube-api-access-8bntm\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:02:48.815880 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:48.815882    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/26f6fe1e-88f6-4063-ab18-e15376f37b65-proxy-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:02:49.601153 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:49.601124    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"
Sep 17 17:02:49.601596 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:49.601127    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb" event={"ID":"26f6fe1e-88f6-4063-ab18-e15376f37b65","Type":"ContainerDied","Data":"b01f50055b814e4d29959248a835b1f6c1bcec3610cd683c877d0998af981eb7"}
Sep 17 17:02:49.601596 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:49.601257    2571 scope.go:117] "RemoveContainer" containerID="f0cebffdd35beb91d26870955f9bb9b7db1a38faf67237d996da4a6cc66e93af"
Sep 17 17:02:49.609377 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:49.609347    2571 scope.go:117] "RemoveContainer" containerID="bac6ba803f0baaa883748784b96ffae5980d79adb3ccae51556652a101e866f3"
Sep 17 17:02:49.624387 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:49.624363    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"]
Sep 17 17:02:49.627355 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:49.627335    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b5187-predictor-59c96b8b97-nzkvb"]
Sep 17 17:02:50.891994 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:50.891957    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" path="/var/lib/kubelet/pods/26f6fe1e-88f6-4063-ab18-e15376f37b65/volumes"
Sep 17 17:02:53.600496 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:53.600468    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:02:53.600930 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:02:53.600905    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 17:03:03.601065 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:03.601019    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 17:03:13.601931 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:13.601885    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 17:03:23.601060 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:23.601019    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 17:03:33.601842 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:33.601803    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:03:35.750144 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.750113    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"]
Sep 17 17:03:35.750653 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.750344    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kserve-container" containerID="cri-o://7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e" gracePeriod=30
Sep 17 17:03:35.750653 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.750457    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kube-rbac-proxy" containerID="cri-o://ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f" gracePeriod=30
Sep 17 17:03:35.843794 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.843757    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"]
Sep 17 17:03:35.844135 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.844122    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kserve-container"
Sep 17 17:03:35.844185 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.844138    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kserve-container"
Sep 17 17:03:35.844185 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.844157    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kube-rbac-proxy"
Sep 17 17:03:35.844185 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.844163    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kube-rbac-proxy"
Sep 17 17:03:35.844318 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.844216    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kserve-container"
Sep 17 17:03:35.844318 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.844224    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f6fe1e-88f6-4063-ab18-e15376f37b65" containerName="kube-rbac-proxy"
Sep 17 17:03:35.847422 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.847401    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:35.850480 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.850450    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2e2a5-predictor-serving-cert\""
Sep 17 17:03:35.850750 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.850732    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2e2a5-kube-rbac-proxy-sar-config\""
Sep 17 17:03:35.859167 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.859141    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"]
Sep 17 17:03:35.891824 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.891787    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qjr4\" (UniqueName: \"kubernetes.io/projected/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-api-access-7qjr4\") pod \"success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") " pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:35.891999 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.891843    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-proxy-tls\") pod \"success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") " pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:35.891999 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.891872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") " pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:35.992555 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.992518    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qjr4\" (UniqueName: \"kubernetes.io/projected/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-api-access-7qjr4\") pod \"success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") " pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:35.992746 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.992567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-proxy-tls\") pod \"success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") " pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:35.992746 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:03:35.992679    2571 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-serving-cert: secret "success-200-isvc-2e2a5-predictor-serving-cert" not found
Sep 17 17:03:35.992746 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.992688    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") " pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:35.992746 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:03:35.992741    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-proxy-tls podName:67c0577e-a9bb-43fb-a62e-cd1a689a66dd nodeName:}" failed. No retries permitted until 2026-09-17 17:03:36.492719589 +0000 UTC m=+1173.791466324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-proxy-tls") pod "success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" (UID: "67c0577e-a9bb-43fb-a62e-cd1a689a66dd") : secret "success-200-isvc-2e2a5-predictor-serving-cert" not found
Sep 17 17:03:35.993450 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:35.993428    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") " pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:36.004023 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:36.003951    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qjr4\" (UniqueName: \"kubernetes.io/projected/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-api-access-7qjr4\") pod \"success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") " pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:36.498335 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:36.498298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-proxy-tls\") pod \"success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") " pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:36.500978 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:36.500956    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-proxy-tls\") pod \"success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") " pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:36.759088 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:36.758994    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:36.805529 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:36.805494    2571 generic.go:356] "Generic (PLEG): container finished" podID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerID="ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f" exitCode=2
Sep 17 17:03:36.805703 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:36.805572    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" event={"ID":"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9","Type":"ContainerDied","Data":"ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f"}
Sep 17 17:03:37.035458 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:37.035430    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"]
Sep 17 17:03:37.037992 ip-10-0-143-228 kubenswrapper[2571]: W0917 17:03:37.037964    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c0577e_a9bb_43fb_a62e_cd1a689a66dd.slice/crio-6dc627a21610e13447477b01c2e39edeb735e9b9d992bc7798a5451119bc4269 WatchSource:0}: Error finding container 6dc627a21610e13447477b01c2e39edeb735e9b9d992bc7798a5451119bc4269: Status 404 returned error can't find the container with id 6dc627a21610e13447477b01c2e39edeb735e9b9d992bc7798a5451119bc4269
Sep 17 17:03:37.812085 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:37.812048    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" event={"ID":"67c0577e-a9bb-43fb-a62e-cd1a689a66dd","Type":"ContainerStarted","Data":"44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2"}
Sep 17 17:03:37.812556 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:37.812162    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:37.812556 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:37.812201    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:37.812556 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:37.812231    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" event={"ID":"67c0577e-a9bb-43fb-a62e-cd1a689a66dd","Type":"ContainerStarted","Data":"41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838"}
Sep 17 17:03:37.812556 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:37.812265    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" event={"ID":"67c0577e-a9bb-43fb-a62e-cd1a689a66dd","Type":"ContainerStarted","Data":"6dc627a21610e13447477b01c2e39edeb735e9b9d992bc7798a5451119bc4269"}
Sep 17 17:03:37.813787 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:37.813758    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Sep 17 17:03:37.833219 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:37.833170    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" podStartSLOduration=2.833154279 podStartE2EDuration="2.833154279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:03:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:03:37.83209814 +0000 UTC m=+1175.130844879" watchObservedRunningTime="2026-09-17 17:03:37.833154279 +0000 UTC m=+1175.131901018"
Sep 17 17:03:38.489402 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:38.489351    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.24:8643/healthz\": dial tcp 10.134.0.24:8643: connect: connection refused"
Sep 17 17:03:38.493765 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:38.493728    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 17:03:38.816993 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:38.816906    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Sep 17 17:03:39.195396 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.195370    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 17:03:39.327092 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.327055    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ws7x\" (UniqueName: \"kubernetes.io/projected/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-api-access-8ws7x\") pod \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") "
Sep 17 17:03:39.327260 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.327130    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-proxy-tls\") pod \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") "
Sep 17 17:03:39.327260 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.327159    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-rbac-proxy-sar-config\") pod \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\" (UID: \"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9\") "
Sep 17 17:03:39.327594 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.327561    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" (UID: "2fe0e37d-3a22-46e6-816e-c10daaa1a9c9"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:03:39.329359 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.329336    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" (UID: "2fe0e37d-3a22-46e6-816e-c10daaa1a9c9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:03:39.329483 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.329461    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-api-access-8ws7x" (OuterVolumeSpecName: "kube-api-access-8ws7x") pod "2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" (UID: "2fe0e37d-3a22-46e6-816e-c10daaa1a9c9"). InnerVolumeSpecName "kube-api-access-8ws7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:03:39.427755 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.427664    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:03:39.427755 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.427698    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ws7x\" (UniqueName: \"kubernetes.io/projected/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-kube-api-access-8ws7x\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:03:39.427755 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.427710    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9-proxy-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:03:39.825074 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.825042    2571 generic.go:356] "Generic (PLEG): container finished" podID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerID="7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e" exitCode=0
Sep 17 17:03:39.825521 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.825094    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" event={"ID":"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9","Type":"ContainerDied","Data":"7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e"}
Sep 17 17:03:39.825521 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.825102    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"
Sep 17 17:03:39.825521 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.825155    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw" event={"ID":"2fe0e37d-3a22-46e6-816e-c10daaa1a9c9","Type":"ContainerDied","Data":"f97a4bb541e6a5a880742329964468b41e616fd84ed17fa757014b54656eb7d0"}
Sep 17 17:03:39.825521 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.825195    2571 scope.go:117] "RemoveContainer" containerID="ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f"
Sep 17 17:03:39.834415 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.834390    2571 scope.go:117] "RemoveContainer" containerID="7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e"
Sep 17 17:03:39.842403 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.842379    2571 scope.go:117] "RemoveContainer" containerID="ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f"
Sep 17 17:03:39.842743 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:03:39.842718    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f\": container with ID starting with ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f not found: ID does not exist" containerID="ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f"
Sep 17 17:03:39.842791 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.842758    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f"} err="failed to get container status \"ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f\": rpc error: code = NotFound desc = could not find container \"ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f\": container with ID starting with ac57e18dd1cb4e72d3b2d4dca06f0861c23de12ec08d17e36d1c3550eeca715f not found: ID does not exist"
Sep 17 17:03:39.842791 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.842780    2571 scope.go:117] "RemoveContainer" containerID="7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e"
Sep 17 17:03:39.843058 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:03:39.843036    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e\": container with ID starting with 7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e not found: ID does not exist" containerID="7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e"
Sep 17 17:03:39.843118 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.843069    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e"} err="failed to get container status \"7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e\": rpc error: code = NotFound desc = could not find container \"7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e\": container with ID starting with 7df5fa821f500f75c479dfb2c35783782aa151e9bb157e43d8f036a77c9e861e not found: ID does not exist"
Sep 17 17:03:39.853267 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.853241    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"]
Sep 17 17:03:39.859019 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:39.858990    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f3946-predictor-8f678845f-54nlw"]
Sep 17 17:03:40.891008 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:40.890977    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" path="/var/lib/kubelet/pods/2fe0e37d-3a22-46e6-816e-c10daaa1a9c9/volumes"
Sep 17 17:03:43.821547 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:43.821515    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:03:43.822024 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:43.821980    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Sep 17 17:03:53.822027 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:53.821971    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Sep 17 17:03:55.870526 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:55.870491    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"]
Sep 17 17:03:55.871000 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:55.870782    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kserve-container" containerID="cri-o://046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677" gracePeriod=30
Sep 17 17:03:55.871000 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:55.870826    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kube-rbac-proxy" containerID="cri-o://70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2" gracePeriod=30
Sep 17 17:03:56.171538 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.171456    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"]
Sep 17 17:03:56.171809 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.171796    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kserve-container"
Sep 17 17:03:56.171859 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.171810    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kserve-container"
Sep 17 17:03:56.171859 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.171818    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kube-rbac-proxy"
Sep 17 17:03:56.171859 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.171823    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kube-rbac-proxy"
Sep 17 17:03:56.171945 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.171874    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kube-rbac-proxy"
Sep 17 17:03:56.171945 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.171882    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fe0e37d-3a22-46e6-816e-c10daaa1a9c9" containerName="kserve-container"
Sep 17 17:03:56.174905 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.174888    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.179672 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.179612    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-d52cc-predictor-serving-cert\""
Sep 17 17:03:56.179821 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.179617    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-d52cc-kube-rbac-proxy-sar-config\""
Sep 17 17:03:56.259698 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.259663    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"]
Sep 17 17:03:56.266572 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.266540    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bac55405-2c81-4ef1-9aa7-e6c4317373c0-proxy-tls\") pod \"success-200-isvc-d52cc-predictor-5cb644f657-6t22c\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") " pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.266726 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.266608    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-d52cc-predictor-5cb644f657-6t22c\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") " pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.266726 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.266668    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj2vt\" (UniqueName: \"kubernetes.io/projected/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-api-access-cj2vt\") pod \"success-200-isvc-d52cc-predictor-5cb644f657-6t22c\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") " pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.367969 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.367933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bac55405-2c81-4ef1-9aa7-e6c4317373c0-proxy-tls\") pod \"success-200-isvc-d52cc-predictor-5cb644f657-6t22c\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") " pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.367969 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.367973    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-d52cc-predictor-5cb644f657-6t22c\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") " pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.368163 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.368006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2vt\" (UniqueName: \"kubernetes.io/projected/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-api-access-cj2vt\") pod \"success-200-isvc-d52cc-predictor-5cb644f657-6t22c\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") " pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.368700 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.368680    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-d52cc-predictor-5cb644f657-6t22c\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") " pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.370582 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.370565    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bac55405-2c81-4ef1-9aa7-e6c4317373c0-proxy-tls\") pod \"success-200-isvc-d52cc-predictor-5cb644f657-6t22c\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") " pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.388894 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.388859    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2vt\" (UniqueName: \"kubernetes.io/projected/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-api-access-cj2vt\") pod \"success-200-isvc-d52cc-predictor-5cb644f657-6t22c\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") " pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.485656 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.485595    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.766754 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.766681    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"]
Sep 17 17:03:56.770028 ip-10-0-143-228 kubenswrapper[2571]: W0917 17:03:56.769997    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac55405_2c81_4ef1_9aa7_e6c4317373c0.slice/crio-03e66d689eae890c69e9bf38756ace659cd4a46bb9b10399a6a6873bfbae2d5b WatchSource:0}: Error finding container 03e66d689eae890c69e9bf38756ace659cd4a46bb9b10399a6a6873bfbae2d5b: Status 404 returned error can't find the container with id 03e66d689eae890c69e9bf38756ace659cd4a46bb9b10399a6a6873bfbae2d5b
Sep 17 17:03:56.901424 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.901395    2571 generic.go:356] "Generic (PLEG): container finished" podID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerID="70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2" exitCode=2
Sep 17 17:03:56.901790 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.901461    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" event={"ID":"3fb0e18a-973b-42ea-8f06-c99080d22768","Type":"ContainerDied","Data":"70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2"}
Sep 17 17:03:56.903401 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.903376    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" event={"ID":"bac55405-2c81-4ef1-9aa7-e6c4317373c0","Type":"ContainerStarted","Data":"1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364"}
Sep 17 17:03:56.903521 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.903430    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" event={"ID":"bac55405-2c81-4ef1-9aa7-e6c4317373c0","Type":"ContainerStarted","Data":"b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4"}
Sep 17 17:03:56.903521 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.903460    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" event={"ID":"bac55405-2c81-4ef1-9aa7-e6c4317373c0","Type":"ContainerStarted","Data":"03e66d689eae890c69e9bf38756ace659cd4a46bb9b10399a6a6873bfbae2d5b"}
Sep 17 17:03:56.903521 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.903492    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:56.927866 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:56.927820    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" podStartSLOduration=0.927805538 podStartE2EDuration="927.805538ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:03:56.9269483 +0000 UTC m=+1194.225695029" watchObservedRunningTime="2026-09-17 17:03:56.927805538 +0000 UTC m=+1194.226552276"
Sep 17 17:03:57.907889 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:57.907855    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:03:57.909392 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:57.909359    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 17:03:58.596474 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:58.596430    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.25:8643/healthz\": dial tcp 10.134.0.25:8643: connect: connection refused"
Sep 17 17:03:58.912152 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:58.912059    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 17:03:59.211990 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.211965    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:03:59.392205 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.392165    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3fb0e18a-973b-42ea-8f06-c99080d22768-proxy-tls\") pod \"3fb0e18a-973b-42ea-8f06-c99080d22768\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") "
Sep 17 17:03:59.392349 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.392215    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns6tv\" (UniqueName: \"kubernetes.io/projected/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-api-access-ns6tv\") pod \"3fb0e18a-973b-42ea-8f06-c99080d22768\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") "
Sep 17 17:03:59.392349 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.392265    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-rbac-proxy-sar-config\") pod \"3fb0e18a-973b-42ea-8f06-c99080d22768\" (UID: \"3fb0e18a-973b-42ea-8f06-c99080d22768\") "
Sep 17 17:03:59.392693 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.392671    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "3fb0e18a-973b-42ea-8f06-c99080d22768" (UID: "3fb0e18a-973b-42ea-8f06-c99080d22768"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:03:59.394563 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.394540    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb0e18a-973b-42ea-8f06-c99080d22768-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3fb0e18a-973b-42ea-8f06-c99080d22768" (UID: "3fb0e18a-973b-42ea-8f06-c99080d22768"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:03:59.394666 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.394583    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-api-access-ns6tv" (OuterVolumeSpecName: "kube-api-access-ns6tv") pod "3fb0e18a-973b-42ea-8f06-c99080d22768" (UID: "3fb0e18a-973b-42ea-8f06-c99080d22768"). InnerVolumeSpecName "kube-api-access-ns6tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:03:59.493237 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.493202    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3fb0e18a-973b-42ea-8f06-c99080d22768-proxy-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:03:59.493237 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.493233    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns6tv\" (UniqueName: \"kubernetes.io/projected/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-api-access-ns6tv\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:03:59.493237 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.493244    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3fb0e18a-973b-42ea-8f06-c99080d22768-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:03:59.920350 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.920252    2571 generic.go:356] "Generic (PLEG): container finished" podID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerID="046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677" exitCode=0
Sep 17 17:03:59.920350 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.920315    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"
Sep 17 17:03:59.920350 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.920340    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" event={"ID":"3fb0e18a-973b-42ea-8f06-c99080d22768","Type":"ContainerDied","Data":"046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677"}
Sep 17 17:03:59.920950 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.920401    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m" event={"ID":"3fb0e18a-973b-42ea-8f06-c99080d22768","Type":"ContainerDied","Data":"3647049eeb36cc5252eb211c83c6afbbdcb2017e3df7851845f5c8c5986bd63c"}
Sep 17 17:03:59.920950 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.920428    2571 scope.go:117] "RemoveContainer" containerID="70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2"
Sep 17 17:03:59.931742 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.931544    2571 scope.go:117] "RemoveContainer" containerID="046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677"
Sep 17 17:03:59.940099 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.940077    2571 scope.go:117] "RemoveContainer" containerID="70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2"
Sep 17 17:03:59.940374 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:03:59.940353    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2\": container with ID starting with 70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2 not found: ID does not exist" containerID="70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2"
Sep 17 17:03:59.940422 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.940385    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2"} err="failed to get container status \"70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2\": rpc error: code = NotFound desc = could not find container \"70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2\": container with ID starting with 70e81841c440607a17fecebba1fb0fade17dac21034c5dcc401cdafa07bf6bf2 not found: ID does not exist"
Sep 17 17:03:59.940422 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.940402    2571 scope.go:117] "RemoveContainer" containerID="046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677"
Sep 17 17:03:59.940643 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:03:59.940611    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677\": container with ID starting with 046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677 not found: ID does not exist" containerID="046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677"
Sep 17 17:03:59.940689 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.940660    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677"} err="failed to get container status \"046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677\": rpc error: code = NotFound desc = could not find container \"046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677\": container with ID starting with 046ace9973ea6f5815de7602342788bdaac1b947e57b20899482e7f6866ef677 not found: ID does not exist"
Sep 17 17:03:59.950357 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.950327    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"]
Sep 17 17:03:59.955668 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:03:59.955620    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-93f48-predictor-695cd6968c-m8g6m"]
Sep 17 17:04:00.891331 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:00.891296    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" path="/var/lib/kubelet/pods/3fb0e18a-973b-42ea-8f06-c99080d22768/volumes"
Sep 17 17:04:03.822596 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:03.822552    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Sep 17 17:04:03.916722 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:03.916691    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:04:03.917325 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:03.917295    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 17:04:04.821651 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:04.821606    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:04:04.824833 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:04.824800    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:04:13.822660 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:13.822592    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Sep 17 17:04:13.917956 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:13.917919    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 17:04:23.823154 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:23.823118    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:04:23.917839 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:23.917802    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 17:04:33.917330 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:33.917286    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 17:04:43.918732 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:43.918704    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:04:46.049906 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.049826    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"]
Sep 17 17:04:46.050446 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.050047    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kserve-container" containerID="cri-o://41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838" gracePeriod=30
Sep 17 17:04:46.050446 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.050103    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kube-rbac-proxy" containerID="cri-o://44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2" gracePeriod=30
Sep 17 17:04:46.181795 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.181764    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"]
Sep 17 17:04:46.182105 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.182092    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kserve-container"
Sep 17 17:04:46.182146 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.182107    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kserve-container"
Sep 17 17:04:46.182146 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.182122    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kube-rbac-proxy"
Sep 17 17:04:46.182146 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.182127    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kube-rbac-proxy"
Sep 17 17:04:46.182238 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.182175    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kserve-container"
Sep 17 17:04:46.182238 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.182185    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb0e18a-973b-42ea-8f06-c99080d22768" containerName="kube-rbac-proxy"
Sep 17 17:04:46.185204 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.185183    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:46.187599 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.187578    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c2858-predictor-serving-cert\""
Sep 17 17:04:46.187800 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.187787    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c2858-kube-rbac-proxy-sar-config\""
Sep 17 17:04:46.195364 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.195343    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"]
Sep 17 17:04:46.250082 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.250054    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7d7g\" (UniqueName: \"kubernetes.io/projected/93436152-4304-41ed-957f-725a70287c97-kube-api-access-b7d7g\") pod \"success-200-isvc-c2858-predictor-d76bb676c-2vf88\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") " pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:46.250228 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.250131    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/93436152-4304-41ed-957f-725a70287c97-proxy-tls\") pod \"success-200-isvc-c2858-predictor-d76bb676c-2vf88\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") " pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:46.250228 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.250154    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/93436152-4304-41ed-957f-725a70287c97-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c2858-predictor-d76bb676c-2vf88\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") " pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:46.351147 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.351068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/93436152-4304-41ed-957f-725a70287c97-proxy-tls\") pod \"success-200-isvc-c2858-predictor-d76bb676c-2vf88\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") " pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:46.351147 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.351108    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/93436152-4304-41ed-957f-725a70287c97-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c2858-predictor-d76bb676c-2vf88\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") " pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:46.351326 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.351155    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7d7g\" (UniqueName: \"kubernetes.io/projected/93436152-4304-41ed-957f-725a70287c97-kube-api-access-b7d7g\") pod \"success-200-isvc-c2858-predictor-d76bb676c-2vf88\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") " pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:46.351326 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:04:46.351225    2571 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-c2858-predictor-serving-cert: secret "success-200-isvc-c2858-predictor-serving-cert" not found
Sep 17 17:04:46.351326 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:04:46.351307    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93436152-4304-41ed-957f-725a70287c97-proxy-tls podName:93436152-4304-41ed-957f-725a70287c97 nodeName:}" failed. No retries permitted until 2026-09-17 17:04:46.851290664 +0000 UTC m=+1244.150037386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/93436152-4304-41ed-957f-725a70287c97-proxy-tls") pod "success-200-isvc-c2858-predictor-d76bb676c-2vf88" (UID: "93436152-4304-41ed-957f-725a70287c97") : secret "success-200-isvc-c2858-predictor-serving-cert" not found
Sep 17 17:04:46.351918 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.351898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/93436152-4304-41ed-957f-725a70287c97-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c2858-predictor-d76bb676c-2vf88\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") " pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:46.360876 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.360850    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7d7g\" (UniqueName: \"kubernetes.io/projected/93436152-4304-41ed-957f-725a70287c97-kube-api-access-b7d7g\") pod \"success-200-isvc-c2858-predictor-d76bb676c-2vf88\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") " pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:46.854236 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.854195    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/93436152-4304-41ed-957f-725a70287c97-proxy-tls\") pod \"success-200-isvc-c2858-predictor-d76bb676c-2vf88\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") " pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:46.856919 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:46.856895    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/93436152-4304-41ed-957f-725a70287c97-proxy-tls\") pod \"success-200-isvc-c2858-predictor-d76bb676c-2vf88\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") " pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:47.097915 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:47.097876    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:47.119225 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:47.119190    2571 generic.go:356] "Generic (PLEG): container finished" podID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerID="44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2" exitCode=2
Sep 17 17:04:47.119343 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:47.119242    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" event={"ID":"67c0577e-a9bb-43fb-a62e-cd1a689a66dd","Type":"ContainerDied","Data":"44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2"}
Sep 17 17:04:47.373428 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:47.373375    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"]
Sep 17 17:04:47.375586 ip-10-0-143-228 kubenswrapper[2571]: W0917 17:04:47.375562    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93436152_4304_41ed_957f_725a70287c97.slice/crio-6502cd249f3e3447f4cf8cc22750a71dbcf9df8a9e45e331800b327e5b4d7934 WatchSource:0}: Error finding container 6502cd249f3e3447f4cf8cc22750a71dbcf9df8a9e45e331800b327e5b4d7934: Status 404 returned error can't find the container with id 6502cd249f3e3447f4cf8cc22750a71dbcf9df8a9e45e331800b327e5b4d7934
Sep 17 17:04:48.125321 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:48.125283    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" event={"ID":"93436152-4304-41ed-957f-725a70287c97","Type":"ContainerStarted","Data":"4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374"}
Sep 17 17:04:48.125767 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:48.125376    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" event={"ID":"93436152-4304-41ed-957f-725a70287c97","Type":"ContainerStarted","Data":"240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d"}
Sep 17 17:04:48.125767 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:48.125498    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:48.125767 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:48.125551    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:48.125767 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:48.125581    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" event={"ID":"93436152-4304-41ed-957f-725a70287c97","Type":"ContainerStarted","Data":"6502cd249f3e3447f4cf8cc22750a71dbcf9df8a9e45e331800b327e5b4d7934"}
Sep 17 17:04:48.126913 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:48.126890    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Sep 17 17:04:48.145807 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:48.145757    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" podStartSLOduration=2.145742977 podStartE2EDuration="2.145742977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:04:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:04:48.144571181 +0000 UTC m=+1245.443317925" watchObservedRunningTime="2026-09-17 17:04:48.145742977 +0000 UTC m=+1245.444489716"
Sep 17 17:04:48.818045 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:48.818006    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused"
Sep 17 17:04:49.130003 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:49.129905    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Sep 17 17:04:49.394078 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:49.394051    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:04:49.474619 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:49.474582    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-proxy-tls\") pod \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") "
Sep 17 17:04:49.474619 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:49.474625    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qjr4\" (UniqueName: \"kubernetes.io/projected/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-api-access-7qjr4\") pod \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") "
Sep 17 17:04:49.474843 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:49.474704    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-rbac-proxy-sar-config\") pod \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\" (UID: \"67c0577e-a9bb-43fb-a62e-cd1a689a66dd\") "
Sep 17 17:04:49.475080 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:49.475047    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "67c0577e-a9bb-43fb-a62e-cd1a689a66dd" (UID: "67c0577e-a9bb-43fb-a62e-cd1a689a66dd"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:04:49.476852 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:49.476825    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "67c0577e-a9bb-43fb-a62e-cd1a689a66dd" (UID: "67c0577e-a9bb-43fb-a62e-cd1a689a66dd"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:04:49.476975 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:49.476954    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-api-access-7qjr4" (OuterVolumeSpecName: "kube-api-access-7qjr4") pod "67c0577e-a9bb-43fb-a62e-cd1a689a66dd" (UID: "67c0577e-a9bb-43fb-a62e-cd1a689a66dd"). InnerVolumeSpecName "kube-api-access-7qjr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:04:49.576176 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:49.576136    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-proxy-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:04:49.576176 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:49.576168    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qjr4\" (UniqueName: \"kubernetes.io/projected/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-api-access-7qjr4\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:04:49.576401 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:49.576184    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/67c0577e-a9bb-43fb-a62e-cd1a689a66dd-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:04:50.135484 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.135451    2571 generic.go:356] "Generic (PLEG): container finished" podID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerID="41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838" exitCode=0
Sep 17 17:04:50.135484 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.135489    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" event={"ID":"67c0577e-a9bb-43fb-a62e-cd1a689a66dd","Type":"ContainerDied","Data":"41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838"}
Sep 17 17:04:50.136085 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.135516    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"
Sep 17 17:04:50.136085 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.135533    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n" event={"ID":"67c0577e-a9bb-43fb-a62e-cd1a689a66dd","Type":"ContainerDied","Data":"6dc627a21610e13447477b01c2e39edeb735e9b9d992bc7798a5451119bc4269"}
Sep 17 17:04:50.136085 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.135560    2571 scope.go:117] "RemoveContainer" containerID="44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2"
Sep 17 17:04:50.144117 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.144100    2571 scope.go:117] "RemoveContainer" containerID="41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838"
Sep 17 17:04:50.151898 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.151880    2571 scope.go:117] "RemoveContainer" containerID="44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2"
Sep 17 17:04:50.152155 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:04:50.152136    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2\": container with ID starting with 44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2 not found: ID does not exist" containerID="44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2"
Sep 17 17:04:50.152199 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.152163    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2"} err="failed to get container status \"44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2\": rpc error: code = NotFound desc = could not find container \"44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2\": container with ID starting with 44ef259475275d2272aa221e159d783fba6623e975647fa8df88f40fed7b83c2 not found: ID does not exist"
Sep 17 17:04:50.152199 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.152181    2571 scope.go:117] "RemoveContainer" containerID="41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838"
Sep 17 17:04:50.152423 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:04:50.152405    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838\": container with ID starting with 41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838 not found: ID does not exist" containerID="41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838"
Sep 17 17:04:50.152478 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.152427    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838"} err="failed to get container status \"41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838\": rpc error: code = NotFound desc = could not find container \"41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838\": container with ID starting with 41a08b5f985bf0777eb4c23e79b84c3870fa1b54bbefae27ca9e4ed6cf6bc838 not found: ID does not exist"
Sep 17 17:04:50.159330 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.159307    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"]
Sep 17 17:04:50.161383 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.161362    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2e2a5-predictor-5cd7c778fc-rqd7n"]
Sep 17 17:04:50.890921 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:50.890885    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" path="/var/lib/kubelet/pods/67c0577e-a9bb-43fb-a62e-cd1a689a66dd/volumes"
Sep 17 17:04:54.134532 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:54.134504    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:04:54.134968 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:04:54.134942    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Sep 17 17:05:04.135758 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:05:04.135717    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Sep 17 17:05:14.135613 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:05:14.135568    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Sep 17 17:05:24.135379 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:05:24.135341    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Sep 17 17:05:34.136697 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:05:34.136667    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:09:04.846196 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:09:04.846169    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:09:04.850761 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:09:04.850742    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:13:10.754337 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.754299    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"]
Sep 17 17:13:10.754941 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.754584    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kserve-container" containerID="cri-o://b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4" gracePeriod=30
Sep 17 17:13:10.754941 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.754625    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kube-rbac-proxy" containerID="cri-o://1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364" gracePeriod=30
Sep 17 17:13:10.826325 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.826293    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"]
Sep 17 17:13:10.826616 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.826603    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kserve-container"
Sep 17 17:13:10.826616 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.826616    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kserve-container"
Sep 17 17:13:10.826744 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.826647    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kube-rbac-proxy"
Sep 17 17:13:10.826744 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.826653    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kube-rbac-proxy"
Sep 17 17:13:10.826744 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.826708    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kserve-container"
Sep 17 17:13:10.826744 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.826717    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="67c0577e-a9bb-43fb-a62e-cd1a689a66dd" containerName="kube-rbac-proxy"
Sep 17 17:13:10.829798 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.829773    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:10.832669 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.832623    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2fdf6-kube-rbac-proxy-sar-config\""
Sep 17 17:13:10.832806 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.832646    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2fdf6-predictor-serving-cert\""
Sep 17 17:13:10.842390 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.842364    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"]
Sep 17 17:13:10.972765 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.972724    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb0cc532-47d1-445f-962f-ddecee228798-proxy-tls\") pod \"success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") " pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:10.972765 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.972761    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fb0cc532-47d1-445f-962f-ddecee228798-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") " pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:10.972978 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:10.972787    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4wtr\" (UniqueName: \"kubernetes.io/projected/fb0cc532-47d1-445f-962f-ddecee228798-kube-api-access-k4wtr\") pod \"success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") " pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:11.074835 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:11.074306    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb0cc532-47d1-445f-962f-ddecee228798-proxy-tls\") pod \"success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") " pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:11.074835 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:11.074360    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fb0cc532-47d1-445f-962f-ddecee228798-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") " pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:11.074835 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:11.074408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4wtr\" (UniqueName: \"kubernetes.io/projected/fb0cc532-47d1-445f-962f-ddecee228798-kube-api-access-k4wtr\") pod \"success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") " pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:11.075419 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:11.075390    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fb0cc532-47d1-445f-962f-ddecee228798-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") " pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:11.077085 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:11.077051    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb0cc532-47d1-445f-962f-ddecee228798-proxy-tls\") pod \"success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") " pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:11.082375 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:11.082343    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4wtr\" (UniqueName: \"kubernetes.io/projected/fb0cc532-47d1-445f-962f-ddecee228798-kube-api-access-k4wtr\") pod \"success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") " pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:11.140504 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:11.140462    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:11.231078 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:11.231040    2571 generic.go:356] "Generic (PLEG): container finished" podID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerID="1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364" exitCode=2
Sep 17 17:13:11.231246 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:11.231104    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" event={"ID":"bac55405-2c81-4ef1-9aa7-e6c4317373c0","Type":"ContainerDied","Data":"1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364"}
Sep 17 17:13:11.413284 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:11.413260    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"]
Sep 17 17:13:11.415712 ip-10-0-143-228 kubenswrapper[2571]: W0917 17:13:11.415684    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb0cc532_47d1_445f_962f_ddecee228798.slice/crio-0f7d396e03c214c1205f989d10557c560ce254dbb792af5fcc21d361f4e2f73e WatchSource:0}: Error finding container 0f7d396e03c214c1205f989d10557c560ce254dbb792af5fcc21d361f4e2f73e: Status 404 returned error can't find the container with id 0f7d396e03c214c1205f989d10557c560ce254dbb792af5fcc21d361f4e2f73e
Sep 17 17:13:12.238032 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:12.237994    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" event={"ID":"fb0cc532-47d1-445f-962f-ddecee228798","Type":"ContainerStarted","Data":"5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf"}
Sep 17 17:13:12.238427 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:12.238055    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" event={"ID":"fb0cc532-47d1-445f-962f-ddecee228798","Type":"ContainerStarted","Data":"1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3"}
Sep 17 17:13:12.238427 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:12.238077    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" event={"ID":"fb0cc532-47d1-445f-962f-ddecee228798","Type":"ContainerStarted","Data":"0f7d396e03c214c1205f989d10557c560ce254dbb792af5fcc21d361f4e2f73e"}
Sep 17 17:13:12.238427 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:12.238146    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:12.258762 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:12.258707    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" podStartSLOduration=2.258690197 podStartE2EDuration="2.258690197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:13:12.257872696 +0000 UTC m=+1749.556619448" watchObservedRunningTime="2026-09-17 17:13:12.258690197 +0000 UTC m=+1749.557436936"
Sep 17 17:13:13.242382 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:13.242344    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:13.243690 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:13.243661    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Sep 17 17:13:13.913045 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:13.913000    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Sep 17 17:13:13.917385 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:13.917347    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 17:13:14.022752 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.022726    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:13:14.201925 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.201834    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bac55405-2c81-4ef1-9aa7-e6c4317373c0-proxy-tls\") pod \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") "
Sep 17 17:13:14.201925 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.201891    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-rbac-proxy-sar-config\") pod \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") "
Sep 17 17:13:14.201925 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.201922    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj2vt\" (UniqueName: \"kubernetes.io/projected/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-api-access-cj2vt\") pod \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\" (UID: \"bac55405-2c81-4ef1-9aa7-e6c4317373c0\") "
Sep 17 17:13:14.202278 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.202239    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "bac55405-2c81-4ef1-9aa7-e6c4317373c0" (UID: "bac55405-2c81-4ef1-9aa7-e6c4317373c0"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:13:14.204137 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.204111    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bac55405-2c81-4ef1-9aa7-e6c4317373c0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bac55405-2c81-4ef1-9aa7-e6c4317373c0" (UID: "bac55405-2c81-4ef1-9aa7-e6c4317373c0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:13:14.204233 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.204163    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-api-access-cj2vt" (OuterVolumeSpecName: "kube-api-access-cj2vt") pod "bac55405-2c81-4ef1-9aa7-e6c4317373c0" (UID: "bac55405-2c81-4ef1-9aa7-e6c4317373c0"). InnerVolumeSpecName "kube-api-access-cj2vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:13:14.247527 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.247495    2571 generic.go:356] "Generic (PLEG): container finished" podID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerID="b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4" exitCode=0
Sep 17 17:13:14.248007 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.247552    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"
Sep 17 17:13:14.248007 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.247562    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" event={"ID":"bac55405-2c81-4ef1-9aa7-e6c4317373c0","Type":"ContainerDied","Data":"b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4"}
Sep 17 17:13:14.248007 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.247624    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c" event={"ID":"bac55405-2c81-4ef1-9aa7-e6c4317373c0","Type":"ContainerDied","Data":"03e66d689eae890c69e9bf38756ace659cd4a46bb9b10399a6a6873bfbae2d5b"}
Sep 17 17:13:14.248007 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.247675    2571 scope.go:117] "RemoveContainer" containerID="1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364"
Sep 17 17:13:14.248331 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.248298    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Sep 17 17:13:14.256609 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.256591    2571 scope.go:117] "RemoveContainer" containerID="b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4"
Sep 17 17:13:14.264731 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.264714    2571 scope.go:117] "RemoveContainer" containerID="1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364"
Sep 17 17:13:14.265013 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:13:14.264993    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364\": container with ID starting with 1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364 not found: ID does not exist" containerID="1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364"
Sep 17 17:13:14.265086 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.265026    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364"} err="failed to get container status \"1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364\": rpc error: code = NotFound desc = could not find container \"1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364\": container with ID starting with 1a2b801c46a8b4cb8c8b63234e8fc669d2c9bd1ad43255e101fec9163c22a364 not found: ID does not exist"
Sep 17 17:13:14.265086 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.265050    2571 scope.go:117] "RemoveContainer" containerID="b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4"
Sep 17 17:13:14.265298 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:13:14.265282    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4\": container with ID starting with b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4 not found: ID does not exist" containerID="b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4"
Sep 17 17:13:14.265337 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.265303    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4"} err="failed to get container status \"b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4\": rpc error: code = NotFound desc = could not find container \"b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4\": container with ID starting with b869dd57161463a7e0006c41033c4fe467dc65029083764e50a8884c3028d4c4 not found: ID does not exist"
Sep 17 17:13:14.269069 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.269047    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"]
Sep 17 17:13:14.274532 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.274506    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-d52cc-predictor-5cb644f657-6t22c"]
Sep 17 17:13:14.303238 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.303211    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj2vt\" (UniqueName: \"kubernetes.io/projected/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-api-access-cj2vt\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:13:14.303238 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.303237    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bac55405-2c81-4ef1-9aa7-e6c4317373c0-proxy-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:13:14.303348 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.303248    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bac55405-2c81-4ef1-9aa7-e6c4317373c0-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:13:14.891617 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:14.891582    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" path="/var/lib/kubelet/pods/bac55405-2c81-4ef1-9aa7-e6c4317373c0/volumes"
Sep 17 17:13:19.252883 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:19.252854    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:13:19.253391 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:19.253321    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Sep 17 17:13:29.253652 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:29.253585    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Sep 17 17:13:39.253603 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:39.253556    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Sep 17 17:13:49.253341 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:49.253250    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Sep 17 17:13:59.254830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:13:59.254793    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:14:00.904373 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:00.904341    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"]
Sep 17 17:14:00.905182 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:00.905142    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kserve-container" containerID="cri-o://240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d" gracePeriod=30
Sep 17 17:14:00.905401 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:00.905180    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kube-rbac-proxy" containerID="cri-o://4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374" gracePeriod=30
Sep 17 17:14:01.028840 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.028811    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"]
Sep 17 17:14:01.029194 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.029178    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kube-rbac-proxy"
Sep 17 17:14:01.029265 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.029224    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kube-rbac-proxy"
Sep 17 17:14:01.029265 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.029249    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kserve-container"
Sep 17 17:14:01.029265 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.029254    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kserve-container"
Sep 17 17:14:01.029400 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.029382    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kube-rbac-proxy"
Sep 17 17:14:01.029547 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.029418    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac55405-2c81-4ef1-9aa7-e6c4317373c0" containerName="kserve-container"
Sep 17 17:14:01.032447 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.032427    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:01.035803 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.035778    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-f0d22-predictor-serving-cert\""
Sep 17 17:14:01.035904 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.035869    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-f0d22-kube-rbac-proxy-sar-config\""
Sep 17 17:14:01.044795 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.044772    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"]
Sep 17 17:14:01.185367 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.185276    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f0d22-predictor-69c49986b7-kp9jw\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") " pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:01.185367 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.185343    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13cdfc73-20d2-4162-a57a-29b7578fd666-proxy-tls\") pod \"success-200-isvc-f0d22-predictor-69c49986b7-kp9jw\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") " pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:01.185562 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.185381    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfl7f\" (UniqueName: \"kubernetes.io/projected/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-api-access-zfl7f\") pod \"success-200-isvc-f0d22-predictor-69c49986b7-kp9jw\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") " pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:01.286030 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.285988    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f0d22-predictor-69c49986b7-kp9jw\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") " pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:01.286192 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.286057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13cdfc73-20d2-4162-a57a-29b7578fd666-proxy-tls\") pod \"success-200-isvc-f0d22-predictor-69c49986b7-kp9jw\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") " pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:01.286192 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.286086    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfl7f\" (UniqueName: \"kubernetes.io/projected/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-api-access-zfl7f\") pod \"success-200-isvc-f0d22-predictor-69c49986b7-kp9jw\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") " pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:01.286294 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:14:01.286207    2571 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-serving-cert: secret "success-200-isvc-f0d22-predictor-serving-cert" not found
Sep 17 17:14:01.286294 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:14:01.286263    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13cdfc73-20d2-4162-a57a-29b7578fd666-proxy-tls podName:13cdfc73-20d2-4162-a57a-29b7578fd666 nodeName:}" failed. No retries permitted until 2026-09-17 17:14:01.786244609 +0000 UTC m=+1799.084991326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/13cdfc73-20d2-4162-a57a-29b7578fd666-proxy-tls") pod "success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" (UID: "13cdfc73-20d2-4162-a57a-29b7578fd666") : secret "success-200-isvc-f0d22-predictor-serving-cert" not found
Sep 17 17:14:01.286613 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.286595    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f0d22-predictor-69c49986b7-kp9jw\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") " pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:01.300210 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.300186    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfl7f\" (UniqueName: \"kubernetes.io/projected/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-api-access-zfl7f\") pod \"success-200-isvc-f0d22-predictor-69c49986b7-kp9jw\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") " pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:01.449349 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.449256    2571 generic.go:356] "Generic (PLEG): container finished" podID="93436152-4304-41ed-957f-725a70287c97" containerID="4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374" exitCode=2
Sep 17 17:14:01.449349 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.449326    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" event={"ID":"93436152-4304-41ed-957f-725a70287c97","Type":"ContainerDied","Data":"4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374"}
Sep 17 17:14:01.790946 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.790900    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13cdfc73-20d2-4162-a57a-29b7578fd666-proxy-tls\") pod \"success-200-isvc-f0d22-predictor-69c49986b7-kp9jw\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") " pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:01.793685 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.793652    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13cdfc73-20d2-4162-a57a-29b7578fd666-proxy-tls\") pod \"success-200-isvc-f0d22-predictor-69c49986b7-kp9jw\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") " pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:01.943746 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:01.943706    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:02.220367 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:02.220342    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"]
Sep 17 17:14:02.223116 ip-10-0-143-228 kubenswrapper[2571]: W0917 17:14:02.223087    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13cdfc73_20d2_4162_a57a_29b7578fd666.slice/crio-048f56acd6749ffa3d19436dbb478ca90eb99a3e02d1c424f8073d58a825bb33 WatchSource:0}: Error finding container 048f56acd6749ffa3d19436dbb478ca90eb99a3e02d1c424f8073d58a825bb33: Status 404 returned error can't find the container with id 048f56acd6749ffa3d19436dbb478ca90eb99a3e02d1c424f8073d58a825bb33
Sep 17 17:14:02.457488 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:02.457421    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" event={"ID":"13cdfc73-20d2-4162-a57a-29b7578fd666","Type":"ContainerStarted","Data":"57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c"}
Sep 17 17:14:02.457711 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:02.457496    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" event={"ID":"13cdfc73-20d2-4162-a57a-29b7578fd666","Type":"ContainerStarted","Data":"df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa"}
Sep 17 17:14:02.457711 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:02.457517    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" event={"ID":"13cdfc73-20d2-4162-a57a-29b7578fd666","Type":"ContainerStarted","Data":"048f56acd6749ffa3d19436dbb478ca90eb99a3e02d1c424f8073d58a825bb33"}
Sep 17 17:14:02.457711 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:02.457660    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:02.482678 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:02.482571    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" podStartSLOduration=1.482556787 podStartE2EDuration="1.482556787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:14:02.479540475 +0000 UTC m=+1799.778287226" watchObservedRunningTime="2026-09-17 17:14:02.482556787 +0000 UTC m=+1799.781303525"
Sep 17 17:14:03.462559 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:03.462527    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:03.464098 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:03.464070    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 17:14:04.158992 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.158958    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:14:04.317849 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.317815    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7d7g\" (UniqueName: \"kubernetes.io/projected/93436152-4304-41ed-957f-725a70287c97-kube-api-access-b7d7g\") pod \"93436152-4304-41ed-957f-725a70287c97\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") "
Sep 17 17:14:04.318024 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.317917    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/93436152-4304-41ed-957f-725a70287c97-kube-rbac-proxy-sar-config\") pod \"93436152-4304-41ed-957f-725a70287c97\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") "
Sep 17 17:14:04.318024 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.317969    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/93436152-4304-41ed-957f-725a70287c97-proxy-tls\") pod \"93436152-4304-41ed-957f-725a70287c97\" (UID: \"93436152-4304-41ed-957f-725a70287c97\") "
Sep 17 17:14:04.318363 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.318334    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93436152-4304-41ed-957f-725a70287c97-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "93436152-4304-41ed-957f-725a70287c97" (UID: "93436152-4304-41ed-957f-725a70287c97"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:14:04.320104 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.320081    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93436152-4304-41ed-957f-725a70287c97-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "93436152-4304-41ed-957f-725a70287c97" (UID: "93436152-4304-41ed-957f-725a70287c97"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:14:04.320195 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.320177    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93436152-4304-41ed-957f-725a70287c97-kube-api-access-b7d7g" (OuterVolumeSpecName: "kube-api-access-b7d7g") pod "93436152-4304-41ed-957f-725a70287c97" (UID: "93436152-4304-41ed-957f-725a70287c97"). InnerVolumeSpecName "kube-api-access-b7d7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:14:04.419256 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.419220    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/93436152-4304-41ed-957f-725a70287c97-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:14:04.419256 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.419250    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/93436152-4304-41ed-957f-725a70287c97-proxy-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:14:04.419256 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.419260    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7d7g\" (UniqueName: \"kubernetes.io/projected/93436152-4304-41ed-957f-725a70287c97-kube-api-access-b7d7g\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:14:04.468435 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.468390    2571 generic.go:356] "Generic (PLEG): container finished" podID="93436152-4304-41ed-957f-725a70287c97" containerID="240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d" exitCode=0
Sep 17 17:14:04.468887 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.468453    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"
Sep 17 17:14:04.468887 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.468474    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" event={"ID":"93436152-4304-41ed-957f-725a70287c97","Type":"ContainerDied","Data":"240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d"}
Sep 17 17:14:04.468887 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.468533    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" event={"ID":"93436152-4304-41ed-957f-725a70287c97","Type":"ContainerDied","Data":"6502cd249f3e3447f4cf8cc22750a71dbcf9df8a9e45e331800b327e5b4d7934"}
Sep 17 17:14:04.468887 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.468562    2571 scope.go:117] "RemoveContainer" containerID="4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374"
Sep 17 17:14:04.469099 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.468992    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 17:14:04.477519 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.477501    2571 scope.go:117] "RemoveContainer" containerID="240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d"
Sep 17 17:14:04.485268 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.485246    2571 scope.go:117] "RemoveContainer" containerID="4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374"
Sep 17 17:14:04.485555 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:14:04.485536    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374\": container with ID starting with 4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374 not found: ID does not exist" containerID="4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374"
Sep 17 17:14:04.485605 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.485567    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374"} err="failed to get container status \"4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374\": rpc error: code = NotFound desc = could not find container \"4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374\": container with ID starting with 4a4607a31bb192de07eaf3e8ebbbbf979e442e158f02c85bf9ce2f209d4cc374 not found: ID does not exist"
Sep 17 17:14:04.485605 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.485585    2571 scope.go:117] "RemoveContainer" containerID="240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d"
Sep 17 17:14:04.485851 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:14:04.485836    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d\": container with ID starting with 240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d not found: ID does not exist" containerID="240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d"
Sep 17 17:14:04.485891 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.485855    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d"} err="failed to get container status \"240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d\": rpc error: code = NotFound desc = could not find container \"240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d\": container with ID starting with 240b660cfd7e51dd38f9d8572da22e00977f567c0e3e487b747053ebd4b2758d not found: ID does not exist"
Sep 17 17:14:04.490180 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.490156    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"]
Sep 17 17:14:04.496190 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.496170    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88"]
Sep 17 17:14:04.877664 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.877541    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:14:04.897062 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.883360    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:14:04.897062 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:04.891201    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93436152-4304-41ed-957f-725a70287c97" path="/var/lib/kubelet/pods/93436152-4304-41ed-957f-725a70287c97/volumes"
Sep 17 17:14:05.131751 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:05.131649    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 17 17:14:05.135811 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:05.135783    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c2858-predictor-d76bb676c-2vf88" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: i/o timeout"
Sep 17 17:14:09.473261 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:09.473232    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:09.473712 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:09.473655    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 17:14:19.473879 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:19.473832    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 17:14:21.059766 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.059735    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"]
Sep 17 17:14:21.060285 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.059977    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kserve-container" containerID="cri-o://1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3" gracePeriod=30
Sep 17 17:14:21.060285 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.060007    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kube-rbac-proxy" containerID="cri-o://5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf" gracePeriod=30
Sep 17 17:14:21.181751 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.181719    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"]
Sep 17 17:14:21.182038 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.182026    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kube-rbac-proxy"
Sep 17 17:14:21.182084 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.182040    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kube-rbac-proxy"
Sep 17 17:14:21.182084 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.182065    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kserve-container"
Sep 17 17:14:21.182084 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.182071    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kserve-container"
Sep 17 17:14:21.182172 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.182117    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kube-rbac-proxy"
Sep 17 17:14:21.182172 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.182127    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="93436152-4304-41ed-957f-725a70287c97" containerName="kserve-container"
Sep 17 17:14:21.185250 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.185230    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:21.187771 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.187747    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2756e-predictor-serving-cert\""
Sep 17 17:14:21.188285 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.188258    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2756e-kube-rbac-proxy-sar-config\""
Sep 17 17:14:21.197270 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.197250    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"]
Sep 17 17:14:21.356374 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.356268    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2756e-predictor-5c99844f45-rhfvz\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") " pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:21.356562 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.356395    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htzkq\" (UniqueName: \"kubernetes.io/projected/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-api-access-htzkq\") pod \"success-200-isvc-2756e-predictor-5c99844f45-rhfvz\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") " pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:21.356562 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.356471    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8b52607-1be7-4367-af33-3ec1ec22dd51-proxy-tls\") pod \"success-200-isvc-2756e-predictor-5c99844f45-rhfvz\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") " pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:21.457819 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.457766    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8b52607-1be7-4367-af33-3ec1ec22dd51-proxy-tls\") pod \"success-200-isvc-2756e-predictor-5c99844f45-rhfvz\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") " pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:21.457987 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.457847    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2756e-predictor-5c99844f45-rhfvz\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") " pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:21.457987 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.457917    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htzkq\" (UniqueName: \"kubernetes.io/projected/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-api-access-htzkq\") pod \"success-200-isvc-2756e-predictor-5c99844f45-rhfvz\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") " pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:21.458494 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.458452    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2756e-predictor-5c99844f45-rhfvz\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") " pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:21.460531 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.460505    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8b52607-1be7-4367-af33-3ec1ec22dd51-proxy-tls\") pod \"success-200-isvc-2756e-predictor-5c99844f45-rhfvz\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") " pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:21.465881 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.465861    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htzkq\" (UniqueName: \"kubernetes.io/projected/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-api-access-htzkq\") pod \"success-200-isvc-2756e-predictor-5c99844f45-rhfvz\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") " pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:21.495887 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.495844    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:21.540269 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.540234    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb0cc532-47d1-445f-962f-ddecee228798" containerID="5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf" exitCode=2
Sep 17 17:14:21.540438 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.540281    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" event={"ID":"fb0cc532-47d1-445f-962f-ddecee228798","Type":"ContainerDied","Data":"5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf"}
Sep 17 17:14:21.788844 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:21.788667    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"]
Sep 17 17:14:21.791486 ip-10-0-143-228 kubenswrapper[2571]: W0917 17:14:21.791454    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b52607_1be7_4367_af33_3ec1ec22dd51.slice/crio-f5664e7da57103cd4c7cc979256fcfd67e7da8f37c6605bd7bc264af5176666b WatchSource:0}: Error finding container f5664e7da57103cd4c7cc979256fcfd67e7da8f37c6605bd7bc264af5176666b: Status 404 returned error can't find the container with id f5664e7da57103cd4c7cc979256fcfd67e7da8f37c6605bd7bc264af5176666b
Sep 17 17:14:22.546900 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:22.546859    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" event={"ID":"b8b52607-1be7-4367-af33-3ec1ec22dd51","Type":"ContainerStarted","Data":"2e0761cf84709bd6b7f6e0d8b5d383e5bb1b057ea4abf21e70a55a4c6131527c"}
Sep 17 17:14:22.547298 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:22.546924    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" event={"ID":"b8b52607-1be7-4367-af33-3ec1ec22dd51","Type":"ContainerStarted","Data":"1f1fdc3abae10273ae2db3a84aa1b3c326ca38388a279e620310a991e89966a2"}
Sep 17 17:14:22.547298 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:22.546956    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:22.547298 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:22.546976    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" event={"ID":"b8b52607-1be7-4367-af33-3ec1ec22dd51","Type":"ContainerStarted","Data":"f5664e7da57103cd4c7cc979256fcfd67e7da8f37c6605bd7bc264af5176666b"}
Sep 17 17:14:22.572452 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:22.572386    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" podStartSLOduration=1.572364031 podStartE2EDuration="1.572364031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:14:22.571005688 +0000 UTC m=+1819.869752438" watchObservedRunningTime="2026-09-17 17:14:22.572364031 +0000 UTC m=+1819.871110770"
Sep 17 17:14:23.551303 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:23.551271    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:23.552551 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:23.552527    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 17:14:24.248734 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.248700    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Sep 17 17:14:24.555929 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.555899    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 17:14:24.711868 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.711841    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:14:24.781238 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.781204    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fb0cc532-47d1-445f-962f-ddecee228798-kube-rbac-proxy-sar-config\") pod \"fb0cc532-47d1-445f-962f-ddecee228798\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") "
Sep 17 17:14:24.781238 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.781244    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4wtr\" (UniqueName: \"kubernetes.io/projected/fb0cc532-47d1-445f-962f-ddecee228798-kube-api-access-k4wtr\") pod \"fb0cc532-47d1-445f-962f-ddecee228798\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") "
Sep 17 17:14:24.781456 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.781282    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb0cc532-47d1-445f-962f-ddecee228798-proxy-tls\") pod \"fb0cc532-47d1-445f-962f-ddecee228798\" (UID: \"fb0cc532-47d1-445f-962f-ddecee228798\") "
Sep 17 17:14:24.787350 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.781894    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb0cc532-47d1-445f-962f-ddecee228798-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "fb0cc532-47d1-445f-962f-ddecee228798" (UID: "fb0cc532-47d1-445f-962f-ddecee228798"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:14:24.787350 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.784316    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb0cc532-47d1-445f-962f-ddecee228798-kube-api-access-k4wtr" (OuterVolumeSpecName: "kube-api-access-k4wtr") pod "fb0cc532-47d1-445f-962f-ddecee228798" (UID: "fb0cc532-47d1-445f-962f-ddecee228798"). InnerVolumeSpecName "kube-api-access-k4wtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:14:24.787870 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.787841    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb0cc532-47d1-445f-962f-ddecee228798-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fb0cc532-47d1-445f-962f-ddecee228798" (UID: "fb0cc532-47d1-445f-962f-ddecee228798"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:14:24.883059 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.882969    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fb0cc532-47d1-445f-962f-ddecee228798-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:14:24.883059 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.883004    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4wtr\" (UniqueName: \"kubernetes.io/projected/fb0cc532-47d1-445f-962f-ddecee228798-kube-api-access-k4wtr\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:14:24.883059 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:24.883017    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb0cc532-47d1-445f-962f-ddecee228798-proxy-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:14:25.561903 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.561856    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb0cc532-47d1-445f-962f-ddecee228798" containerID="1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3" exitCode=0
Sep 17 17:14:25.562363 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.561901    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" event={"ID":"fb0cc532-47d1-445f-962f-ddecee228798","Type":"ContainerDied","Data":"1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3"}
Sep 17 17:14:25.562363 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.561947    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"
Sep 17 17:14:25.562363 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.561974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn" event={"ID":"fb0cc532-47d1-445f-962f-ddecee228798","Type":"ContainerDied","Data":"0f7d396e03c214c1205f989d10557c560ce254dbb792af5fcc21d361f4e2f73e"}
Sep 17 17:14:25.562363 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.562001    2571 scope.go:117] "RemoveContainer" containerID="5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf"
Sep 17 17:14:25.570473 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.570455    2571 scope.go:117] "RemoveContainer" containerID="1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3"
Sep 17 17:14:25.580314 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.580128    2571 scope.go:117] "RemoveContainer" containerID="5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf"
Sep 17 17:14:25.580468 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:14:25.580448    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf\": container with ID starting with 5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf not found: ID does not exist" containerID="5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf"
Sep 17 17:14:25.580514 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.580476    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf"} err="failed to get container status \"5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf\": rpc error: code = NotFound desc = could not find container \"5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf\": container with ID starting with 5f84ee58fbc1e7aea50e89b5a655a3f9842d6c1f28eba17cfa7d6e88d7a2e2cf not found: ID does not exist"
Sep 17 17:14:25.580514 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.580491    2571 scope.go:117] "RemoveContainer" containerID="1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3"
Sep 17 17:14:25.580780 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:14:25.580761    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3\": container with ID starting with 1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3 not found: ID does not exist" containerID="1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3"
Sep 17 17:14:25.580826 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.580787    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3"} err="failed to get container status \"1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3\": rpc error: code = NotFound desc = could not find container \"1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3\": container with ID starting with 1a7c13f6cfe789e7423f713f2100ccf4808505991602c8b81bb12124f6cd15b3 not found: ID does not exist"
Sep 17 17:14:25.593662 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.593597    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"]
Sep 17 17:14:25.595210 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:25.595190    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2fdf6-predictor-74959c8f6c-t8vgn"]
Sep 17 17:14:26.894722 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:26.894693    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb0cc532-47d1-445f-962f-ddecee228798" path="/var/lib/kubelet/pods/fb0cc532-47d1-445f-962f-ddecee228798/volumes"
Sep 17 17:14:29.473981 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:29.473942    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 17:14:29.562069 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:29.562040    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:14:29.562486 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:29.562457    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 17:14:39.473779 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:39.473740    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 17:14:39.563239 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:39.563197    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 17:14:49.475385 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:49.475353    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:14:49.563044 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:49.562997    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 17:14:59.562538 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:14:59.562491    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 17:15:09.563563 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:15:09.563533    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:19:04.905790 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:19:04.905623    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:19:04.911335 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:19:04.911318    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:23:35.977751 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:35.977720    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"]
Sep 17 17:23:35.978247 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:35.977934    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kserve-container" containerID="cri-o://1f1fdc3abae10273ae2db3a84aa1b3c326ca38388a279e620310a991e89966a2" gracePeriod=30
Sep 17 17:23:35.978247 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:35.977977    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kube-rbac-proxy" containerID="cri-o://2e0761cf84709bd6b7f6e0d8b5d383e5bb1b057ea4abf21e70a55a4c6131527c" gracePeriod=30
Sep 17 17:23:36.887334 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:36.887297    2571 generic.go:356] "Generic (PLEG): container finished" podID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerID="2e0761cf84709bd6b7f6e0d8b5d383e5bb1b057ea4abf21e70a55a4c6131527c" exitCode=2
Sep 17 17:23:36.890056 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:36.890030    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" event={"ID":"b8b52607-1be7-4367-af33-3ec1ec22dd51","Type":"ContainerDied","Data":"2e0761cf84709bd6b7f6e0d8b5d383e5bb1b057ea4abf21e70a55a4c6131527c"}
Sep 17 17:23:38.898455 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:38.898426    2571 generic.go:356] "Generic (PLEG): container finished" podID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerID="1f1fdc3abae10273ae2db3a84aa1b3c326ca38388a279e620310a991e89966a2" exitCode=0
Sep 17 17:23:38.898821 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:38.898473    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" event={"ID":"b8b52607-1be7-4367-af33-3ec1ec22dd51","Type":"ContainerDied","Data":"1f1fdc3abae10273ae2db3a84aa1b3c326ca38388a279e620310a991e89966a2"}
Sep 17 17:23:39.028388 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.028364    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:23:39.061224 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.061196    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8b52607-1be7-4367-af33-3ec1ec22dd51-proxy-tls\") pod \"b8b52607-1be7-4367-af33-3ec1ec22dd51\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") "
Sep 17 17:23:39.061407 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.061245    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htzkq\" (UniqueName: \"kubernetes.io/projected/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-api-access-htzkq\") pod \"b8b52607-1be7-4367-af33-3ec1ec22dd51\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") "
Sep 17 17:23:39.061407 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.061270    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-rbac-proxy-sar-config\") pod \"b8b52607-1be7-4367-af33-3ec1ec22dd51\" (UID: \"b8b52607-1be7-4367-af33-3ec1ec22dd51\") "
Sep 17 17:23:39.061779 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.061744    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b8b52607-1be7-4367-af33-3ec1ec22dd51" (UID: "b8b52607-1be7-4367-af33-3ec1ec22dd51"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:23:39.063733 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.063701    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-api-access-htzkq" (OuterVolumeSpecName: "kube-api-access-htzkq") pod "b8b52607-1be7-4367-af33-3ec1ec22dd51" (UID: "b8b52607-1be7-4367-af33-3ec1ec22dd51"). InnerVolumeSpecName "kube-api-access-htzkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:23:39.063842 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.063723    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8b52607-1be7-4367-af33-3ec1ec22dd51-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b8b52607-1be7-4367-af33-3ec1ec22dd51" (UID: "b8b52607-1be7-4367-af33-3ec1ec22dd51"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:23:39.162429 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.162342    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8b52607-1be7-4367-af33-3ec1ec22dd51-proxy-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:23:39.162429 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.162374    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htzkq\" (UniqueName: \"kubernetes.io/projected/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-api-access-htzkq\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:23:39.162429 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.162384    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8b52607-1be7-4367-af33-3ec1ec22dd51-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:23:39.904344 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.904309    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz" event={"ID":"b8b52607-1be7-4367-af33-3ec1ec22dd51","Type":"ContainerDied","Data":"f5664e7da57103cd4c7cc979256fcfd67e7da8f37c6605bd7bc264af5176666b"}
Sep 17 17:23:39.904834 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.904371    2571 scope.go:117] "RemoveContainer" containerID="2e0761cf84709bd6b7f6e0d8b5d383e5bb1b057ea4abf21e70a55a4c6131527c"
Sep 17 17:23:39.904834 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.904318    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"
Sep 17 17:23:39.913589 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.913566    2571 scope.go:117] "RemoveContainer" containerID="1f1fdc3abae10273ae2db3a84aa1b3c326ca38388a279e620310a991e89966a2"
Sep 17 17:23:39.928701 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.928679    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"]
Sep 17 17:23:39.931659 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:39.931616    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2756e-predictor-5c99844f45-rhfvz"]
Sep 17 17:23:39.933364 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:23:39.933339    2571 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b52607_1be7_4367_af33_3ec1ec22dd51.slice\": RecentStats: unable to find data in memory cache]"
Sep 17 17:23:40.891026 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:23:40.890993    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" path="/var/lib/kubelet/pods/b8b52607-1be7-4367-af33-3ec1ec22dd51/volumes"
Sep 17 17:24:04.930620 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:24:04.930514    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:24:04.941299 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:24:04.936617    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:29:04.954416 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:29:04.954278    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:29:04.962001 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:29:04.961982    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:31:20.634013 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:20.633973    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"]
Sep 17 17:31:20.634582 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:20.634263    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kserve-container" containerID="cri-o://df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa" gracePeriod=30
Sep 17 17:31:20.634582 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:20.634295    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kube-rbac-proxy" containerID="cri-o://57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c" gracePeriod=30
Sep 17 17:31:21.677236 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:21.677205    2571 generic.go:356] "Generic (PLEG): container finished" podID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerID="57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c" exitCode=2
Sep 17 17:31:21.677613 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:21.677242    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" event={"ID":"13cdfc73-20d2-4162-a57a-29b7578fd666","Type":"ContainerDied","Data":"57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c"}
Sep 17 17:31:24.083122 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.083097    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:31:24.159771 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.159672    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13cdfc73-20d2-4162-a57a-29b7578fd666-proxy-tls\") pod \"13cdfc73-20d2-4162-a57a-29b7578fd666\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") "
Sep 17 17:31:24.159771 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.159740    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfl7f\" (UniqueName: \"kubernetes.io/projected/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-api-access-zfl7f\") pod \"13cdfc73-20d2-4162-a57a-29b7578fd666\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") "
Sep 17 17:31:24.159771 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.159774    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-rbac-proxy-sar-config\") pod \"13cdfc73-20d2-4162-a57a-29b7578fd666\" (UID: \"13cdfc73-20d2-4162-a57a-29b7578fd666\") "
Sep 17 17:31:24.160232 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.160208    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "13cdfc73-20d2-4162-a57a-29b7578fd666" (UID: "13cdfc73-20d2-4162-a57a-29b7578fd666"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:31:24.162004 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.161974    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13cdfc73-20d2-4162-a57a-29b7578fd666-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "13cdfc73-20d2-4162-a57a-29b7578fd666" (UID: "13cdfc73-20d2-4162-a57a-29b7578fd666"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:31:24.162004 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.161987    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-api-access-zfl7f" (OuterVolumeSpecName: "kube-api-access-zfl7f") pod "13cdfc73-20d2-4162-a57a-29b7578fd666" (UID: "13cdfc73-20d2-4162-a57a-29b7578fd666"). InnerVolumeSpecName "kube-api-access-zfl7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:31:24.260271 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.260226    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfl7f\" (UniqueName: \"kubernetes.io/projected/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-api-access-zfl7f\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:31:24.260271 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.260261    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/13cdfc73-20d2-4162-a57a-29b7578fd666-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:31:24.260271 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.260271    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13cdfc73-20d2-4162-a57a-29b7578fd666-proxy-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 17 17:31:24.690367 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.690335    2571 generic.go:356] "Generic (PLEG): container finished" podID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerID="df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa" exitCode=0
Sep 17 17:31:24.690538 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.690383    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"
Sep 17 17:31:24.690538 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.690424    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" event={"ID":"13cdfc73-20d2-4162-a57a-29b7578fd666","Type":"ContainerDied","Data":"df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa"}
Sep 17 17:31:24.690538 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.690485    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw" event={"ID":"13cdfc73-20d2-4162-a57a-29b7578fd666","Type":"ContainerDied","Data":"048f56acd6749ffa3d19436dbb478ca90eb99a3e02d1c424f8073d58a825bb33"}
Sep 17 17:31:24.690538 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.690512    2571 scope.go:117] "RemoveContainer" containerID="57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c"
Sep 17 17:31:24.699572 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.699556    2571 scope.go:117] "RemoveContainer" containerID="df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa"
Sep 17 17:31:24.707423 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.707406    2571 scope.go:117] "RemoveContainer" containerID="57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c"
Sep 17 17:31:24.707718 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:31:24.707699    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c\": container with ID starting with 57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c not found: ID does not exist" containerID="57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c"
Sep 17 17:31:24.707767 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.707727    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c"} err="failed to get container status \"57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c\": rpc error: code = NotFound desc = could not find container \"57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c\": container with ID starting with 57df5d259e4ebdb2aa09a0daae7532f8eaed89eeadd888a4abff38595e408a6c not found: ID does not exist"
Sep 17 17:31:24.707767 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.707744    2571 scope.go:117] "RemoveContainer" containerID="df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa"
Sep 17 17:31:24.707988 ip-10-0-143-228 kubenswrapper[2571]: E0917 17:31:24.707974    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa\": container with ID starting with df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa not found: ID does not exist" containerID="df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa"
Sep 17 17:31:24.708029 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.707992    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa"} err="failed to get container status \"df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa\": rpc error: code = NotFound desc = could not find container \"df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa\": container with ID starting with df2c7b02ae5fe86c48d44272f30bd644dff1313a3977b9ce27d9b00f863aefaa not found: ID does not exist"
Sep 17 17:31:24.713303 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.713279    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"]
Sep 17 17:31:24.717871 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.717848    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0d22-predictor-69c49986b7-kp9jw"]
Sep 17 17:31:24.891194 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:24.891162    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" path="/var/lib/kubelet/pods/13cdfc73-20d2-4162-a57a-29b7578fd666/volumes"
Sep 17 17:31:53.566344 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566258    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6kqg/must-gather-cdlqt"]
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566574    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kube-rbac-proxy"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566588    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kube-rbac-proxy"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566608    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kserve-container"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566620    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kserve-container"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566678    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kserve-container"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566689    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kserve-container"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566698    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kube-rbac-proxy"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566703    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kube-rbac-proxy"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566709    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kube-rbac-proxy"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566714    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kube-rbac-proxy"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566723    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kserve-container"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566729    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kserve-container"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566794    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kube-rbac-proxy"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566808    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kserve-container"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566816    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8b52607-1be7-4367-af33-3ec1ec22dd51" containerName="kserve-container"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566826    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb0cc532-47d1-445f-962f-ddecee228798" containerName="kube-rbac-proxy"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566834    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kube-rbac-proxy"
Sep 17 17:31:53.566830 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.566844    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="13cdfc73-20d2-4162-a57a-29b7578fd666" containerName="kserve-container"
Sep 17 17:31:53.569835 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.569816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6kqg/must-gather-cdlqt"
Sep 17 17:31:53.572753 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.572727    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6kqg\"/\"kube-root-ca.crt\""
Sep 17 17:31:53.573869 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.573854    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6kqg\"/\"openshift-service-ca.crt\""
Sep 17 17:31:53.573958 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.573897    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t6kqg\"/\"default-dockercfg-gk9tj\""
Sep 17 17:31:53.578909 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.578884    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6kqg/must-gather-cdlqt"]
Sep 17 17:31:53.579552 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.579530    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bwrb\" (UniqueName: \"kubernetes.io/projected/4800a11f-9a02-48ff-aec6-3faf3f001906-kube-api-access-7bwrb\") pod \"must-gather-cdlqt\" (UID: \"4800a11f-9a02-48ff-aec6-3faf3f001906\") " pod="openshift-must-gather-t6kqg/must-gather-cdlqt"
Sep 17 17:31:53.579613 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.579578    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4800a11f-9a02-48ff-aec6-3faf3f001906-must-gather-output\") pod \"must-gather-cdlqt\" (UID: \"4800a11f-9a02-48ff-aec6-3faf3f001906\") " pod="openshift-must-gather-t6kqg/must-gather-cdlqt"
Sep 17 17:31:53.680257 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.680217    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bwrb\" (UniqueName: \"kubernetes.io/projected/4800a11f-9a02-48ff-aec6-3faf3f001906-kube-api-access-7bwrb\") pod \"must-gather-cdlqt\" (UID: \"4800a11f-9a02-48ff-aec6-3faf3f001906\") " pod="openshift-must-gather-t6kqg/must-gather-cdlqt"
Sep 17 17:31:53.680436 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.680269    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4800a11f-9a02-48ff-aec6-3faf3f001906-must-gather-output\") pod \"must-gather-cdlqt\" (UID: \"4800a11f-9a02-48ff-aec6-3faf3f001906\") " pod="openshift-must-gather-t6kqg/must-gather-cdlqt"
Sep 17 17:31:53.680651 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.680613    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4800a11f-9a02-48ff-aec6-3faf3f001906-must-gather-output\") pod \"must-gather-cdlqt\" (UID: \"4800a11f-9a02-48ff-aec6-3faf3f001906\") " pod="openshift-must-gather-t6kqg/must-gather-cdlqt"
Sep 17 17:31:53.689014 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.688991    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bwrb\" (UniqueName: \"kubernetes.io/projected/4800a11f-9a02-48ff-aec6-3faf3f001906-kube-api-access-7bwrb\") pod \"must-gather-cdlqt\" (UID: \"4800a11f-9a02-48ff-aec6-3faf3f001906\") " pod="openshift-must-gather-t6kqg/must-gather-cdlqt"
Sep 17 17:31:53.888777 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:53.888692    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6kqg/must-gather-cdlqt"
Sep 17 17:31:54.161765 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:54.161675    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6kqg/must-gather-cdlqt"]
Sep 17 17:31:54.164730 ip-10-0-143-228 kubenswrapper[2571]: W0917 17:31:54.164693    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4800a11f_9a02_48ff_aec6_3faf3f001906.slice/crio-16f2b89e582fd55d206b10d4deeae356e6edcdb3b6abb7b3bd86c2ec17ccb970 WatchSource:0}: Error finding container 16f2b89e582fd55d206b10d4deeae356e6edcdb3b6abb7b3bd86c2ec17ccb970: Status 404 returned error can't find the container with id 16f2b89e582fd55d206b10d4deeae356e6edcdb3b6abb7b3bd86c2ec17ccb970
Sep 17 17:31:54.166664 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:54.166624    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:31:54.807425 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:54.807398    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6kqg/must-gather-cdlqt" event={"ID":"4800a11f-9a02-48ff-aec6-3faf3f001906","Type":"ContainerStarted","Data":"16f2b89e582fd55d206b10d4deeae356e6edcdb3b6abb7b3bd86c2ec17ccb970"}
Sep 17 17:31:55.817602 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:55.817567    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6kqg/must-gather-cdlqt" event={"ID":"4800a11f-9a02-48ff-aec6-3faf3f001906","Type":"ContainerStarted","Data":"84ccf2a6a349d8c3caa8e2b22abe1ddb9c87d06a0efe82a2b62401d32269c74f"}
Sep 17 17:31:55.818116 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:55.818086    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6kqg/must-gather-cdlqt" event={"ID":"4800a11f-9a02-48ff-aec6-3faf3f001906","Type":"ContainerStarted","Data":"82bbfe033869968f2cbe03ed6abd774a8865b1831129d07eda70e56ed22f25b3"}
Sep 17 17:31:55.835467 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:55.835397    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6kqg/must-gather-cdlqt" podStartSLOduration=2.193178221 podStartE2EDuration="2.835374645s" totalImagesPullingTime="642.196424ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:31:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:55.833988572 +0000 UTC m=+2873.132735312" watchObservedRunningTime="2026-09-17 17:31:55.835374645 +0000 UTC m=+2873.134121387"
Sep 17 17:31:56.268087 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:56.268056    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-klgkp_cbf5729d-3ed3-4da0-b9b9-45a5d851a373/global-pull-secret-syncer/0.log"
Sep 17 17:31:56.376087 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:56.376055    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jj6qr_d9f40078-4c30-4766-9964-c75481081c36/konnectivity-agent/0.log"
Sep 17 17:31:56.478714 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:31:56.478685    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-228.ec2.internal_9e70fcf4e6b756809a2612ebd8cc6497/haproxy/0.log"
Sep 17 17:32:00.314475 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:00.314445    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72014ec0-2fca-413c-b7d1-5c2e61b87ea3/alertmanager/0.log"
Sep 17 17:32:00.342729 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:00.342692    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72014ec0-2fca-413c-b7d1-5c2e61b87ea3/config-reloader/0.log"
Sep 17 17:32:00.371392 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:00.371364    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72014ec0-2fca-413c-b7d1-5c2e61b87ea3/kube-rbac-proxy-web/0.log"
Sep 17 17:32:00.392105 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:00.392081    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72014ec0-2fca-413c-b7d1-5c2e61b87ea3/kube-rbac-proxy/0.log"
Sep 17 17:32:00.411577 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:00.411492    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72014ec0-2fca-413c-b7d1-5c2e61b87ea3/kube-rbac-proxy-metric/0.log"
Sep 17 17:32:00.433959 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:00.433865    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72014ec0-2fca-413c-b7d1-5c2e61b87ea3/prom-label-proxy/0.log"
Sep 17 17:32:00.454596 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:00.454571    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72014ec0-2fca-413c-b7d1-5c2e61b87ea3/init-config-reloader/0.log"
Sep 17 17:32:00.680419 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:00.680325    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f55vr_51156d1b-1753-4c4b-98d9-4d6c7f72d8ec/node-exporter/0.log"
Sep 17 17:32:00.700189 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:00.700108    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f55vr_51156d1b-1753-4c4b-98d9-4d6c7f72d8ec/kube-rbac-proxy/0.log"
Sep 17 17:32:00.721329 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:00.721301    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f55vr_51156d1b-1753-4c4b-98d9-4d6c7f72d8ec/init-textfile/0.log"
Sep 17 17:32:04.794710 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.794664    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"]
Sep 17 17:32:04.801178 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.801143    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.807883 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.807852    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"]
Sep 17 17:32:04.881609 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.881550    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-lib-modules\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.881609 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.881614    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-sys\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.881874 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.881696    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxx9t\" (UniqueName: \"kubernetes.io/projected/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-kube-api-access-xxx9t\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.881874 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.881748    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-podres\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.881874 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.881832    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-proc\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.983247 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.983204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-proc\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.983430 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.983277    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-lib-modules\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.983430 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.983309    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-sys\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.983430 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.983329    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-proc\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.983430 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.983335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxx9t\" (UniqueName: \"kubernetes.io/projected/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-kube-api-access-xxx9t\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.983430 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.983418    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-podres\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.983622 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.983428    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-lib-modules\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.983622 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.983421    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-sys\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.983622 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.983501    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-podres\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:04.993145 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:04.993079    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxx9t\" (UniqueName: \"kubernetes.io/projected/e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb-kube-api-access-xxx9t\") pod \"perf-node-gather-daemonset-b4cdd\" (UID: \"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:05.116275 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:05.116245    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:05.376244 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:05.376154    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6qlrj_59248255-9996-415e-893a-5c55f072a164/dns/0.log"
Sep 17 17:32:05.395221 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:05.395180    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6qlrj_59248255-9996-415e-893a-5c55f072a164/kube-rbac-proxy/0.log"
Sep 17 17:32:05.403833 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:05.403801    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"]
Sep 17 17:32:05.407428 ip-10-0-143-228 kubenswrapper[2571]: W0917 17:32:05.407395    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode7bf5bbb_bd4f_49f4_b838_2cc6a2ed00bb.slice/crio-c3856698e1fb60120b4561e27a18fe47d2036f23d8c89b4e4a4983f49270b989 WatchSource:0}: Error finding container c3856698e1fb60120b4561e27a18fe47d2036f23d8c89b4e4a4983f49270b989: Status 404 returned error can't find the container with id c3856698e1fb60120b4561e27a18fe47d2036f23d8c89b4e4a4983f49270b989
Sep 17 17:32:05.531742 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:05.528919    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qrbkk_ebfe5a84-b861-42d0-8872-a150201e5f06/dns-node-resolver/0.log"
Sep 17 17:32:05.881228 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:05.881191    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd" event={"ID":"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb","Type":"ContainerStarted","Data":"d9a1ae6d092767dd18f40c5630c53d5e24ab4645fec29b7ddae96e908cbe6249"}
Sep 17 17:32:05.881608 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:05.881289    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd" event={"ID":"e7bf5bbb-bd4f-49f4-b838-2cc6a2ed00bb","Type":"ContainerStarted","Data":"c3856698e1fb60120b4561e27a18fe47d2036f23d8c89b4e4a4983f49270b989"}
Sep 17 17:32:05.881608 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:05.881316    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:05.899105 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:05.899039    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd" podStartSLOduration=1.899016891 podStartE2EDuration="1.899016891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:32:05.8974345 +0000 UTC m=+2883.196181245" watchObservedRunningTime="2026-09-17 17:32:05.899016891 +0000 UTC m=+2883.197763631"
Sep 17 17:32:06.124306 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:06.124272    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cm58d_92c8b0e9-8317-4b4f-afb0-7d9e4df469ea/node-ca/0.log"
Sep 17 17:32:07.243260 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:07.243226    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fvsld_8def3d02-2c1e-442a-9eae-a5aab4c47610/serve-healthcheck-canary/0.log"
Sep 17 17:32:07.835060 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:07.835029    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l2m4k_2566a007-9e99-4d74-ab9c-a11f95f45478/kube-rbac-proxy/0.log"
Sep 17 17:32:07.854960 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:07.854924    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l2m4k_2566a007-9e99-4d74-ab9c-a11f95f45478/exporter/0.log"
Sep 17 17:32:07.873828 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:07.873801    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l2m4k_2566a007-9e99-4d74-ab9c-a11f95f45478/extractor/0.log"
Sep 17 17:32:10.151162 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:10.151129    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-846cf5d849-kg2qx_7bd8f2f7-c4d3-48a5-90ef-1acc084dde03/manager/0.log"
Sep 17 17:32:10.181202 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:10.181143    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-kwt62_4016c45c-052d-46d7-9897-ecfb22999029/manager/0.log"
Sep 17 17:32:10.200339 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:10.200316    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-76bk9_8a43a361-2548-4a4e-872d-af1f34f7a713/server/0.log"
Sep 17 17:32:10.298955 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:10.298923    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-7b966d7984-nbw44_c8b7293c-7891-4902-b475-0af08c17c6f5/manager/0.log"
Sep 17 17:32:10.378155 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:10.378126    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-z2xq6_0ca5f46f-4958-4e0b-8caf-1e08af43d961/seaweedfs/0.log"
Sep 17 17:32:11.895521 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:11.895491    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-b4cdd"
Sep 17 17:32:16.036811 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:16.036780    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2k258_edd7139d-c5f9-4116-9874-81a64a742b90/kube-multus/0.log"
Sep 17 17:32:16.062577 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:16.062550    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hnmt_26fae68a-5b43-4922-80b0-85e02d657dcb/kube-multus-additional-cni-plugins/0.log"
Sep 17 17:32:16.088184 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:16.088154    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hnmt_26fae68a-5b43-4922-80b0-85e02d657dcb/egress-router-binary-copy/0.log"
Sep 17 17:32:16.107912 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:16.107883    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hnmt_26fae68a-5b43-4922-80b0-85e02d657dcb/cni-plugins/0.log"
Sep 17 17:32:16.126064 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:16.126037    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hnmt_26fae68a-5b43-4922-80b0-85e02d657dcb/bond-cni-plugin/0.log"
Sep 17 17:32:16.144985 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:16.144953    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hnmt_26fae68a-5b43-4922-80b0-85e02d657dcb/routeoverride-cni/0.log"
Sep 17 17:32:16.165879 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:16.165855    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hnmt_26fae68a-5b43-4922-80b0-85e02d657dcb/whereabouts-cni-bincopy/0.log"
Sep 17 17:32:16.184557 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:16.184479    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hnmt_26fae68a-5b43-4922-80b0-85e02d657dcb/whereabouts-cni/0.log"
Sep 17 17:32:16.722071 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:16.722024    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pbvnw_7740d182-6376-444a-815f-d023d12adb99/network-metrics-daemon/0.log"
Sep 17 17:32:16.746530 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:16.746484    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pbvnw_7740d182-6376-444a-815f-d023d12adb99/kube-rbac-proxy/0.log"
Sep 17 17:32:17.528560 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:17.528532    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-controller/0.log"
Sep 17 17:32:17.545523 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:17.545494    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/1.log"
Sep 17 17:32:17.545703 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:17.545538    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovn-acl-logging/0.log"
Sep 17 17:32:17.562698 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:17.562670    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/kube-rbac-proxy-node/0.log"
Sep 17 17:32:17.583163 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:17.583125    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 17:32:17.604866 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:17.604839    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/northd/0.log"
Sep 17 17:32:17.624060 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:17.624030    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/nbdb/0.log"
Sep 17 17:32:17.645171 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:17.645145    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/sbdb/0.log"
Sep 17 17:32:17.683033 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:17.683000    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jtwdg_205bc652-451f-483f-8ef3-c736c1b8078e/ovnkube-controller/0.log"
Sep 17 17:32:19.207475 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:19.207439    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5rsr7_761a0949-beec-4697-8f72-c03e252b6acb/network-check-target-container/0.log"
Sep 17 17:32:20.148424 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:20.148389    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dpzks_2c4df0ad-6bfa-4618-96e2-ccdfb53fc446/iptables-alerter/0.log"
Sep 17 17:32:20.917527 ip-10-0-143-228 kubenswrapper[2571]: I0917 17:32:20.917491    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-7g7mq_875335d5-a53b-482b-aef5-2fb2363bfa9d/tuned/0.log"