Apr 16 16:45:05.011673 ip-10-0-139-227 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Apr 16 16:45:05.011688 ip-10-0-139-227 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Apr 16 16:45:05.011699 ip-10-0-139-227 systemd[1]: kubelet.service: Failed with result 'resources'.
Apr 16 16:45:05.012012 ip-10-0-139-227 systemd[1]: Failed to start Kubernetes Kubelet.
Apr 16 16:45:15.228848 ip-10-0-139-227 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Apr 16 16:45:15.228866 ip-10-0-139-227 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot be563fef3cb14ba0ad6a6d9201198ed1 --
Apr 16 16:47:40.977083 ip-10-0-139-227 systemd[1]: Starting Kubernetes Kubelet...
Apr 16 16:47:41.437030 ip-10-0-139-227 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 16 16:47:41.437030 ip-10-0-139-227 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Apr 16 16:47:41.437030 ip-10-0-139-227 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 16 16:47:41.437030 ip-10-0-139-227 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Apr 16 16:47:41.437030 ip-10-0-139-227 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 16 16:47:41.440532 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.440436    2569 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Apr 16 16:47:41.445820 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445786    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Apr 16 16:47:41.445820 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445817    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Apr 16 16:47:41.445820 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445823    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Apr 16 16:47:41.445820 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445827    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445832    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445836    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445840    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445844    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445849    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445853    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445857    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445861    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445865    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445868    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445880    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445885    2569 feature_gate.go:328] unrecognized feature gate: Example2
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445889    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445893    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445896    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445900    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445904    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445908    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445912    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Apr 16 16:47:41.446063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445915    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445919    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445923    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445927    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445931    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445935    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445939    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445943    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445947    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445953    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445960    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445965    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445972    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445977    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445983    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445988    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445994    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.445999    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446003    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Apr 16 16:47:41.446909 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446008    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446012    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446016    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446021    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446025    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446032    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446036    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446041    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446045    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446050    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446054    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446058    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446062    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446066    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446070    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446074    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446079    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446083    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446086    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446091    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Apr 16 16:47:41.447588 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446095    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446099    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446104    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446108    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446113    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446117    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446121    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446127    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446131    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446136    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446141    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446145    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446149    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446153    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446158    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446162    2569 feature_gate.go:328] unrecognized feature gate: Example
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446167    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446171    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446176    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Apr 16 16:47:41.448186 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446181    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446187    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446192    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446196    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446201    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446790    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446819    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446823    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446828    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446831    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446836    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446840    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446844    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446848    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446852    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446856    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446861    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446865    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446870    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Apr 16 16:47:41.448642 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446875    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446879    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446884    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446888    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446893    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446897    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446901    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446905    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446909    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446913    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446917    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446922    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446927    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446931    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446935    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446939    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446943    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446948    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446953    2569 feature_gate.go:328] unrecognized feature gate: Example2
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446957    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Apr 16 16:47:41.449123 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446961    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446965    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446969    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446973    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446977    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446981    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446986    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446990    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446994    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.446999    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447004    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447008    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447013    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447017    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447022    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447026    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447030    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447035    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447039    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447043    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Apr 16 16:47:41.449617 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447047    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447052    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447056    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447060    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447065    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447069    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447074    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447078    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447082    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447086    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447091    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447098    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447104    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447109    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447115    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447119    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447124    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447128    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447133    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Apr 16 16:47:41.450133 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447138    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447142    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447148    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447154    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447159    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447164    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447169    2569 feature_gate.go:328] unrecognized feature gate: Example
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447174    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447178    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447182    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447186    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447190    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.447194    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447915    2569 flags.go:64] FLAG: --address="0.0.0.0"
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447929    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447941    2569 flags.go:64] FLAG: --anonymous-auth="true"
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447948    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447956    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447961    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447969    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447977    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Apr 16 16:47:41.450593 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447982    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447987    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447993    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.447998    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448003    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448008    2569 flags.go:64] FLAG: --cgroup-root=""
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448013    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448019    2569 flags.go:64] FLAG: --client-ca-file=""
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448023    2569 flags.go:64] FLAG: --cloud-config=""
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448028    2569 flags.go:64] FLAG: --cloud-provider="external"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448033    2569 flags.go:64] FLAG: --cluster-dns="[]"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448039    2569 flags.go:64] FLAG: --cluster-domain=""
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448043    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448049    2569 flags.go:64] FLAG: --config-dir=""
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448053    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448059    2569 flags.go:64] FLAG: --container-log-max-files="5"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448087    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448107    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448111    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448116    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448119    2569 flags.go:64] FLAG: --contention-profiling="false"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448123    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448127    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448131    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448134    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Apr 16 16:47:41.451118 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448140    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448143    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448147    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448150    2569 flags.go:64] FLAG: --enable-load-reader="false"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448153    2569 flags.go:64] FLAG: --enable-server="true"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448156    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448164    2569 flags.go:64] FLAG: --event-burst="100"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448168    2569 flags.go:64] FLAG: --event-qps="50"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448171    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448176    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448179    2569 flags.go:64] FLAG: --eviction-hard=""
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448183    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448186    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448189    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448193    2569 flags.go:64] FLAG: --eviction-soft=""
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448196    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448199    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448218    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448223    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448227    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448230    2569 flags.go:64] FLAG: --fail-swap-on="true"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448233    2569 flags.go:64] FLAG: --feature-gates=""
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448237    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448241    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448245    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Apr 16 16:47:41.451742 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448249    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448252    2569 flags.go:64] FLAG: --healthz-port="10248"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448255    2569 flags.go:64] FLAG: --help="false"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448258    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448262    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448265    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448268    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448272    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448276    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448279    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448282    2569 flags.go:64] FLAG: --image-service-endpoint=""
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448285    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448288    2569 flags.go:64] FLAG: --kube-api-burst="100"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448291    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448295    2569 flags.go:64] FLAG: --kube-api-qps="50"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448298    2569 flags.go:64] FLAG: --kube-reserved=""
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448301    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448305    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448308    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448311    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448314    2569 flags.go:64] FLAG: --lock-file=""
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448317    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448320    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448323    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Apr 16 16:47:41.452459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448329    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448332    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448335    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448338    2569 flags.go:64] FLAG: --logging-format="text"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448341    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448344    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448348    2569 flags.go:64] FLAG: --manifest-url=""
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448351    2569 flags.go:64] FLAG: --manifest-url-header=""
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448356    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448360    2569 flags.go:64] FLAG: --max-open-files="1000000"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448364    2569 flags.go:64] FLAG: --max-pods="110"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448367    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448371    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448374    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448377    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448380    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448383    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448386    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448394    2569 flags.go:64] FLAG: --node-status-max-images="50"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448397    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448400    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448403    2569 flags.go:64] FLAG: --pod-cidr=""
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448406    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc76bab72f320de3d4105c90d73c4fb139c09e20ce0fa8dcbc0cb59920d27dec"
Apr 16 16:47:41.453101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448412    2569 flags.go:64] FLAG: --pod-manifest-path=""
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448415    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448418    2569 flags.go:64] FLAG: --pods-per-core="0"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448422    2569 flags.go:64] FLAG: --port="10250"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448425    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448429    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08281d7bb3ff3c0bf"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448432    2569 flags.go:64] FLAG: --qos-reserved=""
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448435    2569 flags.go:64] FLAG: --read-only-port="10255"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448439    2569 flags.go:64] FLAG: --register-node="true"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448442    2569 flags.go:64] FLAG: --register-schedulable="true"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448444    2569 flags.go:64] FLAG: --register-with-taints=""
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448449    2569 flags.go:64] FLAG: --registry-burst="10"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448452    2569 flags.go:64] FLAG: --registry-qps="5"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448455    2569 flags.go:64] FLAG: --reserved-cpus=""
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448458    2569 flags.go:64] FLAG: --reserved-memory=""
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448461    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448465    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448468    2569 flags.go:64] FLAG: --rotate-certificates="false"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448471    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448474    2569 flags.go:64] FLAG: --runonce="false"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448477    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448480    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448483    2569 flags.go:64] FLAG: --seccomp-default="false"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448486    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448489    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448492    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Apr 16 16:47:41.453663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448495    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448498    2569 flags.go:64] FLAG: --storage-driver-password="root"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448501    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448504    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448507    2569 flags.go:64] FLAG: --storage-driver-user="root"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448510    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448513    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448516    2569 flags.go:64] FLAG: --system-cgroups=""
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448519    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448525    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448528    2569 flags.go:64] FLAG: --tls-cert-file=""
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448531    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448538    2569 flags.go:64] FLAG: --tls-min-version=""
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448541    2569 flags.go:64] FLAG: --tls-private-key-file=""
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448545    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448548    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448551    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448554    2569 flags.go:64] FLAG: --v="2"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448558    2569 flags.go:64] FLAG: --version="false"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448562    2569 flags.go:64] FLAG: --vmodule=""
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448566    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448570    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448673    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448677    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Apr 16 16:47:41.454342 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448681    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448693    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448696    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448699    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448702    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448705    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448708    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448711    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448713    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448716    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448719    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448722    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448725    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448728    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448731    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448734    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448736    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448739    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448742    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448745    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Apr 16 16:47:41.454930 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448749    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448752    2569 feature_gate.go:328] unrecognized feature gate: Example
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448754    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448757    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448760    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448762    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448766    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448768    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448771    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448774    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448776    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448779    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448781    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448784    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448787    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448789    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448808    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448811    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448814    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Apr 16 16:47:41.455434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448816    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448819    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448821    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448826    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448830    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448832    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448835    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448838    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448841    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448844    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448846    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448849    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448852    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448857    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448860    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448863    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448865    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448868    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448871    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Apr 16 16:47:41.455913 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448873    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448877    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448879    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448882    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448884    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448887    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448890    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448893    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448895    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448898    2569 feature_gate.go:328] unrecognized feature gate: Example2
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448902    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448905    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448909    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448912    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448914    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448917    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448920    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448923    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448925    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448928    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Apr 16 16:47:41.456388 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448931    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Apr 16 16:47:41.457022 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448934    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Apr 16 16:47:41.457022 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448937    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Apr 16 16:47:41.457022 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448940    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Apr 16 16:47:41.457022 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448942    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Apr 16 16:47:41.457022 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.448945    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Apr 16 16:47:41.457022 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.448955    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Apr 16 16:47:41.457356 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.457336    2569 server.go:530] "Kubelet version" kubeletVersion="v1.33.9"
Apr 16 16:47:41.457388 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.457356    2569 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Apr 16 16:47:41.457421 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457404    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Apr 16 16:47:41.457421 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457408    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Apr 16 16:47:41.457421 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457411    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Apr 16 16:47:41.457421 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457415    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Apr 16 16:47:41.457421 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457418    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Apr 16 16:47:41.457421 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457421    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Apr 16 16:47:41.457421 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457424    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457428    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457431    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457433    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457436    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457439    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457442    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457445    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457447    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457450    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457453    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457455    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457458    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457461    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457463    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457466    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457469    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457472    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457475    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457477    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Apr 16 16:47:41.457599 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457480    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457482    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457485    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457488    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457491    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457494    2569 feature_gate.go:328] unrecognized feature gate: Example
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457496    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457499    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457501    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457504    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457507    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457510    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457513    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457516    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457519    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457522    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457525    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457527    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457530    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457533    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Apr 16 16:47:41.458142 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457536    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457540    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457544    2569 feature_gate.go:328] unrecognized feature gate: Example2
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457548    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457550    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457553    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457556    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457558    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457561    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457564    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457566    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457569    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457573    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457577    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457580    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457583    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457586    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457589    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457592    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Apr 16 16:47:41.458636 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457594    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457597    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457600    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457603    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457606    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457609    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457611    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457614    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457617    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457620    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457622    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457626    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457628    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457631    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457634    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457637    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457639    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457642    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457644    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457647    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Apr 16 16:47:41.459148 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457650    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.457655    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457745    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457749    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457753    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457756    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457758    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457761    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457764    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457767    2569 feature_gate.go:328] unrecognized feature gate: Example
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457769    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457773    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457777    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457780    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457784    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Apr 16 16:47:41.459640 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457786    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457790    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457810    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457815    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457819    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457822    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457825    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457828    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457831    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457834    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457837    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457840    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457842    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457845    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457848    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457851    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457853    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457856    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457858    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457861    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Apr 16 16:47:41.460038 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457864    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457866    2569 feature_gate.go:328] unrecognized feature gate: Example2
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457869    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457872    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457875    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457877    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457880    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457883    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457885    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457888    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457891    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457893    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457896    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457899    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457902    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457905    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457907    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457910    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457913    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457915    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Apr 16 16:47:41.460524 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457918    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457921    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457924    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457927    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457930    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457933    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457936    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457938    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457941    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457943    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457946    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457949    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457951    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457954    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457956    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457959    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457961    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457964    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457967    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457969    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Apr 16 16:47:41.461047 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457972    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457974    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457977    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457979    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457982    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457986    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457990    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457992    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457995    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.457998    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.458000    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.458003    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:41.458006    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.458011    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Apr 16 16:47:41.461526 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.458676    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Apr 16 16:47:41.461893 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.460707    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Apr 16 16:47:41.461893 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.461697    2569 server.go:1019] "Starting client certificate rotation"
Apr 16 16:47:41.461893 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.461790    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Apr 16 16:47:41.461893 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.461844    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Apr 16 16:47:41.488743 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.488725    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Apr 16 16:47:41.491380 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.491363    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Apr 16 16:47:41.519446 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.519425    2569 log.go:25] "Validated CRI v1 runtime API"
Apr 16 16:47:41.522921 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.522902    2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Apr 16 16:47:41.525549 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.525535    2569 log.go:25] "Validated CRI v1 image API"
Apr 16 16:47:41.526938 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.526923    2569 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Apr 16 16:47:41.530869 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.530846    2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c9ce8d5d-b606-45d8-a3f4-75ad06f376a9:/dev/nvme0n1p3 ef04ff78-faf9-4b1f-99d9-e13c26921021:/dev/nvme0n1p4]
Apr 16 16:47:41.530938 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.530867    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Apr 16 16:47:41.536952 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.536847    2569 manager.go:217] Machine: {Timestamp:2026-04-16 16:47:41.534917433 +0000 UTC m=+0.435668809 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100268 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24d8a0dc187e2840be63caace10c35 SystemUUID:ec24d8a0-dc18-7e28-40be-63caace10c35 BootID:be563fef-3cb1-4ba0-ad6a-6d9201198ed1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6098944 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cc:00:4d:3d:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cc:00:4d:3d:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:72:cd:47:59:ee Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Apr 16 16:47:41.536952 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.536950    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Apr 16 16:47:41.537065 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.537050    2569 manager.go:233] Version: {KernelVersion:5.14.0-570.104.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260401-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Apr 16 16:47:41.540043 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.539867    2569 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Apr 16 16:47:41.540216 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.540048    2569 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-227.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Apr 16 16:47:41.540296 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.540230    2569 topology_manager.go:138] "Creating topology manager with none policy"
Apr 16 16:47:41.540296 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.540244    2569 container_manager_linux.go:306] "Creating device plugin manager"
Apr 16 16:47:41.540296 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.540263    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Apr 16 16:47:41.541339 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.541327    2569 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Apr 16 16:47:41.542696 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.542684    2569 state_mem.go:36] "Initialized new in-memory state store"
Apr 16 16:47:41.542854 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.542842    2569 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Apr 16 16:47:41.544622 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.544604    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2w4g7"
Apr 16 16:47:41.545455 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.545443    2569 kubelet.go:491] "Attempting to sync node with API server"
Apr 16 16:47:41.545518 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.545463    2569 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Apr 16 16:47:41.545518 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.545479    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Apr 16 16:47:41.545518 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.545494    2569 kubelet.go:397] "Adding apiserver pod source"
Apr 16 16:47:41.545518 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.545505    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Apr 16 16:47:41.546578 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.546565    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Apr 16 16:47:41.546651 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.546588    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Apr 16 16:47:41.549274 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.549259    2569 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1"
Apr 16 16:47:41.560968 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.560947    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2w4g7"
Apr 16 16:47:41.562026 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.562006    2569 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Apr 16 16:47:41.563500 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563487    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Apr 16 16:47:41.563562 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563504    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Apr 16 16:47:41.563562 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563510    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Apr 16 16:47:41.563562 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563516    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Apr 16 16:47:41.563562 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563521    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Apr 16 16:47:41.563562 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563527    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Apr 16 16:47:41.563562 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563533    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Apr 16 16:47:41.563562 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563538    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Apr 16 16:47:41.563562 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563545    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Apr 16 16:47:41.563562 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563551    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Apr 16 16:47:41.563562 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563559    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Apr 16 16:47:41.563857 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.563568    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Apr 16 16:47:41.565177 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.565163    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Apr 16 16:47:41.565177 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.565176    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Apr 16 16:47:41.568880 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.568865    2569 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Apr 16 16:47:41.568953 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.568902    2569 server.go:1295] "Started kubelet"
Apr 16 16:47:41.569019 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.568985    2569 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Apr 16 16:47:41.569073 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.569001    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Apr 16 16:47:41.569073 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.569045    2569 server_v1.go:47] "podresources" method="list" useActivePods=true
Apr 16 16:47:41.569383 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.569367    2569 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 16 16:47:41.569883 ip-10-0-139-227 systemd[1]: Started Kubernetes Kubelet.
Apr 16 16:47:41.570173 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.570152    2569 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Apr 16 16:47:41.570909 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.570861    2569 server.go:317] "Adding debug handlers to kubelet server"
Apr 16 16:47:41.571975 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.571954    2569 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 16 16:47:41.575553 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.575537    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Apr 16 16:47:41.576092 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.576075    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Apr 16 16:47:41.577021 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:41.576981    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-227.ec2.internal\" not found"
Apr 16 16:47:41.577203 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577179    2569 factory.go:153] Registering CRI-O factory
Apr 16 16:47:41.577273 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577233    2569 factory.go:223] Registration of the crio container factory successfully
Apr 16 16:47:41.577273 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:41.577230    2569 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Apr 16 16:47:41.577375 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577297    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Apr 16 16:47:41.577375 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577309    2569 factory.go:55] Registering systemd factory
Apr 16 16:47:41.577375 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577311    2569 volume_manager.go:295] "The desired_state_of_world populator starts"
Apr 16 16:47:41.577375 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577356    2569 volume_manager.go:297] "Starting Kubelet Volume Manager"
Apr 16 16:47:41.577566 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577318    2569 factory.go:223] Registration of the systemd container factory successfully
Apr 16 16:47:41.577566 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577386    2569 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Apr 16 16:47:41.577566 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577410    2569 factory.go:103] Registering Raw factory
Apr 16 16:47:41.577566 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577428    2569 manager.go:1196] Started watching for new ooms in manager
Apr 16 16:47:41.577566 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577463    2569 reconstruct.go:97] "Volume reconstruction finished"
Apr 16 16:47:41.577566 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.577471    2569 reconciler.go:26] "Reconciler: start to sync state"
Apr 16 16:47:41.578590 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.578570    2569 manager.go:319] Starting recovery of all containers
Apr 16 16:47:41.579439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.579417    2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 16 16:47:41.580306 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.580287    2569 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-227.ec2.internal" not found
Apr 16 16:47:41.581571 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:41.581550    2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-227.ec2.internal\" not found" node="ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.591329 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.591183    2569 manager.go:324] Recovery completed
Apr 16 16:47:41.592490 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:41.592474    2569 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Apr 16 16:47:41.595867 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.595851    2569 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-227.ec2.internal" not found
Apr 16 16:47:41.595958 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.595945    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Apr 16 16:47:41.597658 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.597644    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-227.ec2.internal" event="NodeHasSufficientMemory"
Apr 16 16:47:41.597716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.597675    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-227.ec2.internal" event="NodeHasNoDiskPressure"
Apr 16 16:47:41.597716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.597685    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-227.ec2.internal" event="NodeHasSufficientPID"
Apr 16 16:47:41.598202 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.598189    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Apr 16 16:47:41.598202 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.598200    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Apr 16 16:47:41.598295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.598216    2569 state_mem.go:36] "Initialized new in-memory state store"
Apr 16 16:47:41.600500 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.600487    2569 policy_none.go:49] "None policy: Start"
Apr 16 16:47:41.600546 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.600503    2569 memory_manager.go:186] "Starting memorymanager" policy="None"
Apr 16 16:47:41.600546 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.600513    2569 state_mem.go:35] "Initializing new in-memory state store"
Apr 16 16:47:41.637347 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.637333    2569 manager.go:341] "Starting Device Plugin manager"
Apr 16 16:47:41.644961 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:41.637359    2569 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Apr 16 16:47:41.644961 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.637368    2569 server.go:85] "Starting device plugin registration server"
Apr 16 16:47:41.644961 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.637593    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Apr 16 16:47:41.644961 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.637605    2569 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Apr 16 16:47:41.644961 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.637766    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Apr 16 16:47:41.644961 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.637848    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Apr 16 16:47:41.644961 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.637855    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Apr 16 16:47:41.644961 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:41.638194    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Apr 16 16:47:41.644961 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:41.638221    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-227.ec2.internal\" not found"
Apr 16 16:47:41.666014 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.665999    2569 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-227.ec2.internal" not found
Apr 16 16:47:41.706818 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.706749    2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Apr 16 16:47:41.707928 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.707914    2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Apr 16 16:47:41.708021 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.707942    2569 status_manager.go:230] "Starting to sync pod status with apiserver"
Apr 16 16:47:41.708021 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.707962    2569 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Apr 16 16:47:41.708021 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.707977    2569 kubelet.go:2451] "Starting kubelet main sync loop"
Apr 16 16:47:41.708152 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:41.708015    2569 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Apr 16 16:47:41.711088 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.711069    2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 16 16:47:41.738250 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.738234    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Apr 16 16:47:41.739034 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.739021    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-227.ec2.internal" event="NodeHasSufficientMemory"
Apr 16 16:47:41.739094 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.739045    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-227.ec2.internal" event="NodeHasNoDiskPressure"
Apr 16 16:47:41.739094 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.739067    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-227.ec2.internal" event="NodeHasSufficientPID"
Apr 16 16:47:41.739094 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.739095    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.749341 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.749323    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.808866 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.808832    2569 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-227.ec2.internal"]
Apr 16 16:47:41.811643 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.811624    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.811725 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.811626    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.834306 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.834284    2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.838663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.838647    2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.845979 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.845966    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Apr 16 16:47:41.878965 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.878943    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8843cc356802eac373d4d79680a04c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal\" (UID: \"f8843cc356802eac373d4d79680a04c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.879040 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.878985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8843cc356802eac373d4d79680a04c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal\" (UID: \"f8843cc356802eac373d4d79680a04c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.879040 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.879001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3790cf888bcb006af761d10ed316a9f7-config\") pod \"kube-apiserver-proxy-ip-10-0-139-227.ec2.internal\" (UID: \"3790cf888bcb006af761d10ed316a9f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.932086 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.932071    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Apr 16 16:47:41.979472 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.979421    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8843cc356802eac373d4d79680a04c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal\" (UID: \"f8843cc356802eac373d4d79680a04c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.979547 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.979476    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8843cc356802eac373d4d79680a04c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal\" (UID: \"f8843cc356802eac373d4d79680a04c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.979547 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.979494    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3790cf888bcb006af761d10ed316a9f7-config\") pod \"kube-apiserver-proxy-ip-10-0-139-227.ec2.internal\" (UID: \"3790cf888bcb006af761d10ed316a9f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.979547 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.979508    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8843cc356802eac373d4d79680a04c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal\" (UID: \"f8843cc356802eac373d4d79680a04c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.979547 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.979521    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8843cc356802eac373d4d79680a04c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal\" (UID: \"f8843cc356802eac373d4d79680a04c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:41.979665 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:41.979579    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3790cf888bcb006af761d10ed316a9f7-config\") pod \"kube-apiserver-proxy-ip-10-0-139-227.ec2.internal\" (UID: \"3790cf888bcb006af761d10ed316a9f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:42.150558 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.150513    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:42.236396 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.236315    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal"
Apr 16 16:47:42.461627 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.461590    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Apr 16 16:47:42.462342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.461821    2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Apr 16 16:47:42.462342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.461788    2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Apr 16 16:47:42.462342 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.461822    2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Apr 16 16:47:42.545858 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.545759    2569 apiserver.go:52] "Watching apiserver"
Apr 16 16:47:42.553663 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.553632    2569 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Apr 16 16:47:42.556915 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.556886    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-ljvpw","openshift-dns/node-resolver-szz5j","openshift-image-registry/node-ca-k8bx9","openshift-multus/multus-7mtwf","openshift-multus/multus-additional-cni-plugins-kzrf9","openshift-ovn-kubernetes/ovnkube-node-z7xdk","kube-system/kube-apiserver-proxy-ip-10-0-139-227.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal","openshift-multus/network-metrics-daemon-t57ts","openshift-network-diagnostics/network-check-target-c7j5m","openshift-network-operator/iptables-alerter-sl4vz","kube-system/konnectivity-agent-drbvd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"]
Apr 16 16:47:42.560097 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.560076    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.561326 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.561298    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-szz5j"
Apr 16 16:47:42.562402 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.562373    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-15 16:42:41 +0000 UTC" deadline="2027-09-14 18:42:06.788815929 +0000 UTC"
Apr 16 16:47:42.562402 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.562394    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k8bx9"
Apr 16 16:47:42.562402 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.562398    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12385h54m24.226420691s"
Apr 16 16:47:42.562571 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.562484    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.563708 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.563686    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.563816 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.563775    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2c9dm\""
Apr 16 16:47:42.563816 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.563783    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Apr 16 16:47:42.563924 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.563785    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Apr 16 16:47:42.564091 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.564074    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Apr 16 16:47:42.564174 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.564158    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vkzzw\""
Apr 16 16:47:42.564340 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.564325    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Apr 16 16:47:42.564414 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.564400    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Apr 16 16:47:42.564991 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.564810    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Apr 16 16:47:42.564991 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.564822    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Apr 16 16:47:42.564991 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.564871    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Apr 16 16:47:42.564991 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.564890    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qg6jz\""
Apr 16 16:47:42.564991 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.564890    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Apr 16 16:47:42.564991 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.564960    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hnwcx\""
Apr 16 16:47:42.565319 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.565083    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Apr 16 16:47:42.565319 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.565101    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Apr 16 16:47:42.565319 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.565145    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.566229 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.566212    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Apr 16 16:47:42.566317 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.566221    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Apr 16 16:47:42.566388 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.566323    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:42.566441 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:42.566400    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:47:42.566782 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.566767    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vbwx8\""
Apr 16 16:47:42.567334 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.567317    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Apr 16 16:47:42.567413 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.567347    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Apr 16 16:47:42.567699 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.567686    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p5pmh\""
Apr 16 16:47:42.567738 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.567707    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Apr 16 16:47:42.567778 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.567765    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:42.567880 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:42.567845    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:47:42.567952 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.567924    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Apr 16 16:47:42.568029 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.567992    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Apr 16 16:47:42.568130 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.568111    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Apr 16 16:47:42.569318 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.569301    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sl4vz"
Apr 16 16:47:42.570557 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.570539    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:47:42.571372 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.571352    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Apr 16 16:47:42.571482 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.571420    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Apr 16 16:47:42.571575 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.571564    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wlmjm\""
Apr 16 16:47:42.571818 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.571790    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Apr 16 16:47:42.571898 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.571810    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.572924 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.572904    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Apr 16 16:47:42.573051 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.572937    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Apr 16 16:47:42.573051 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.572943    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9cs84\""
Apr 16 16:47:42.573902 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.573886    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Apr 16 16:47:42.574147 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.574134    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Apr 16 16:47:42.574200 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.574157    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Apr 16 16:47:42.574233 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.574206    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sf5tz\""
Apr 16 16:47:42.575700 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.575688    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Apr 16 16:47:42.580413 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.579661    2569 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Apr 16 16:47:42.582614 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582595    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.582688 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582622    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-cni-bin\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.582688 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582645    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6gcw\" (UniqueName: \"kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw\") pod \"network-check-target-c7j5m\" (UID: \"172397d5-6eec-4fb9-a90f-18f769743e08\") " pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:42.582757 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582681    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-run-k8s-cni-cncf-io\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.582757 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582712    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9eff2a2f-c317-48bf-af6d-e22e8d69b90d-konnectivity-ca\") pod \"konnectivity-agent-drbvd\" (UID: \"9eff2a2f-c317-48bf-af6d-e22e8d69b90d\") " pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:47:42.582757 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582733    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-sys-fs\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.582757 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582751    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bce462c6-480f-4662-93cd-1f3623c1ab4e-cni-binary-copy\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.582934 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582767    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.582934 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582790    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.582934 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582824    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8xmg\" (UniqueName: \"kubernetes.io/projected/fd31177f-5733-4747-bedd-2bfd23a1dc00-kube-api-access-s8xmg\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.582934 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582860    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-run-openvswitch\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.582934 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582886    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/850a1a3c-96d9-47b8-9797-28615fc9806a-env-overrides\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.582934 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582905    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-cni-dir\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.582934 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582920    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-run-multus-certs\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.582934 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-log-socket\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.583155 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.582975    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-var-lib-cni-multus\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.583155 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-cnibin\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.583155 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583018    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vlnm\" (UniqueName: \"kubernetes.io/projected/cffe5d0c-d081-4b1e-b883-472bec4cfc56-kube-api-access-5vlnm\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:42.583155 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-socket-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.583155 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-slash\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.583155 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583096    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-var-lib-kubelet\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.583155 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583111    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-hostroot\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.583155 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583125    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9eff2a2f-c317-48bf-af6d-e22e8d69b90d-agent-certs\") pod \"konnectivity-agent-drbvd\" (UID: \"9eff2a2f-c317-48bf-af6d-e22e8d69b90d\") " pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:47:42.583155 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-etc-selinux\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.583155 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583153    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/850a1a3c-96d9-47b8-9797-28615fc9806a-ovnkube-script-lib\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583188    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-run\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583210    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-system-cni-dir\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583224    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-var-lib-openvswitch\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583237    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ab0c49d-05ab-4c86-a82d-772183938b38-tmp\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583252    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-conf-dir\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583285    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsnr5\" (UniqueName: \"kubernetes.io/projected/850a1a3c-96d9-47b8-9797-28615fc9806a-kube-api-access-wsnr5\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583310    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88hxv\" (UniqueName: \"kubernetes.io/projected/4ab0c49d-05ab-4c86-a82d-772183938b38-kube-api-access-88hxv\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583328    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-os-release\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583344    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcxws\" (UniqueName: \"kubernetes.io/projected/220bc941-c238-4d62-abcb-aae86d4e0e35-kube-api-access-kcxws\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583360    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjdqm\" (UniqueName: \"kubernetes.io/projected/cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c-kube-api-access-hjdqm\") pod \"node-resolver-szz5j\" (UID: \"cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c\") " pod="openshift-dns/node-resolver-szz5j"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583374    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8fcr\" (UniqueName: \"kubernetes.io/projected/e6e03468-e748-4fcf-bc8a-7ee1b325454e-kube-api-access-x8fcr\") pod \"node-ca-k8bx9\" (UID: \"e6e03468-e748-4fcf-bc8a-7ee1b325454e\") " pod="openshift-image-registry/node-ca-k8bx9"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583388    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-run-netns\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583411    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-etc-openvswitch\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.583439 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583429    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-node-log\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/850a1a3c-96d9-47b8-9797-28615fc9806a-ovn-node-metrics-cert\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583467    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-lib-modules\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583482    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-var-lib-kubelet\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583495    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-var-lib-cni-bin\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583510    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-sysconfig\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583523    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-tuned\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583539    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/220bc941-c238-4d62-abcb-aae86d4e0e35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583563    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-registration-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583580    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6e03468-e748-4fcf-bc8a-7ee1b325454e-host\") pod \"node-ca-k8bx9\" (UID: \"e6e03468-e748-4fcf-bc8a-7ee1b325454e\") " pod="openshift-image-registry/node-ca-k8bx9"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583620    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-kubelet\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583635    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-cni-netd\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583651    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94f2fbf5-07e0-4121-85c9-882b6a9a4bbd-iptables-alerter-script\") pod \"iptables-alerter-sl4vz\" (UID: \"94f2fbf5-07e0-4121-85c9-882b6a9a4bbd\") " pod="openshift-network-operator/iptables-alerter-sl4vz"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583666    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-host\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583681    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/220bc941-c238-4d62-abcb-aae86d4e0e35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583696    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-kubernetes\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.583834 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583714    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-socket-dir-parent\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkqlx\" (UniqueName: \"kubernetes.io/projected/bce462c6-480f-4662-93cd-1f3623c1ab4e-kube-api-access-tkqlx\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583751    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583770    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/850a1a3c-96d9-47b8-9797-28615fc9806a-ovnkube-config\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583785    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-modprobe-d\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583834    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-sysctl-d\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-sysctl-conf\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583886    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-cnibin\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583907    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-run-netns\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583921    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-etc-kubernetes\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583950    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-os-release\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583973    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6e03468-e748-4fcf-bc8a-7ee1b325454e-serviceca\") pod \"node-ca-k8bx9\" (UID: \"e6e03468-e748-4fcf-bc8a-7ee1b325454e\") " pod="openshift-image-registry/node-ca-k8bx9"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.583991    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-run-systemd\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584007    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584028    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-device-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c-hosts-file\") pod \"node-resolver-szz5j\" (UID: \"cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c\") " pod="openshift-dns/node-resolver-szz5j"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584058    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c-tmp-dir\") pod \"node-resolver-szz5j\" (UID: \"cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c\") " pod="openshift-dns/node-resolver-szz5j"
Apr 16 16:47:42.584295 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584085    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-run-ovn\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.584749 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584106    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94f2fbf5-07e0-4121-85c9-882b6a9a4bbd-host-slash\") pod \"iptables-alerter-sl4vz\" (UID: \"94f2fbf5-07e0-4121-85c9-882b6a9a4bbd\") " pod="openshift-network-operator/iptables-alerter-sl4vz"
Apr 16 16:47:42.584749 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584126    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-daemon-config\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.584749 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-systemd-units\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.584749 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584158    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fjtv\" (UniqueName: \"kubernetes.io/projected/94f2fbf5-07e0-4121-85c9-882b6a9a4bbd-kube-api-access-4fjtv\") pod \"iptables-alerter-sl4vz\" (UID: \"94f2fbf5-07e0-4121-85c9-882b6a9a4bbd\") " pod="openshift-network-operator/iptables-alerter-sl4vz"
Apr 16 16:47:42.584749 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584174    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-systemd\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.584749 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-sys\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.584749 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584209    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-system-cni-dir\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.584749 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.584237    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/220bc941-c238-4d62-abcb-aae86d4e0e35-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.613533 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.613506    2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Apr 16 16:47:42.613675 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.613581    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kz8wk"
Apr 16 16:47:42.616968 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.616945    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kz8wk"
Apr 16 16:47:42.684859 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.684830    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6e03468-e748-4fcf-bc8a-7ee1b325454e-host\") pod \"node-ca-k8bx9\" (UID: \"e6e03468-e748-4fcf-bc8a-7ee1b325454e\") " pod="openshift-image-registry/node-ca-k8bx9"
Apr 16 16:47:42.684974 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.684867    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-kubelet\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.684974 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.684892    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-cni-netd\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.684974 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.684924    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6e03468-e748-4fcf-bc8a-7ee1b325454e-host\") pod \"node-ca-k8bx9\" (UID: \"e6e03468-e748-4fcf-bc8a-7ee1b325454e\") " pod="openshift-image-registry/node-ca-k8bx9"
Apr 16 16:47:42.684974 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.684939    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-cni-netd\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.684974 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.684970    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-kubelet\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.685120 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.684999    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94f2fbf5-07e0-4121-85c9-882b6a9a4bbd-iptables-alerter-script\") pod \"iptables-alerter-sl4vz\" (UID: \"94f2fbf5-07e0-4121-85c9-882b6a9a4bbd\") " pod="openshift-network-operator/iptables-alerter-sl4vz"
Apr 16 16:47:42.685120 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685028    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-host\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.685120 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685045    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/220bc941-c238-4d62-abcb-aae86d4e0e35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.685120 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685074    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-kubernetes\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.685120 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685090    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-socket-dir-parent\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.685120 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685107    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkqlx\" (UniqueName: \"kubernetes.io/projected/bce462c6-480f-4662-93cd-1f3623c1ab4e-kube-api-access-tkqlx\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.685120 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685114    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-host\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.685399 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685170    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-socket-dir-parent\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.685399 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685164    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-kubernetes\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.685399 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685222    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:42.685399 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685256    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/850a1a3c-96d9-47b8-9797-28615fc9806a-ovnkube-config\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.685399 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685283    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-modprobe-d\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.685399 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685300    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-sysctl-d\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.685399 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:42.685321    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:42.685399 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685314    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-sysctl-conf\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.685399 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685358    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-cnibin\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.685399 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685380    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-run-netns\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:42.685415    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs podName:cffe5d0c-d081-4b1e-b883-472bec4cfc56 nodeName:}" failed. No retries permitted until 2026-04-16 16:47:43.185381931 +0000 UTC m=+2.086133306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs") pod "network-metrics-daemon-t57ts" (UID: "cffe5d0c-d081-4b1e-b883-472bec4cfc56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685457    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-etc-kubernetes\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685463    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-sysctl-d\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685485    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-os-release\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685514    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6e03468-e748-4fcf-bc8a-7ee1b325454e-serviceca\") pod \"node-ca-k8bx9\" (UID: \"e6e03468-e748-4fcf-bc8a-7ee1b325454e\") " pod="openshift-image-registry/node-ca-k8bx9"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685542    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-run-systemd\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685566    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-sysctl-conf\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685570    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685602    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-device-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685634    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c-hosts-file\") pod \"node-resolver-szz5j\" (UID: \"cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c\") " pod="openshift-dns/node-resolver-szz5j"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685648    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-cnibin\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685660    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c-tmp-dir\") pod \"node-resolver-szz5j\" (UID: \"cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c\") " pod="openshift-dns/node-resolver-szz5j"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685672    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94f2fbf5-07e0-4121-85c9-882b6a9a4bbd-iptables-alerter-script\") pod \"iptables-alerter-sl4vz\" (UID: \"94f2fbf5-07e0-4121-85c9-882b6a9a4bbd\") " pod="openshift-network-operator/iptables-alerter-sl4vz"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685689    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-run-ovn\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685704    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/220bc941-c238-4d62-abcb-aae86d4e0e35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685724    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94f2fbf5-07e0-4121-85c9-882b6a9a4bbd-host-slash\") pod \"iptables-alerter-sl4vz\" (UID: \"94f2fbf5-07e0-4121-85c9-882b6a9a4bbd\") " pod="openshift-network-operator/iptables-alerter-sl4vz"
Apr 16 16:47:42.685853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685413    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-run-netns\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685754    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-os-release\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685792    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685814    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-run-systemd\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685604    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-modprobe-d\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685847    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c-hosts-file\") pod \"node-resolver-szz5j\" (UID: \"cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c\") " pod="openshift-dns/node-resolver-szz5j"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685910    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-etc-kubernetes\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685955    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-run-ovn\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.685952    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-device-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686017    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94f2fbf5-07e0-4121-85c9-882b6a9a4bbd-host-slash\") pod \"iptables-alerter-sl4vz\" (UID: \"94f2fbf5-07e0-4121-85c9-882b6a9a4bbd\") " pod="openshift-network-operator/iptables-alerter-sl4vz"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686059    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c-tmp-dir\") pod \"node-resolver-szz5j\" (UID: \"cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c\") " pod="openshift-dns/node-resolver-szz5j"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686070    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/850a1a3c-96d9-47b8-9797-28615fc9806a-ovnkube-config\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686242    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6e03468-e748-4fcf-bc8a-7ee1b325454e-serviceca\") pod \"node-ca-k8bx9\" (UID: \"e6e03468-e748-4fcf-bc8a-7ee1b325454e\") " pod="openshift-image-registry/node-ca-k8bx9"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686250    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-daemon-config\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686286    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-systemd-units\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686302    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fjtv\" (UniqueName: \"kubernetes.io/projected/94f2fbf5-07e0-4121-85c9-882b6a9a4bbd-kube-api-access-4fjtv\") pod \"iptables-alerter-sl4vz\" (UID: \"94f2fbf5-07e0-4121-85c9-882b6a9a4bbd\") " pod="openshift-network-operator/iptables-alerter-sl4vz"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686324    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-systemd\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686347    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-sys\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.686460 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686372    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-system-cni-dir\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686376    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-systemd-units\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686419    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/220bc941-c238-4d62-abcb-aae86d4e0e35-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686446    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-sys\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686455    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686453    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-systemd\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686483    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-cni-bin\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686518    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-cni-bin\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686522    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686469    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-system-cni-dir\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686513    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6gcw\" (UniqueName: \"kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw\") pod \"network-check-target-c7j5m\" (UID: \"172397d5-6eec-4fb9-a90f-18f769743e08\") " pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686564    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-run-k8s-cni-cncf-io\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686594    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9eff2a2f-c317-48bf-af6d-e22e8d69b90d-konnectivity-ca\") pod \"konnectivity-agent-drbvd\" (UID: \"9eff2a2f-c317-48bf-af6d-e22e8d69b90d\") " pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686623    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-sys-fs\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686645    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-run-k8s-cni-cncf-io\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686647    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bce462c6-480f-4662-93cd-1f3623c1ab4e-cni-binary-copy\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686681    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.687207 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686708    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686727    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-daemon-config\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686734    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8xmg\" (UniqueName: \"kubernetes.io/projected/fd31177f-5733-4747-bedd-2bfd23a1dc00-kube-api-access-s8xmg\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686754    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-sys-fs\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686762    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-run-openvswitch\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686819    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-run-openvswitch\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686829    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/850a1a3c-96d9-47b8-9797-28615fc9806a-env-overrides\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.686847    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687237    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/220bc941-c238-4d62-abcb-aae86d4e0e35-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687023    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-cni-dir\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687403    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-cni-dir\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687436    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bce462c6-480f-4662-93cd-1f3623c1ab4e-cni-binary-copy\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687464    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-run-multus-certs\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687524    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-run-multus-certs\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687559    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-log-socket\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687587    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9eff2a2f-c317-48bf-af6d-e22e8d69b90d-konnectivity-ca\") pod \"konnectivity-agent-drbvd\" (UID: \"9eff2a2f-c317-48bf-af6d-e22e8d69b90d\") " pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687594    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-var-lib-cni-multus\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.687996 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687615    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687627    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-cnibin\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687663    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vlnm\" (UniqueName: \"kubernetes.io/projected/cffe5d0c-d081-4b1e-b883-472bec4cfc56-kube-api-access-5vlnm\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687678    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-log-socket\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687734    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-var-lib-cni-multus\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687688    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-socket-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687783    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/220bc941-c238-4d62-abcb-aae86d4e0e35-cnibin\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687791    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-slash\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687838    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-socket-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687858    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/850a1a3c-96d9-47b8-9797-28615fc9806a-env-overrides\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687855    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-var-lib-kubelet\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687927    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-var-lib-kubelet\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687989    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-hostroot\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688031    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-hostroot\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688040    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9eff2a2f-c317-48bf-af6d-e22e8d69b90d-agent-certs\") pod \"konnectivity-agent-drbvd\" (UID: \"9eff2a2f-c317-48bf-af6d-e22e8d69b90d\") " pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688069    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-etc-selinux\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.687991    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-slash\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688130    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/850a1a3c-96d9-47b8-9797-28615fc9806a-ovnkube-script-lib\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.688716 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688165    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-run\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688154    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-etc-selinux\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688194    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-system-cni-dir\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688233    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-var-lib-openvswitch\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688266    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ab0c49d-05ab-4c86-a82d-772183938b38-tmp\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688298    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-conf-dir\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688280    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-run\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688342    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsnr5\" (UniqueName: \"kubernetes.io/projected/850a1a3c-96d9-47b8-9797-28615fc9806a-kube-api-access-wsnr5\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688378    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-var-lib-openvswitch\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688380    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88hxv\" (UniqueName: \"kubernetes.io/projected/4ab0c49d-05ab-4c86-a82d-772183938b38-kube-api-access-88hxv\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688494    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-os-release\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688511    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688526    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcxws\" (UniqueName: \"kubernetes.io/projected/220bc941-c238-4d62-abcb-aae86d4e0e35-kube-api-access-kcxws\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688658    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjdqm\" (UniqueName: \"kubernetes.io/projected/cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c-kube-api-access-hjdqm\") pod \"node-resolver-szz5j\" (UID: \"cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c\") " pod="openshift-dns/node-resolver-szz5j"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688703    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8fcr\" (UniqueName: \"kubernetes.io/projected/e6e03468-e748-4fcf-bc8a-7ee1b325454e-kube-api-access-x8fcr\") pod \"node-ca-k8bx9\" (UID: \"e6e03468-e748-4fcf-bc8a-7ee1b325454e\") " pod="openshift-image-registry/node-ca-k8bx9"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688763    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-run-netns\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688753    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/850a1a3c-96d9-47b8-9797-28615fc9806a-ovnkube-script-lib\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688826    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-etc-openvswitch\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.689543 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688857    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-node-log\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688883    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-multus-conf-dir\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.688957    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-node-log\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689074    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/850a1a3c-96d9-47b8-9797-28615fc9806a-ovn-node-metrics-cert\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689106    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-lib-modules\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689139    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-var-lib-kubelet\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689169    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-var-lib-cni-bin\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689196    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-os-release\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689231    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-var-lib-kubelet\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689292    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-etc-openvswitch\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689273    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/850a1a3c-96d9-47b8-9797-28615fc9806a-host-run-netns\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689356    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-system-cni-dir\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689397    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bce462c6-480f-4662-93cd-1f3623c1ab4e-host-var-lib-cni-bin\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689466    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-sysconfig\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689514    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-lib-modules\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689512    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-tuned\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689557    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/220bc941-c238-4d62-abcb-aae86d4e0e35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689592    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-registration-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.690297 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689683    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd31177f-5733-4747-bedd-2bfd23a1dc00-registration-dir\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.691032 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.689771    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-sysconfig\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.691032 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.690111    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/220bc941-c238-4d62-abcb-aae86d4e0e35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.692777 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.692747    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ab0c49d-05ab-4c86-a82d-772183938b38-tmp\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.692979 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.692959    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ab0c49d-05ab-4c86-a82d-772183938b38-etc-tuned\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.693017 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.692950    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/850a1a3c-96d9-47b8-9797-28615fc9806a-ovn-node-metrics-cert\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.693050 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.692964    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9eff2a2f-c317-48bf-af6d-e22e8d69b90d-agent-certs\") pod \"konnectivity-agent-drbvd\" (UID: \"9eff2a2f-c317-48bf-af6d-e22e8d69b90d\") " pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:47:42.699214 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:42.699136    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 16 16:47:42.699214 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:42.699170    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 16 16:47:42.699214 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:42.699186    2569 projected.go:194] Error preparing data for projected volume kube-api-access-b6gcw for pod openshift-network-diagnostics/network-check-target-c7j5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:42.699463 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:42.699338    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw podName:172397d5-6eec-4fb9-a90f-18f769743e08 nodeName:}" failed. No retries permitted until 2026-04-16 16:47:43.199317198 +0000 UTC m=+2.100068577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b6gcw" (UniqueName: "kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw") pod "network-check-target-c7j5m" (UID: "172397d5-6eec-4fb9-a90f-18f769743e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:42.699821 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.699778    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fjtv\" (UniqueName: \"kubernetes.io/projected/94f2fbf5-07e0-4121-85c9-882b6a9a4bbd-kube-api-access-4fjtv\") pod \"iptables-alerter-sl4vz\" (UID: \"94f2fbf5-07e0-4121-85c9-882b6a9a4bbd\") " pod="openshift-network-operator/iptables-alerter-sl4vz"
Apr 16 16:47:42.699914 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.699826    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkqlx\" (UniqueName: \"kubernetes.io/projected/bce462c6-480f-4662-93cd-1f3623c1ab4e-kube-api-access-tkqlx\") pod \"multus-7mtwf\" (UID: \"bce462c6-480f-4662-93cd-1f3623c1ab4e\") " pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.702220 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.702182    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8xmg\" (UniqueName: \"kubernetes.io/projected/fd31177f-5733-4747-bedd-2bfd23a1dc00-kube-api-access-s8xmg\") pod \"aws-ebs-csi-driver-node-42rwv\" (UID: \"fd31177f-5733-4747-bedd-2bfd23a1dc00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.702552 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.702524    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjdqm\" (UniqueName: \"kubernetes.io/projected/cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c-kube-api-access-hjdqm\") pod \"node-resolver-szz5j\" (UID: \"cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c\") " pod="openshift-dns/node-resolver-szz5j"
Apr 16 16:47:42.702662 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.702560    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcxws\" (UniqueName: \"kubernetes.io/projected/220bc941-c238-4d62-abcb-aae86d4e0e35-kube-api-access-kcxws\") pod \"multus-additional-cni-plugins-kzrf9\" (UID: \"220bc941-c238-4d62-abcb-aae86d4e0e35\") " pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.702662 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.702609    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8fcr\" (UniqueName: \"kubernetes.io/projected/e6e03468-e748-4fcf-bc8a-7ee1b325454e-kube-api-access-x8fcr\") pod \"node-ca-k8bx9\" (UID: \"e6e03468-e748-4fcf-bc8a-7ee1b325454e\") " pod="openshift-image-registry/node-ca-k8bx9"
Apr 16 16:47:42.702772 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.702707    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vlnm\" (UniqueName: \"kubernetes.io/projected/cffe5d0c-d081-4b1e-b883-472bec4cfc56-kube-api-access-5vlnm\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:42.703112 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.703093    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsnr5\" (UniqueName: \"kubernetes.io/projected/850a1a3c-96d9-47b8-9797-28615fc9806a-kube-api-access-wsnr5\") pod \"ovnkube-node-z7xdk\" (UID: \"850a1a3c-96d9-47b8-9797-28615fc9806a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.703487 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.703471    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88hxv\" (UniqueName: \"kubernetes.io/projected/4ab0c49d-05ab-4c86-a82d-772183938b38-kube-api-access-88hxv\") pod \"tuned-ljvpw\" (UID: \"4ab0c49d-05ab-4c86-a82d-772183938b38\") " pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.829287 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:42.829255    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8843cc356802eac373d4d79680a04c3.slice/crio-0264ebbfb9451a780d5398a47c60c179312f78dea5da764e513cee9a8070edb7 WatchSource:0}: Error finding container 0264ebbfb9451a780d5398a47c60c179312f78dea5da764e513cee9a8070edb7: Status 404 returned error can't find the container with id 0264ebbfb9451a780d5398a47c60c179312f78dea5da764e513cee9a8070edb7
Apr 16 16:47:42.833092 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.833076    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 16 16:47:42.888559 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.888532    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ljvpw"
Apr 16 16:47:42.894363 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:42.894339    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab0c49d_05ab_4c86_a82d_772183938b38.slice/crio-01b59534b77684978db0c583856365b5e4840ba03c67d911b4a70c0967931eb1 WatchSource:0}: Error finding container 01b59534b77684978db0c583856365b5e4840ba03c67d911b4a70c0967931eb1: Status 404 returned error can't find the container with id 01b59534b77684978db0c583856365b5e4840ba03c67d911b4a70c0967931eb1
Apr 16 16:47:42.897975 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.897863    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-szz5j"
Apr 16 16:47:42.903434 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:42.903414    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7e4bc2_b2b4_4b2f_b0b8_f88edc4b502c.slice/crio-a948f19fde89aceb9ed5adff6ecd7d317c62f3e2c1ff3b17a85166c82d8c0fc5 WatchSource:0}: Error finding container a948f19fde89aceb9ed5adff6ecd7d317c62f3e2c1ff3b17a85166c82d8c0fc5: Status 404 returned error can't find the container with id a948f19fde89aceb9ed5adff6ecd7d317c62f3e2c1ff3b17a85166c82d8c0fc5
Apr 16 16:47:42.914642 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.914623    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k8bx9"
Apr 16 16:47:42.920063 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:42.920040    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e03468_e748_4fcf_bc8a_7ee1b325454e.slice/crio-716901bc0f8741c64203d7b6d2334d1ead45bd152406a8f45eb29bcf0e424b8e WatchSource:0}: Error finding container 716901bc0f8741c64203d7b6d2334d1ead45bd152406a8f45eb29bcf0e424b8e: Status 404 returned error can't find the container with id 716901bc0f8741c64203d7b6d2334d1ead45bd152406a8f45eb29bcf0e424b8e
Apr 16 16:47:42.930360 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.930343    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7mtwf"
Apr 16 16:47:42.935625 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:42.935590    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce462c6_480f_4662_93cd_1f3623c1ab4e.slice/crio-e460cf92347e2ca1ddd24bd8b4b541800e1441ad802f25dbba398fe46b9bd69b WatchSource:0}: Error finding container e460cf92347e2ca1ddd24bd8b4b541800e1441ad802f25dbba398fe46b9bd69b: Status 404 returned error can't find the container with id e460cf92347e2ca1ddd24bd8b4b541800e1441ad802f25dbba398fe46b9bd69b
Apr 16 16:47:42.942429 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.942407    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kzrf9"
Apr 16 16:47:42.945979 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.945965    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:47:42.950065 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:42.950039    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod220bc941_c238_4d62_abcb_aae86d4e0e35.slice/crio-0a956fd2d20592f362ffd758c40728983b518077f7b8eaa0998ba3ddc5348112 WatchSource:0}: Error finding container 0a956fd2d20592f362ffd758c40728983b518077f7b8eaa0998ba3ddc5348112: Status 404 returned error can't find the container with id 0a956fd2d20592f362ffd758c40728983b518077f7b8eaa0998ba3ddc5348112
Apr 16 16:47:42.954931 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:42.954869    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850a1a3c_96d9_47b8_9797_28615fc9806a.slice/crio-a3862e77b778a38bb1d0c59059dce79be5451959d3551eae81ab63d5b0d79cda WatchSource:0}: Error finding container a3862e77b778a38bb1d0c59059dce79be5451959d3551eae81ab63d5b0d79cda: Status 404 returned error can't find the container with id a3862e77b778a38bb1d0c59059dce79be5451959d3551eae81ab63d5b0d79cda
Apr 16 16:47:42.962247 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.962226    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sl4vz"
Apr 16 16:47:42.968007 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:42.967985    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f2fbf5_07e0_4121_85c9_882b6a9a4bbd.slice/crio-a26af205e99c0a3690113fb169f98409ad5657d90a2f62e2bb88b5815f9bb06d WatchSource:0}: Error finding container a26af205e99c0a3690113fb169f98409ad5657d90a2f62e2bb88b5815f9bb06d: Status 404 returned error can't find the container with id a26af205e99c0a3690113fb169f98409ad5657d90a2f62e2bb88b5815f9bb06d
Apr 16 16:47:42.980240 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.980217    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:47:42.984842 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:42.984820    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv"
Apr 16 16:47:42.986149 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:42.986124    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eff2a2f_c317_48bf_af6d_e22e8d69b90d.slice/crio-a679d3d7afc3e714b5c5016bc5fa2a92450788df37e7eea667b7f6ab79b5f5ba WatchSource:0}: Error finding container a679d3d7afc3e714b5c5016bc5fa2a92450788df37e7eea667b7f6ab79b5f5ba: Status 404 returned error can't find the container with id a679d3d7afc3e714b5c5016bc5fa2a92450788df37e7eea667b7f6ab79b5f5ba
Apr 16 16:47:42.991248 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:42.991227    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd31177f_5733_4747_bedd_2bfd23a1dc00.slice/crio-1bcb0ce582521db2fc97032755b7782506da0b3091bb9febae3544480ca4cd2b WatchSource:0}: Error finding container 1bcb0ce582521db2fc97032755b7782506da0b3091bb9febae3544480ca4cd2b: Status 404 returned error can't find the container with id 1bcb0ce582521db2fc97032755b7782506da0b3091bb9febae3544480ca4cd2b
Apr 16 16:47:43.073079 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:47:43.073051    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3790cf888bcb006af761d10ed316a9f7.slice/crio-8f77971be9879f2e10b1b696a09109ad3a4d23961bfc58ff537ae46d5959abd8 WatchSource:0}: Error finding container 8f77971be9879f2e10b1b696a09109ad3a4d23961bfc58ff537ae46d5959abd8: Status 404 returned error can't find the container with id 8f77971be9879f2e10b1b696a09109ad3a4d23961bfc58ff537ae46d5959abd8
Apr 16 16:47:43.193810 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.193760    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:43.193994 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:43.193932    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:43.194059 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:43.194004    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs podName:cffe5d0c-d081-4b1e-b883-472bec4cfc56 nodeName:}" failed. No retries permitted until 2026-04-16 16:47:44.193984029 +0000 UTC m=+3.094735395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs") pod "network-metrics-daemon-t57ts" (UID: "cffe5d0c-d081-4b1e-b883-472bec4cfc56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:43.295145 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.294978    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6gcw\" (UniqueName: \"kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw\") pod \"network-check-target-c7j5m\" (UID: \"172397d5-6eec-4fb9-a90f-18f769743e08\") " pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:43.295463 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:43.295161    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 16 16:47:43.295463 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:43.295182    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 16 16:47:43.295463 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:43.295195    2569 projected.go:194] Error preparing data for projected volume kube-api-access-b6gcw for pod openshift-network-diagnostics/network-check-target-c7j5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:43.295463 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:43.295446    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw podName:172397d5-6eec-4fb9-a90f-18f769743e08 nodeName:}" failed. No retries permitted until 2026-04-16 16:47:44.295422049 +0000 UTC m=+3.196173413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6gcw" (UniqueName: "kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw") pod "network-check-target-c7j5m" (UID: "172397d5-6eec-4fb9-a90f-18f769743e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:43.533141 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.533046    2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 16 16:47:43.619345 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.619304    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-15 16:42:42 +0000 UTC" deadline="2027-10-19 09:01:03.452364273 +0000 UTC"
Apr 16 16:47:43.619345 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.619341    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13216h13m19.83302702s"
Apr 16 16:47:43.730833 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.730762    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7mtwf" event={"ID":"bce462c6-480f-4662-93cd-1f3623c1ab4e","Type":"ContainerStarted","Data":"e460cf92347e2ca1ddd24bd8b4b541800e1441ad802f25dbba398fe46b9bd69b"}
Apr 16 16:47:43.739866 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.739827    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-szz5j" event={"ID":"cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c","Type":"ContainerStarted","Data":"a948f19fde89aceb9ed5adff6ecd7d317c62f3e2c1ff3b17a85166c82d8c0fc5"}
Apr 16 16:47:43.756970 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.756041    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ljvpw" event={"ID":"4ab0c49d-05ab-4c86-a82d-772183938b38","Type":"ContainerStarted","Data":"01b59534b77684978db0c583856365b5e4840ba03c67d911b4a70c0967931eb1"}
Apr 16 16:47:43.765910 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.765848    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv" event={"ID":"fd31177f-5733-4747-bedd-2bfd23a1dc00","Type":"ContainerStarted","Data":"1bcb0ce582521db2fc97032755b7782506da0b3091bb9febae3544480ca4cd2b"}
Apr 16 16:47:43.766248 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.766222    2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 16 16:47:43.787443 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.787302    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drbvd" event={"ID":"9eff2a2f-c317-48bf-af6d-e22e8d69b90d","Type":"ContainerStarted","Data":"a679d3d7afc3e714b5c5016bc5fa2a92450788df37e7eea667b7f6ab79b5f5ba"}
Apr 16 16:47:43.807614 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.807575    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k8bx9" event={"ID":"e6e03468-e748-4fcf-bc8a-7ee1b325454e","Type":"ContainerStarted","Data":"716901bc0f8741c64203d7b6d2334d1ead45bd152406a8f45eb29bcf0e424b8e"}
Apr 16 16:47:43.830780 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.830465    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal" event={"ID":"f8843cc356802eac373d4d79680a04c3","Type":"ContainerStarted","Data":"0264ebbfb9451a780d5398a47c60c179312f78dea5da764e513cee9a8070edb7"}
Apr 16 16:47:43.851620 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.851549    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-227.ec2.internal" event={"ID":"3790cf888bcb006af761d10ed316a9f7","Type":"ContainerStarted","Data":"8f77971be9879f2e10b1b696a09109ad3a4d23961bfc58ff537ae46d5959abd8"}
Apr 16 16:47:43.869889 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.869829    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sl4vz" event={"ID":"94f2fbf5-07e0-4121-85c9-882b6a9a4bbd","Type":"ContainerStarted","Data":"a26af205e99c0a3690113fb169f98409ad5657d90a2f62e2bb88b5815f9bb06d"}
Apr 16 16:47:43.904141 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.904098    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk" event={"ID":"850a1a3c-96d9-47b8-9797-28615fc9806a","Type":"ContainerStarted","Data":"a3862e77b778a38bb1d0c59059dce79be5451959d3551eae81ab63d5b0d79cda"}
Apr 16 16:47:43.914107 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.914055    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzrf9" event={"ID":"220bc941-c238-4d62-abcb-aae86d4e0e35","Type":"ContainerStarted","Data":"0a956fd2d20592f362ffd758c40728983b518077f7b8eaa0998ba3ddc5348112"}
Apr 16 16:47:43.934459 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:43.934423    2569 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 16 16:47:44.201685 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:44.201647    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:44.201933 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:44.201845    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:44.201933 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:44.201914    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs podName:cffe5d0c-d081-4b1e-b883-472bec4cfc56 nodeName:}" failed. No retries permitted until 2026-04-16 16:47:46.20189441 +0000 UTC m=+5.102645776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs") pod "network-metrics-daemon-t57ts" (UID: "cffe5d0c-d081-4b1e-b883-472bec4cfc56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:44.302577 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:44.302537    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6gcw\" (UniqueName: \"kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw\") pod \"network-check-target-c7j5m\" (UID: \"172397d5-6eec-4fb9-a90f-18f769743e08\") " pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:44.302758 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:44.302703    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 16 16:47:44.302758 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:44.302721    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 16 16:47:44.302758 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:44.302734    2569 projected.go:194] Error preparing data for projected volume kube-api-access-b6gcw for pod openshift-network-diagnostics/network-check-target-c7j5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:44.302943 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:44.302807    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw podName:172397d5-6eec-4fb9-a90f-18f769743e08 nodeName:}" failed. No retries permitted until 2026-04-16 16:47:46.302773045 +0000 UTC m=+5.203524411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6gcw" (UniqueName: "kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw") pod "network-check-target-c7j5m" (UID: "172397d5-6eec-4fb9-a90f-18f769743e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:44.620023 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:44.619981    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-15 16:42:42 +0000 UTC" deadline="2027-11-23 16:04:23.808958545 +0000 UTC"
Apr 16 16:47:44.620023 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:44.620022    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14063h16m39.188940933s"
Apr 16 16:47:44.708483 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:44.708450    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:44.708780 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:44.708589    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:47:44.709084 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:44.709053    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:44.709188 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:44.709163    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:47:46.224432 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.224330    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:46.224955 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:46.224570    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:46.224955 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:46.224642    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs podName:cffe5d0c-d081-4b1e-b883-472bec4cfc56 nodeName:}" failed. No retries permitted until 2026-04-16 16:47:50.22462194 +0000 UTC m=+9.125373304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs") pod "network-metrics-daemon-t57ts" (UID: "cffe5d0c-d081-4b1e-b883-472bec4cfc56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:46.324918 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.324881    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6gcw\" (UniqueName: \"kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw\") pod \"network-check-target-c7j5m\" (UID: \"172397d5-6eec-4fb9-a90f-18f769743e08\") " pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:46.325090 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:46.325036    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 16 16:47:46.325090 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:46.325058    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 16 16:47:46.325090 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:46.325071    2569 projected.go:194] Error preparing data for projected volume kube-api-access-b6gcw for pod openshift-network-diagnostics/network-check-target-c7j5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:46.325247 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:46.325143    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw podName:172397d5-6eec-4fb9-a90f-18f769743e08 nodeName:}" failed. No retries permitted until 2026-04-16 16:47:50.325121686 +0000 UTC m=+9.225873065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6gcw" (UniqueName: "kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw") pod "network-check-target-c7j5m" (UID: "172397d5-6eec-4fb9-a90f-18f769743e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:46.686236 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.685525    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lk2fq"]
Apr 16 16:47:46.688101 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.688078    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:46.688222 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:46.688158    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:47:46.709265 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.708972    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:46.709265 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:46.709059    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:47:46.709265 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.709211    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:46.709434 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:46.709312    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:47:46.728043 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.728014    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-kubelet-config\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:46.728166 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.728079    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:46.728166 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.728134    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-dbus\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:46.829430 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.828926    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-dbus\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:46.829430 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.829003    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-kubelet-config\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:46.829430 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.829054    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:46.829430 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:46.829179    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Apr 16 16:47:46.829430 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:46.829236    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret podName:4937738a-3c6a-4cd4-a252-3c0653b5b6fd nodeName:}" failed. No retries permitted until 2026-04-16 16:47:47.329216776 +0000 UTC m=+6.229968150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret") pod "global-pull-secret-syncer-lk2fq" (UID: "4937738a-3c6a-4cd4-a252-3c0653b5b6fd") : object "kube-system"/"original-pull-secret" not registered
Apr 16 16:47:46.829430 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.829416    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-kubelet-config\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:46.829913 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:46.829499    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-dbus\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:47.334912 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:47.334874    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:47.335342 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:47.335037    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Apr 16 16:47:47.335342 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:47.335104    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret podName:4937738a-3c6a-4cd4-a252-3c0653b5b6fd nodeName:}" failed. No retries permitted until 2026-04-16 16:47:48.335086274 +0000 UTC m=+7.235837640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret") pod "global-pull-secret-syncer-lk2fq" (UID: "4937738a-3c6a-4cd4-a252-3c0653b5b6fd") : object "kube-system"/"original-pull-secret" not registered
Apr 16 16:47:48.343999 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:48.343957    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:48.344442 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:48.344100    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Apr 16 16:47:48.344442 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:48.344162    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret podName:4937738a-3c6a-4cd4-a252-3c0653b5b6fd nodeName:}" failed. No retries permitted until 2026-04-16 16:47:50.34414374 +0000 UTC m=+9.244895116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret") pod "global-pull-secret-syncer-lk2fq" (UID: "4937738a-3c6a-4cd4-a252-3c0653b5b6fd") : object "kube-system"/"original-pull-secret" not registered
Apr 16 16:47:48.709757 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:48.709179    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:48.709757 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:48.709179    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:48.709757 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:48.709317    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:47:48.709757 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:48.709181    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:48.709757 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:48.709412    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:47:48.709757 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:48.709530    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:47:50.258813 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:50.258771    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:50.259419 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:50.258929    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:50.259419 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:50.259013    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs podName:cffe5d0c-d081-4b1e-b883-472bec4cfc56 nodeName:}" failed. No retries permitted until 2026-04-16 16:47:58.258989186 +0000 UTC m=+17.159740550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs") pod "network-metrics-daemon-t57ts" (UID: "cffe5d0c-d081-4b1e-b883-472bec4cfc56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:50.359222 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:50.359172    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:50.359441 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:50.359253    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6gcw\" (UniqueName: \"kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw\") pod \"network-check-target-c7j5m\" (UID: \"172397d5-6eec-4fb9-a90f-18f769743e08\") " pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:50.359441 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:50.359396    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 16 16:47:50.359441 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:50.359416    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 16 16:47:50.359441 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:50.359421    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Apr 16 16:47:50.359660 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:50.359489    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret podName:4937738a-3c6a-4cd4-a252-3c0653b5b6fd nodeName:}" failed. No retries permitted until 2026-04-16 16:47:54.359474898 +0000 UTC m=+13.260226259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret") pod "global-pull-secret-syncer-lk2fq" (UID: "4937738a-3c6a-4cd4-a252-3c0653b5b6fd") : object "kube-system"/"original-pull-secret" not registered
Apr 16 16:47:50.359660 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:50.359430    2569 projected.go:194] Error preparing data for projected volume kube-api-access-b6gcw for pod openshift-network-diagnostics/network-check-target-c7j5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:50.359771 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:50.359664    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw podName:172397d5-6eec-4fb9-a90f-18f769743e08 nodeName:}" failed. No retries permitted until 2026-04-16 16:47:58.359644646 +0000 UTC m=+17.260396014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6gcw" (UniqueName: "kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw") pod "network-check-target-c7j5m" (UID: "172397d5-6eec-4fb9-a90f-18f769743e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:50.709484 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:50.709045    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:50.709484 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:50.709172    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:50.709484 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:50.709184    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:47:50.709484 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:50.709215    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:50.709484 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:50.709317    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:47:50.709484 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:50.709409    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:47:52.709173 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:52.708968    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:52.709585 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:52.709004    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:52.709585 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:52.709260    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:47:52.709585 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:52.709007    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:52.709585 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:52.709334    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:47:52.709585 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:52.709436    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:47:54.390603 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:54.390573    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:54.391007 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:54.390727    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Apr 16 16:47:54.391007 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:54.390806    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret podName:4937738a-3c6a-4cd4-a252-3c0653b5b6fd nodeName:}" failed. No retries permitted until 2026-04-16 16:48:02.390774956 +0000 UTC m=+21.291526320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret") pod "global-pull-secret-syncer-lk2fq" (UID: "4937738a-3c6a-4cd4-a252-3c0653b5b6fd") : object "kube-system"/"original-pull-secret" not registered
Apr 16 16:47:54.708526 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:54.708439    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:54.708708 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:54.708440    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:54.708708 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:54.708585    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:47:54.708708 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:54.708440    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:54.708708 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:54.708667    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:47:54.708953 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:54.708708    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:47:56.708241 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:56.708167    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:56.708241 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:56.708200    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:56.708603 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:56.708268    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:47:56.708603 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:56.708310    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:56.708603 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:56.708375    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:47:56.708603 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:56.708442    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:47:58.319558 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:58.319521    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:58.320109 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:58.319642    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:58.320109 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:58.319712    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs podName:cffe5d0c-d081-4b1e-b883-472bec4cfc56 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:14.31969167 +0000 UTC m=+33.220443035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs") pod "network-metrics-daemon-t57ts" (UID: "cffe5d0c-d081-4b1e-b883-472bec4cfc56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:47:58.420888 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:58.420845    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6gcw\" (UniqueName: \"kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw\") pod \"network-check-target-c7j5m\" (UID: \"172397d5-6eec-4fb9-a90f-18f769743e08\") " pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:58.421080 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:58.420989    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 16 16:47:58.421080 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:58.421015    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 16 16:47:58.421080 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:58.421028    2569 projected.go:194] Error preparing data for projected volume kube-api-access-b6gcw for pod openshift-network-diagnostics/network-check-target-c7j5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:58.421213 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:58.421096    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw podName:172397d5-6eec-4fb9-a90f-18f769743e08 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:14.421073604 +0000 UTC m=+33.321824968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6gcw" (UniqueName: "kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw") pod "network-check-target-c7j5m" (UID: "172397d5-6eec-4fb9-a90f-18f769743e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:47:58.709187 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:58.709120    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:47:58.709345 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:58.709120    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:47:58.709345 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:58.709240    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:47:58.709345 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:47:58.709120    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:47:58.709345 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:58.709290    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:47:58.709517 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:47:58.709381    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:48:00.708638 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:00.708597    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:00.709131 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:00.708606    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:00.709131 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:00.708718    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:48:00.709131 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:00.708606    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:48:00.709131 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:00.708824    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:48:00.709131 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:00.708887    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:48:01.975215 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:01.974989    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-227.ec2.internal" event={"ID":"3790cf888bcb006af761d10ed316a9f7","Type":"ContainerStarted","Data":"b41074ff1950e8547c88fd473561041cf123e438c0e63c75c304d040cf5f5f62"}
Apr 16 16:48:01.982762 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:01.982633    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk" event={"ID":"850a1a3c-96d9-47b8-9797-28615fc9806a","Type":"ContainerStarted","Data":"dd9d32bc70696ba9ef3ddef49106ed4d7432360cce16c1cc7f0b630ab7f2af2d"}
Apr 16 16:48:01.982762 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:01.982669    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk" event={"ID":"850a1a3c-96d9-47b8-9797-28615fc9806a","Type":"ContainerStarted","Data":"113b7d894a1795c03109505767abed5350ed107650e945ef824d59f2487697ba"}
Apr 16 16:48:01.982762 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:01.982683    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk" event={"ID":"850a1a3c-96d9-47b8-9797-28615fc9806a","Type":"ContainerStarted","Data":"ac8921769fcef02739fb4ac55a6562e721b3cf4f08ab5a06037727048ebe9e4a"}
Apr 16 16:48:01.982762 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:01.982697    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk" event={"ID":"850a1a3c-96d9-47b8-9797-28615fc9806a","Type":"ContainerStarted","Data":"e6ae69061274140cb74e31e6af0222d32d89423e4439d3ffec49ad21b2079c51"}
Apr 16 16:48:01.987173 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:01.987130    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-227.ec2.internal" podStartSLOduration=20.987113102 podStartE2EDuration="20.987113102s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 16:48:01.986999676 +0000 UTC m=+20.887751061" watchObservedRunningTime="2026-04-16 16:48:01.987113102 +0000 UTC m=+20.887864499"
Apr 16 16:48:01.987700 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:01.987675    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7mtwf" event={"ID":"bce462c6-480f-4662-93cd-1f3623c1ab4e","Type":"ContainerStarted","Data":"c6b51810fa6d52650298fdbb5c4a88d7e0e5f1b66ebd1b2f62113ebb4c9d0586"}
Apr 16 16:48:01.990431 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:01.990408    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ljvpw" event={"ID":"4ab0c49d-05ab-4c86-a82d-772183938b38","Type":"ContainerStarted","Data":"a9e26a96af39ede0e442668850cabc0b9e1e8f047cb13e285eb4002370b2c1a5"}
Apr 16 16:48:02.001776 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:02.001738    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-7mtwf" podStartSLOduration=2.714546687 podStartE2EDuration="21.001725662s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="2026-04-16 16:47:42.936964785 +0000 UTC m=+1.837716147" lastFinishedPulling="2026-04-16 16:48:01.224143745 +0000 UTC m=+20.124895122" observedRunningTime="2026-04-16 16:48:02.001033542 +0000 UTC m=+20.901784942" watchObservedRunningTime="2026-04-16 16:48:02.001725662 +0000 UTC m=+20.902477052"
Apr 16 16:48:02.450030 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:02.449898    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:02.450117 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:02.450030    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Apr 16 16:48:02.450117 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:02.450082    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret podName:4937738a-3c6a-4cd4-a252-3c0653b5b6fd nodeName:}" failed. No retries permitted until 2026-04-16 16:48:18.450068553 +0000 UTC m=+37.350819918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret") pod "global-pull-secret-syncer-lk2fq" (UID: "4937738a-3c6a-4cd4-a252-3c0653b5b6fd") : object "kube-system"/"original-pull-secret" not registered
Apr 16 16:48:02.709107 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:02.709080    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:48:02.709200 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:02.709080    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:02.709200 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:02.709183    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:48:02.709334 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:02.709080    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:02.709334 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:02.709272    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:48:02.709419 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:02.709351    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:48:02.994202 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:02.994099    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-szz5j" event={"ID":"cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c","Type":"ContainerStarted","Data":"de9314d7372c9f515986ed0ae5dda50e7a01509d6996fbc12e411404a43945e1"}
Apr 16 16:48:02.995540 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:02.995508    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv" event={"ID":"fd31177f-5733-4747-bedd-2bfd23a1dc00","Type":"ContainerStarted","Data":"b1354e7cdf10fb38cc153ceae1e136de9b9710259a80e1f1baf2cdbaaf12bdf1"}
Apr 16 16:48:03.000436 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.000402    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drbvd" event={"ID":"9eff2a2f-c317-48bf-af6d-e22e8d69b90d","Type":"ContainerStarted","Data":"d9511198c295e9a4c871d3b0336adc41ed42dc6894921bbe7d17b2d5f1dbb7dc"}
Apr 16 16:48:03.002136 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.002104    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k8bx9" event={"ID":"e6e03468-e748-4fcf-bc8a-7ee1b325454e","Type":"ContainerStarted","Data":"f69c572a7b2761a4178483ecaaeed0c08e7aeeff678c940979d049e7011b7c90"}
Apr 16 16:48:03.003621 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.003594    2569 generic.go:358] "Generic (PLEG): container finished" podID="f8843cc356802eac373d4d79680a04c3" containerID="3dc707089d0fa4de317ffc038b36f57d7bf7df7a9ed4c6ff27e57a52152a09ed" exitCode=0
Apr 16 16:48:03.003754 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.003666    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal" event={"ID":"f8843cc356802eac373d4d79680a04c3","Type":"ContainerDied","Data":"3dc707089d0fa4de317ffc038b36f57d7bf7df7a9ed4c6ff27e57a52152a09ed"}
Apr 16 16:48:03.005147 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.005121    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sl4vz" event={"ID":"94f2fbf5-07e0-4121-85c9-882b6a9a4bbd","Type":"ContainerStarted","Data":"05e75d75728a93052c437088193b142a17bc8184218b6348c5406980ef4b3eaf"}
Apr 16 16:48:03.007956 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.007927    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk" event={"ID":"850a1a3c-96d9-47b8-9797-28615fc9806a","Type":"ContainerStarted","Data":"59bc58a19a651e154ce2fe7471d5b740f1129a2cc2843f6d19a48f0d4abe5e51"}
Apr 16 16:48:03.008050 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.007966    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk" event={"ID":"850a1a3c-96d9-47b8-9797-28615fc9806a","Type":"ContainerStarted","Data":"e45979c83ce63240665d237feee7bfb54a55be8e095547237575aebd056c2f33"}
Apr 16 16:48:03.008105 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.008064    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ljvpw" podStartSLOduration=3.830368503 podStartE2EDuration="22.008049757s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="2026-04-16 16:47:42.896527946 +0000 UTC m=+1.797279308" lastFinishedPulling="2026-04-16 16:48:01.074209184 +0000 UTC m=+19.974960562" observedRunningTime="2026-04-16 16:48:02.014210498 +0000 UTC m=+20.914961894" watchObservedRunningTime="2026-04-16 16:48:03.008049757 +0000 UTC m=+21.908801143"
Apr 16 16:48:03.008230 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.008193    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-szz5j" podStartSLOduration=3.867569172 podStartE2EDuration="22.008187606s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="2026-04-16 16:47:42.904817954 +0000 UTC m=+1.805569316" lastFinishedPulling="2026-04-16 16:48:01.045436375 +0000 UTC m=+19.946187750" observedRunningTime="2026-04-16 16:48:03.007780618 +0000 UTC m=+21.908532002" watchObservedRunningTime="2026-04-16 16:48:03.008187606 +0000 UTC m=+21.908939051"
Apr 16 16:48:03.009487 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.009451    2569 generic.go:358] "Generic (PLEG): container finished" podID="220bc941-c238-4d62-abcb-aae86d4e0e35" containerID="39b54dd38707d28b21c9604cfacb091f7f2ea19e59d2a3b3e4dc9c1e50ee757e" exitCode=0
Apr 16 16:48:03.009583 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.009548    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzrf9" event={"ID":"220bc941-c238-4d62-abcb-aae86d4e0e35","Type":"ContainerDied","Data":"39b54dd38707d28b21c9604cfacb091f7f2ea19e59d2a3b3e4dc9c1e50ee757e"}
Apr 16 16:48:03.033701 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.033647    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k8bx9" podStartSLOduration=3.909721356 podStartE2EDuration="22.033632753s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="2026-04-16 16:47:42.921494831 +0000 UTC m=+1.822246193" lastFinishedPulling="2026-04-16 16:48:01.045406222 +0000 UTC m=+19.946157590" observedRunningTime="2026-04-16 16:48:03.033310197 +0000 UTC m=+21.934061592" watchObservedRunningTime="2026-04-16 16:48:03.033632753 +0000 UTC m=+21.934384141"
Apr 16 16:48:03.046345 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.046309    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sl4vz" podStartSLOduration=3.943454345 podStartE2EDuration="22.046294332s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="2026-04-16 16:47:42.969483942 +0000 UTC m=+1.870235303" lastFinishedPulling="2026-04-16 16:48:01.072323916 +0000 UTC m=+19.973075290" observedRunningTime="2026-04-16 16:48:03.045773316 +0000 UTC m=+21.946524713" watchObservedRunningTime="2026-04-16 16:48:03.046294332 +0000 UTC m=+21.947045717"
Apr 16 16:48:03.059759 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.059714    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-drbvd" podStartSLOduration=4.002076082 podStartE2EDuration="22.05970165s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="2026-04-16 16:47:42.987776928 +0000 UTC m=+1.888528291" lastFinishedPulling="2026-04-16 16:48:01.045402482 +0000 UTC m=+19.946153859" observedRunningTime="2026-04-16 16:48:03.059652275 +0000 UTC m=+21.960403662" watchObservedRunningTime="2026-04-16 16:48:03.05970165 +0000 UTC m=+21.960453039"
Apr 16 16:48:03.212746 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.212717    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Apr 16 16:48:03.651039 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.650941    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-16T16:48:03.212735369Z","UUID":"29635844-a3e2-4b23-8265-e97a61c6a9c1","Handler":null,"Name":"","Endpoint":""}
Apr 16 16:48:03.652764 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.652746    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Apr 16 16:48:03.652764 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:03.652768    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Apr 16 16:48:04.013143 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:04.013052    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv" event={"ID":"fd31177f-5733-4747-bedd-2bfd23a1dc00","Type":"ContainerStarted","Data":"38f402982fb868287e3f981e137506912c6eff70e8040cbd87a8fd7f42bc1403"}
Apr 16 16:48:04.015270 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:04.015131    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal" event={"ID":"f8843cc356802eac373d4d79680a04c3","Type":"ContainerStarted","Data":"91b3c8531fef93e05ee0bf7e8ce4d5279c52808aebc6a2abad0068a682e15dae"}
Apr 16 16:48:04.034977 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:04.034930    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-227.ec2.internal" podStartSLOduration=23.034914519 podStartE2EDuration="23.034914519s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 16:48:04.034451928 +0000 UTC m=+22.935203311" watchObservedRunningTime="2026-04-16 16:48:04.034914519 +0000 UTC m=+22.935665905"
Apr 16 16:48:04.708739 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:04.708709    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:04.708953 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:04.708829    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:48:04.708953 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:04.708836    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:48:04.708953 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:04.708870    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:04.708953 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:04.708914    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:48:04.709175 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:04.708975    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:48:05.020087 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:05.020004    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk" event={"ID":"850a1a3c-96d9-47b8-9797-28615fc9806a","Type":"ContainerStarted","Data":"60a6ef9cf8afe4e2c9f3e933fc418fe36cb5b379670949e5cafe226feec8f99f"}
Apr 16 16:48:05.021921 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:05.021895    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv" event={"ID":"fd31177f-5733-4747-bedd-2bfd23a1dc00","Type":"ContainerStarted","Data":"937d3489cad243a23626bcf8c982e077ed12dc321797076fb9beb2ebd1f5fb29"}
Apr 16 16:48:05.040550 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:05.040497    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42rwv" podStartSLOduration=1.867370985 podStartE2EDuration="23.04048636s" podCreationTimestamp="2026-04-16 16:47:42 +0000 UTC" firstStartedPulling="2026-04-16 16:47:42.992775011 +0000 UTC m=+1.893526379" lastFinishedPulling="2026-04-16 16:48:04.16589038 +0000 UTC m=+23.066641754" observedRunningTime="2026-04-16 16:48:05.039753909 +0000 UTC m=+23.940505294" watchObservedRunningTime="2026-04-16 16:48:05.04048636 +0000 UTC m=+23.941237743"
Apr 16 16:48:06.708824 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:06.708734    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:06.708824 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:06.708762    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:48:06.709248 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:06.708734    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:06.709248 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:06.708867    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:48:06.709248 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:06.708941    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:48:06.709248 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:06.709036    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:48:07.557810 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:07.557636    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:48:07.558349 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:07.558332    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:48:08.034214 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.034142    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk" event={"ID":"850a1a3c-96d9-47b8-9797-28615fc9806a","Type":"ContainerStarted","Data":"30a0ddb5666ed74c9f91121d003b10db594e6311deb4b30630acd883fab374b1"}
Apr 16 16:48:08.034874 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.034462    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:48:08.035937 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.035911    2569 generic.go:358] "Generic (PLEG): container finished" podID="220bc941-c238-4d62-abcb-aae86d4e0e35" containerID="9f86bc2952b121c3e0a9618ce7e211519bac21c02d27467e50fb659dcaea39eb" exitCode=0
Apr 16 16:48:08.036057 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.035994    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzrf9" event={"ID":"220bc941-c238-4d62-abcb-aae86d4e0e35","Type":"ContainerDied","Data":"9f86bc2952b121c3e0a9618ce7e211519bac21c02d27467e50fb659dcaea39eb"}
Apr 16 16:48:08.036279 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.036222    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:48:08.037023 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.036656    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-drbvd"
Apr 16 16:48:08.049250 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.049232    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:48:08.063321 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.063283    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk" podStartSLOduration=8.327944004999999 podStartE2EDuration="27.063272422s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="2026-04-16 16:47:42.956256619 +0000 UTC m=+1.857007980" lastFinishedPulling="2026-04-16 16:48:01.691585022 +0000 UTC m=+20.592336397" observedRunningTime="2026-04-16 16:48:08.062822091 +0000 UTC m=+26.963573474" watchObservedRunningTime="2026-04-16 16:48:08.063272422 +0000 UTC m=+26.964023805"
Apr 16 16:48:08.708851 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.708826    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:08.708851 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.708848    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:08.709003 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:08.708950    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:48:08.709054 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:08.709012    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:48:08.709113 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.709062    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:48:08.709191 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:08.709173    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:48:08.961738 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.961556    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c7j5m"]
Apr 16 16:48:08.964944 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.964920    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t57ts"]
Apr 16 16:48:08.967852 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:08.967833    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lk2fq"]
Apr 16 16:48:09.039539 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:09.039518    2569 generic.go:358] "Generic (PLEG): container finished" podID="220bc941-c238-4d62-abcb-aae86d4e0e35" containerID="96d0113f05a145100591370781c12da5cfa3bb07a186b481da3dd07a2942384a" exitCode=0
Apr 16 16:48:09.039922 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:09.039597    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:09.039922 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:09.039616    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzrf9" event={"ID":"220bc941-c238-4d62-abcb-aae86d4e0e35","Type":"ContainerDied","Data":"96d0113f05a145100591370781c12da5cfa3bb07a186b481da3dd07a2942384a"}
Apr 16 16:48:09.039922 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:09.039732    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:48:09.039922 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:09.039828    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:48:09.039922 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:09.039913    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:48:09.040080 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:09.039940    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:09.040080 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:09.040003    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:48:09.040560 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:09.040539    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:48:09.040611 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:09.040562    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:48:09.055065 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:09.055049    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:48:10.043679 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:10.043602    2569 generic.go:358] "Generic (PLEG): container finished" podID="220bc941-c238-4d62-abcb-aae86d4e0e35" containerID="0b0dfc90045f8102c7afdbf7605afded74e29438520d453b39072487517d2254" exitCode=0
Apr 16 16:48:10.044077 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:10.043693    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzrf9" event={"ID":"220bc941-c238-4d62-abcb-aae86d4e0e35","Type":"ContainerDied","Data":"0b0dfc90045f8102c7afdbf7605afded74e29438520d453b39072487517d2254"}
Apr 16 16:48:10.708818 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:10.708718    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:10.708818 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:10.708735    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:10.709023 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:10.708868    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:48:10.709023 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:10.708901    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:48:10.709023 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:10.709011    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:48:10.709182 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:10.709123    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:48:12.708667 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:12.708639    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:12.709166 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:12.708639    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:12.709166 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:12.708762    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk2fq" podUID="4937738a-3c6a-4cd4-a252-3c0653b5b6fd"
Apr 16 16:48:12.709166 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:12.708844    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7j5m" podUID="172397d5-6eec-4fb9-a90f-18f769743e08"
Apr 16 16:48:12.709166 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:12.708639    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:48:12.709166 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:12.708955    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:48:14.344034 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.343995    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:48:14.344492 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.344141    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:48:14.344492 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.344214    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs podName:cffe5d0c-d081-4b1e-b883-472bec4cfc56 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:46.34419585 +0000 UTC m=+65.244947235 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs") pod "network-metrics-daemon-t57ts" (UID: "cffe5d0c-d081-4b1e-b883-472bec4cfc56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 16 16:48:14.427166 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.427132    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-227.ec2.internal" event="NodeReady"
Apr 16 16:48:14.427344 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.427303    2569 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Apr 16 16:48:14.445161 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.445125    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6gcw\" (UniqueName: \"kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw\") pod \"network-check-target-c7j5m\" (UID: \"172397d5-6eec-4fb9-a90f-18f769743e08\") " pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:14.445345 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.445298    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 16 16:48:14.445345 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.445325    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 16 16:48:14.445345 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.445340    2569 projected.go:194] Error preparing data for projected volume kube-api-access-b6gcw for pod openshift-network-diagnostics/network-check-target-c7j5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:48:14.445461 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.445402    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw podName:172397d5-6eec-4fb9-a90f-18f769743e08 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:46.445381763 +0000 UTC m=+65.346133128 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6gcw" (UniqueName: "kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw") pod "network-check-target-c7j5m" (UID: "172397d5-6eec-4fb9-a90f-18f769743e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 16 16:48:14.460789 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.460750    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn"]
Apr 16 16:48:14.486669 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.486621    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"]
Apr 16 16:48:14.486947 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.486816    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn"
Apr 16 16:48:14.490837 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.490469    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Apr 16 16:48:14.490837 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.490469    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Apr 16 16:48:14.490837 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.490471    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ztnp8\""
Apr 16 16:48:14.491085 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.490982    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Apr 16 16:48:14.491483 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.491330    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Apr 16 16:48:14.502531 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.502505    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-848fcfd69-2p7x4"]
Apr 16 16:48:14.503278 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.502878    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.506004 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.505979    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Apr 16 16:48:14.506120 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.505979    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Apr 16 16:48:14.506120 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.505979    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Apr 16 16:48:14.506120 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.505988    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Apr 16 16:48:14.514540 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.514501    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"]
Apr 16 16:48:14.514691 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.514668    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.518382 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.518355    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Apr 16 16:48:14.518382 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.518379    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-djqlx\""
Apr 16 16:48:14.518574 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.518355    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Apr 16 16:48:14.518574 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.518470    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Apr 16 16:48:14.525170 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.525143    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Apr 16 16:48:14.537769 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.537745    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn"]
Apr 16 16:48:14.537915 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.537780    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lwxz6"]
Apr 16 16:48:14.537958 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.537927    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:14.541031 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.541004    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Apr 16 16:48:14.554533 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.554508    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"]
Apr 16 16:48:14.554533 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.554533    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"]
Apr 16 16:48:14.554757 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.554546    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-848fcfd69-2p7x4"]
Apr 16 16:48:14.554757 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.554559    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lwxz6"]
Apr 16 16:48:14.554757 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.554642    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:14.557399 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.557363    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Apr 16 16:48:14.557399 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.557363    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Apr 16 16:48:14.557573 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.557419    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c25vw\""
Apr 16 16:48:14.557573 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.557419    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Apr 16 16:48:14.573312 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.573283    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xsmg4"]
Apr 16 16:48:14.585385 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.585355    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xsmg4"]
Apr 16 16:48:14.585538 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.585517    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:14.587853 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.587830    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Apr 16 16:48:14.587988 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.587919    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Apr 16 16:48:14.587988 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.587958    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-99nwp\""
Apr 16 16:48:14.646979 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.646942    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-hub\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.646979 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.646989    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8pvk\" (UniqueName: \"kubernetes.io/projected/8e583e75-b233-48e9-a90e-00cff442db85-kube-api-access-w8pvk\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.647237 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647027    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5px6b\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-kube-api-access-5px6b\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.647237 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647051    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bbc01d7b-9e55-46bf-a370-eb85e14c347b-ca-trust-extracted\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.647237 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647073    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.647237 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647108    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8509b8ec-b1d5-4995-a05f-20d6f7418127-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5845f779bf-kjbzn\" (UID: \"8509b8ec-b1d5-4995-a05f-20d6f7418127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn"
Apr 16 16:48:14.647237 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:14.647237 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647169    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cr6v\" (UniqueName: \"kubernetes.io/projected/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-kube-api-access-5cr6v\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:14.647237 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-installation-pull-secrets\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.647553 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647277    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.647553 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-ca\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.647553 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647365    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.647553 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85c6826a-2212-4fb5-bc8b-b975ac9af043-tmp\") pod \"klusterlet-addon-workmgr-554687b794-m5vz4\" (UID: \"85c6826a-2212-4fb5-bc8b-b975ac9af043\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:14.647553 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647419    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/85c6826a-2212-4fb5-bc8b-b975ac9af043-klusterlet-config\") pod \"klusterlet-addon-workmgr-554687b794-m5vz4\" (UID: \"85c6826a-2212-4fb5-bc8b-b975ac9af043\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:14.647553 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647481    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-certificates\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.647553 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-trusted-ca\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.647553 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647513    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-bound-sa-token\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.647553 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647535    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8e583e75-b233-48e9-a90e-00cff442db85-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.647973 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647572    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqpdk\" (UniqueName: \"kubernetes.io/projected/85c6826a-2212-4fb5-bc8b-b975ac9af043-kube-api-access-mqpdk\") pod \"klusterlet-addon-workmgr-554687b794-m5vz4\" (UID: \"85c6826a-2212-4fb5-bc8b-b975ac9af043\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:14.647973 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647637    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2tdv\" (UniqueName: \"kubernetes.io/projected/8509b8ec-b1d5-4995-a05f-20d6f7418127-kube-api-access-r2tdv\") pod \"managed-serviceaccount-addon-agent-5845f779bf-kjbzn\" (UID: \"8509b8ec-b1d5-4995-a05f-20d6f7418127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn"
Apr 16 16:48:14.647973 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.647663    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-image-registry-private-configuration\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.708379 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.708335    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:14.708379 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.708365    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:48:14.708611 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.708388    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:14.711907 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.711882    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-877l2\""
Apr 16 16:48:14.712039 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.711925    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Apr 16 16:48:14.712039 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.711940    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wrbkk\""
Apr 16 16:48:14.712039 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.711947    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Apr 16 16:48:14.712039 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.711976    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Apr 16 16:48:14.712039 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.711925    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Apr 16 16:48:14.748152 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748067    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8509b8ec-b1d5-4995-a05f-20d6f7418127-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5845f779bf-kjbzn\" (UID: \"8509b8ec-b1d5-4995-a05f-20d6f7418127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn"
Apr 16 16:48:14.748152 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748114    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b383d53-c55b-43dc-865b-bcf9daa5c109-tmp-dir\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:14.748152 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748146    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:14.748410 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748179    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:14.748410 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748242    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5cr6v\" (UniqueName: \"kubernetes.io/projected/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-kube-api-access-5cr6v\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:14.748410 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748285    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-installation-pull-secrets\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.748410 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.748308    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Apr 16 16:48:14.748410 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748329    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.748410 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.748356    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert podName:77527e40-fe4f-4ffd-9e9f-6f9daa905db4 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:15.248340743 +0000 UTC m=+34.149092105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert") pod "ingress-canary-lwxz6" (UID: "77527e40-fe4f-4ffd-9e9f-6f9daa905db4") : secret "canary-serving-cert" not found
Apr 16 16:48:14.748410 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748377    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-ca\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.748410 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.748392    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Apr 16 16:48:14.748410 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.748402    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848fcfd69-2p7x4: secret "image-registry-tls" not found
Apr 16 16:48:14.748410 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748402    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748419    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85c6826a-2212-4fb5-bc8b-b975ac9af043-tmp\") pod \"klusterlet-addon-workmgr-554687b794-m5vz4\" (UID: \"85c6826a-2212-4fb5-bc8b-b975ac9af043\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748434    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/85c6826a-2212-4fb5-bc8b-b975ac9af043-klusterlet-config\") pod \"klusterlet-addon-workmgr-554687b794-m5vz4\" (UID: \"85c6826a-2212-4fb5-bc8b-b975ac9af043\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.748445    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls podName:bbc01d7b-9e55-46bf-a370-eb85e14c347b nodeName:}" failed. No retries permitted until 2026-04-16 16:48:15.248433478 +0000 UTC m=+34.149184839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls") pod "image-registry-848fcfd69-2p7x4" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b") : secret "image-registry-tls" not found
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748471    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-certificates\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748489    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-trusted-ca\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748505    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-bound-sa-token\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748521    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8e583e75-b233-48e9-a90e-00cff442db85-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748554    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqpdk\" (UniqueName: \"kubernetes.io/projected/85c6826a-2212-4fb5-bc8b-b975ac9af043-kube-api-access-mqpdk\") pod \"klusterlet-addon-workmgr-554687b794-m5vz4\" (UID: \"85c6826a-2212-4fb5-bc8b-b975ac9af043\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748575    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2tdv\" (UniqueName: \"kubernetes.io/projected/8509b8ec-b1d5-4995-a05f-20d6f7418127-kube-api-access-r2tdv\") pod \"managed-serviceaccount-addon-agent-5845f779bf-kjbzn\" (UID: \"8509b8ec-b1d5-4995-a05f-20d6f7418127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748591    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-image-registry-private-configuration\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748617    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-hub\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748633    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8pvk\" (UniqueName: \"kubernetes.io/projected/8e583e75-b233-48e9-a90e-00cff442db85-kube-api-access-w8pvk\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748652    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5px6b\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-kube-api-access-5px6b\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748679    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4xrd\" (UniqueName: \"kubernetes.io/projected/4b383d53-c55b-43dc-865b-bcf9daa5c109-kube-api-access-z4xrd\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:14.748881 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748701    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bbc01d7b-9e55-46bf-a370-eb85e14c347b-ca-trust-extracted\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.749496 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748718    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.749496 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.748734    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b383d53-c55b-43dc-865b-bcf9daa5c109-config-volume\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:14.749609 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.749589    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8e583e75-b233-48e9-a90e-00cff442db85-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.750072 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.749757    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-certificates\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.750188 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.750171    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85c6826a-2212-4fb5-bc8b-b975ac9af043-tmp\") pod \"klusterlet-addon-workmgr-554687b794-m5vz4\" (UID: \"85c6826a-2212-4fb5-bc8b-b975ac9af043\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:14.750275 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.750251    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bbc01d7b-9e55-46bf-a370-eb85e14c347b-ca-trust-extracted\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.751182 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.751130    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-trusted-ca\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.753827 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.753742    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-ca\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.753827 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.753749    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-hub\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.753827 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.753780    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8509b8ec-b1d5-4995-a05f-20d6f7418127-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5845f779bf-kjbzn\" (UID: \"8509b8ec-b1d5-4995-a05f-20d6f7418127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn"
Apr 16 16:48:14.753827 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.753729    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-image-registry-private-configuration\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.754715 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.754692    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-installation-pull-secrets\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.754845 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.754691    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/85c6826a-2212-4fb5-bc8b-b975ac9af043-klusterlet-config\") pod \"klusterlet-addon-workmgr-554687b794-m5vz4\" (UID: \"85c6826a-2212-4fb5-bc8b-b975ac9af043\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:14.754900 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.754887    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.755009 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.754983    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8e583e75-b233-48e9-a90e-00cff442db85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.759027 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.758981    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-bound-sa-token\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.759142 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.759114    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2tdv\" (UniqueName: \"kubernetes.io/projected/8509b8ec-b1d5-4995-a05f-20d6f7418127-kube-api-access-r2tdv\") pod \"managed-serviceaccount-addon-agent-5845f779bf-kjbzn\" (UID: \"8509b8ec-b1d5-4995-a05f-20d6f7418127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn"
Apr 16 16:48:14.759870 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.759689    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqpdk\" (UniqueName: \"kubernetes.io/projected/85c6826a-2212-4fb5-bc8b-b975ac9af043-kube-api-access-mqpdk\") pod \"klusterlet-addon-workmgr-554687b794-m5vz4\" (UID: \"85c6826a-2212-4fb5-bc8b-b975ac9af043\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:14.759870 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.759766    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5px6b\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-kube-api-access-5px6b\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:14.760541 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.760485    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cr6v\" (UniqueName: \"kubernetes.io/projected/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-kube-api-access-5cr6v\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:14.760541 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.760494    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8pvk\" (UniqueName: \"kubernetes.io/projected/8e583e75-b233-48e9-a90e-00cff442db85-kube-api-access-w8pvk\") pod \"cluster-proxy-proxy-agent-945d6475b-c2r95\" (UID: \"8e583e75-b233-48e9-a90e-00cff442db85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.814368 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.814323    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn"
Apr 16 16:48:14.817358 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.817331    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:48:14.849535 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.849497    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4xrd\" (UniqueName: \"kubernetes.io/projected/4b383d53-c55b-43dc-865b-bcf9daa5c109-kube-api-access-z4xrd\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:14.849535 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.849543    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b383d53-c55b-43dc-865b-bcf9daa5c109-config-volume\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:14.849813 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.849588    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b383d53-c55b-43dc-865b-bcf9daa5c109-tmp-dir\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:14.849813 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.849766    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:14.849944 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.849925    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Apr 16 16:48:14.850006 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:14.849994    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls podName:4b383d53-c55b-43dc-865b-bcf9daa5c109 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:15.349968575 +0000 UTC m=+34.250719937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls") pod "dns-default-xsmg4" (UID: "4b383d53-c55b-43dc-865b-bcf9daa5c109") : secret "dns-default-metrics-tls" not found
Apr 16 16:48:14.850072 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.850026    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:14.850249 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.850227    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b383d53-c55b-43dc-865b-bcf9daa5c109-config-volume\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:14.861747 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.861673    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b383d53-c55b-43dc-865b-bcf9daa5c109-tmp-dir\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:14.864528 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:14.864500    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4xrd\" (UniqueName: \"kubernetes.io/projected/4b383d53-c55b-43dc-865b-bcf9daa5c109-kube-api-access-z4xrd\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:15.253370 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:15.253325    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:15.253581 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:15.253428    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:15.253581 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:15.253488    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Apr 16 16:48:15.253581 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:15.253551    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Apr 16 16:48:15.253581 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:15.253569    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert podName:77527e40-fe4f-4ffd-9e9f-6f9daa905db4 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:16.253553807 +0000 UTC m=+35.154305170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert") pod "ingress-canary-lwxz6" (UID: "77527e40-fe4f-4ffd-9e9f-6f9daa905db4") : secret "canary-serving-cert" not found
Apr 16 16:48:15.253581 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:15.253572    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848fcfd69-2p7x4: secret "image-registry-tls" not found
Apr 16 16:48:15.253849 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:15.253624    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls podName:bbc01d7b-9e55-46bf-a370-eb85e14c347b nodeName:}" failed. No retries permitted until 2026-04-16 16:48:16.253607394 +0000 UTC m=+35.154358759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls") pod "image-registry-848fcfd69-2p7x4" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b") : secret "image-registry-tls" not found
Apr 16 16:48:15.354990 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:15.354948    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:15.355471 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:15.355092    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Apr 16 16:48:15.355471 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:15.355179    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls podName:4b383d53-c55b-43dc-865b-bcf9daa5c109 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:16.355154733 +0000 UTC m=+35.255906097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls") pod "dns-default-xsmg4" (UID: "4b383d53-c55b-43dc-865b-bcf9daa5c109") : secret "dns-default-metrics-tls" not found
Apr 16 16:48:15.717826 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:15.717601    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"]
Apr 16 16:48:15.726033 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:15.726009    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn"]
Apr 16 16:48:15.729004 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:15.728980    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"]
Apr 16 16:48:15.822277 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:48:15.822241    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e583e75_b233_48e9_a90e_00cff442db85.slice/crio-84ba2096745bf8055c8da033639861b5de5dedf3d88be52177650d0577f8fe88 WatchSource:0}: Error finding container 84ba2096745bf8055c8da033639861b5de5dedf3d88be52177650d0577f8fe88: Status 404 returned error can't find the container with id 84ba2096745bf8055c8da033639861b5de5dedf3d88be52177650d0577f8fe88
Apr 16 16:48:15.822924 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:48:15.822897    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8509b8ec_b1d5_4995_a05f_20d6f7418127.slice/crio-337655455a04283d99543d7ba4b94ff357beb3eb78fcc0069d4633dfa90d9e41 WatchSource:0}: Error finding container 337655455a04283d99543d7ba4b94ff357beb3eb78fcc0069d4633dfa90d9e41: Status 404 returned error can't find the container with id 337655455a04283d99543d7ba4b94ff357beb3eb78fcc0069d4633dfa90d9e41
Apr 16 16:48:15.823656 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:48:15.823633    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c6826a_2212_4fb5_bc8b_b975ac9af043.slice/crio-ac4c0077c0c0aa4163826598ebf514d73c48ecdfd8c224e9a6c6704dd5512c7c WatchSource:0}: Error finding container ac4c0077c0c0aa4163826598ebf514d73c48ecdfd8c224e9a6c6704dd5512c7c: Status 404 returned error can't find the container with id ac4c0077c0c0aa4163826598ebf514d73c48ecdfd8c224e9a6c6704dd5512c7c
Apr 16 16:48:16.055844 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:16.055782    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" event={"ID":"8e583e75-b233-48e9-a90e-00cff442db85","Type":"ContainerStarted","Data":"84ba2096745bf8055c8da033639861b5de5dedf3d88be52177650d0577f8fe88"}
Apr 16 16:48:16.056752 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:16.056727    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn" event={"ID":"8509b8ec-b1d5-4995-a05f-20d6f7418127","Type":"ContainerStarted","Data":"337655455a04283d99543d7ba4b94ff357beb3eb78fcc0069d4633dfa90d9e41"}
Apr 16 16:48:16.057840 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:16.057817    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4" event={"ID":"85c6826a-2212-4fb5-bc8b-b975ac9af043","Type":"ContainerStarted","Data":"ac4c0077c0c0aa4163826598ebf514d73c48ecdfd8c224e9a6c6704dd5512c7c"}
Apr 16 16:48:16.061976 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:16.061938    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzrf9" event={"ID":"220bc941-c238-4d62-abcb-aae86d4e0e35","Type":"ContainerStarted","Data":"bb738b9a0ba59665c6059e534e73a1e660c585b949314ccdd3cd66701380b79f"}
Apr 16 16:48:16.261451 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:16.261412    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:16.261678 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:16.261477    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:16.261678 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:16.261585    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Apr 16 16:48:16.261678 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:16.261598    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848fcfd69-2p7x4: secret "image-registry-tls" not found
Apr 16 16:48:16.261678 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:16.261598    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Apr 16 16:48:16.261678 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:16.261646    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls podName:bbc01d7b-9e55-46bf-a370-eb85e14c347b nodeName:}" failed. No retries permitted until 2026-04-16 16:48:18.261632815 +0000 UTC m=+37.162384177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls") pod "image-registry-848fcfd69-2p7x4" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b") : secret "image-registry-tls" not found
Apr 16 16:48:16.261678 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:16.261677    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert podName:77527e40-fe4f-4ffd-9e9f-6f9daa905db4 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:18.261658363 +0000 UTC m=+37.162409730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert") pod "ingress-canary-lwxz6" (UID: "77527e40-fe4f-4ffd-9e9f-6f9daa905db4") : secret "canary-serving-cert" not found
Apr 16 16:48:16.362667 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:16.362626    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:16.363377 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:16.362742    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Apr 16 16:48:16.363377 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:16.362814    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls podName:4b383d53-c55b-43dc-865b-bcf9daa5c109 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:18.36277915 +0000 UTC m=+37.263530512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls") pod "dns-default-xsmg4" (UID: "4b383d53-c55b-43dc-865b-bcf9daa5c109") : secret "dns-default-metrics-tls" not found
Apr 16 16:48:17.070661 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:17.070622    2569 generic.go:358] "Generic (PLEG): container finished" podID="220bc941-c238-4d62-abcb-aae86d4e0e35" containerID="bb738b9a0ba59665c6059e534e73a1e660c585b949314ccdd3cd66701380b79f" exitCode=0
Apr 16 16:48:17.070884 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:17.070720    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzrf9" event={"ID":"220bc941-c238-4d62-abcb-aae86d4e0e35","Type":"ContainerDied","Data":"bb738b9a0ba59665c6059e534e73a1e660c585b949314ccdd3cd66701380b79f"}
Apr 16 16:48:18.077034 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:18.076992    2569 generic.go:358] "Generic (PLEG): container finished" podID="220bc941-c238-4d62-abcb-aae86d4e0e35" containerID="bfc40b321f54118418edf322ce8c0f720f54deefa3a3cf9c16c5200d3f82531c" exitCode=0
Apr 16 16:48:18.077034 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:18.077037    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzrf9" event={"ID":"220bc941-c238-4d62-abcb-aae86d4e0e35","Type":"ContainerDied","Data":"bfc40b321f54118418edf322ce8c0f720f54deefa3a3cf9c16c5200d3f82531c"}
Apr 16 16:48:18.281689 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:18.281648    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:18.281885 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:18.281767    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:18.281885 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:18.281834    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Apr 16 16:48:18.281885 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:18.281858    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848fcfd69-2p7x4: secret "image-registry-tls" not found
Apr 16 16:48:18.282150 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:18.281918    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Apr 16 16:48:18.282150 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:18.281923    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls podName:bbc01d7b-9e55-46bf-a370-eb85e14c347b nodeName:}" failed. No retries permitted until 2026-04-16 16:48:22.28190553 +0000 UTC m=+41.182656893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls") pod "image-registry-848fcfd69-2p7x4" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b") : secret "image-registry-tls" not found
Apr 16 16:48:18.282150 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:18.281984    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert podName:77527e40-fe4f-4ffd-9e9f-6f9daa905db4 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:22.281972154 +0000 UTC m=+41.182723517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert") pod "ingress-canary-lwxz6" (UID: "77527e40-fe4f-4ffd-9e9f-6f9daa905db4") : secret "canary-serving-cert" not found
Apr 16 16:48:18.382584 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:18.382496    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:18.382747 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:18.382672    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Apr 16 16:48:18.382822 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:18.382755    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls podName:4b383d53-c55b-43dc-865b-bcf9daa5c109 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:22.382736516 +0000 UTC m=+41.283487884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls") pod "dns-default-xsmg4" (UID: "4b383d53-c55b-43dc-865b-bcf9daa5c109") : secret "dns-default-metrics-tls" not found
Apr 16 16:48:18.483569 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:18.483526    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:18.486997 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:18.486971    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937738a-3c6a-4cd4-a252-3c0653b5b6fd-original-pull-secret\") pod \"global-pull-secret-syncer-lk2fq\" (UID: \"4937738a-3c6a-4cd4-a252-3c0653b5b6fd\") " pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:18.620144 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:18.620110    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk2fq"
Apr 16 16:48:22.178851 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:22.178666    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lk2fq"]
Apr 16 16:48:22.182477 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:48:22.182444    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4937738a_3c6a_4cd4_a252_3c0653b5b6fd.slice/crio-f7c076f02ec6172da7d0ca72cf786420b20c2da842015d9ec655287309955995 WatchSource:0}: Error finding container f7c076f02ec6172da7d0ca72cf786420b20c2da842015d9ec655287309955995: Status 404 returned error can't find the container with id f7c076f02ec6172da7d0ca72cf786420b20c2da842015d9ec655287309955995
Apr 16 16:48:22.317786 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:22.317746    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:22.317939 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:22.317841    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:22.317939 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:22.317903    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Apr 16 16:48:22.317939 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:22.317922    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848fcfd69-2p7x4: secret "image-registry-tls" not found
Apr 16 16:48:22.317939 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:22.317932    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Apr 16 16:48:22.318093 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:22.317971    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls podName:bbc01d7b-9e55-46bf-a370-eb85e14c347b nodeName:}" failed. No retries permitted until 2026-04-16 16:48:30.317955222 +0000 UTC m=+49.218706585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls") pod "image-registry-848fcfd69-2p7x4" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b") : secret "image-registry-tls" not found
Apr 16 16:48:22.318093 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:22.317985    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert podName:77527e40-fe4f-4ffd-9e9f-6f9daa905db4 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:30.317978936 +0000 UTC m=+49.218730298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert") pod "ingress-canary-lwxz6" (UID: "77527e40-fe4f-4ffd-9e9f-6f9daa905db4") : secret "canary-serving-cert" not found
Apr 16 16:48:22.418485 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:22.418423    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:22.418593 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:22.418532    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Apr 16 16:48:22.418593 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:22.418576    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls podName:4b383d53-c55b-43dc-865b-bcf9daa5c109 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:30.41856454 +0000 UTC m=+49.319315902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls") pod "dns-default-xsmg4" (UID: "4b383d53-c55b-43dc-865b-bcf9daa5c109") : secret "dns-default-metrics-tls" not found
Apr 16 16:48:23.090863 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:23.090829    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzrf9" event={"ID":"220bc941-c238-4d62-abcb-aae86d4e0e35","Type":"ContainerStarted","Data":"90f37865e9ae1a6d44a301f95b74e8a0c343030f632e8fb9e8da85bd6c4e1fb7"}
Apr 16 16:48:23.092224 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:23.092188    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" event={"ID":"8e583e75-b233-48e9-a90e-00cff442db85","Type":"ContainerStarted","Data":"6a10f13ca500231add253bb82e511b84bb8eb8d4aba44faf6207cad36aa8e74d"}
Apr 16 16:48:23.093572 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:23.093535    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn" event={"ID":"8509b8ec-b1d5-4995-a05f-20d6f7418127","Type":"ContainerStarted","Data":"298b92888b75999e88529d5ee99440c19204a1029dd5bf0aa41701f8c4dbd2b0"}
Apr 16 16:48:23.095003 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:23.094970    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4" event={"ID":"85c6826a-2212-4fb5-bc8b-b975ac9af043","Type":"ContainerStarted","Data":"74215aa472466a9dd9a0879c908c0df3806bd4d70098974f9a8e6105bd2bbcfa"}
Apr 16 16:48:23.095205 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:23.095174    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:23.096105 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:23.096084    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lk2fq" event={"ID":"4937738a-3c6a-4cd4-a252-3c0653b5b6fd","Type":"ContainerStarted","Data":"f7c076f02ec6172da7d0ca72cf786420b20c2da842015d9ec655287309955995"}
Apr 16 16:48:23.097244 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:23.097222    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:48:23.118332 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:23.118292    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kzrf9" podStartSLOduration=9.202485277 podStartE2EDuration="42.118281999s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="2026-04-16 16:47:42.951937491 +0000 UTC m=+1.852688856" lastFinishedPulling="2026-04-16 16:48:15.867734216 +0000 UTC m=+34.768485578" observedRunningTime="2026-04-16 16:48:23.116256271 +0000 UTC m=+42.017007654" watchObservedRunningTime="2026-04-16 16:48:23.118281999 +0000 UTC m=+42.019033382"
Apr 16 16:48:23.131855 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:23.131817    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn" podStartSLOduration=34.933239599 podStartE2EDuration="41.131787928s" podCreationTimestamp="2026-04-16 16:47:42 +0000 UTC" firstStartedPulling="2026-04-16 16:48:15.842834414 +0000 UTC m=+34.743585777" lastFinishedPulling="2026-04-16 16:48:22.041382732 +0000 UTC m=+40.942134106" observedRunningTime="2026-04-16 16:48:23.13119588 +0000 UTC m=+42.031947265" watchObservedRunningTime="2026-04-16 16:48:23.131787928 +0000 UTC m=+42.032539303"
Apr 16 16:48:27.105448 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:27.105411    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lk2fq" event={"ID":"4937738a-3c6a-4cd4-a252-3c0653b5b6fd","Type":"ContainerStarted","Data":"b04151c5f168e475642bbac3ca4f2dc2f97f635e4cc7bae6818a5a20d45b6c42"}
Apr 16 16:48:27.122299 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:27.122247    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lk2fq" podStartSLOduration=37.244826491 podStartE2EDuration="41.122234558s" podCreationTimestamp="2026-04-16 16:47:46 +0000 UTC" firstStartedPulling="2026-04-16 16:48:22.184184563 +0000 UTC m=+41.084935942" lastFinishedPulling="2026-04-16 16:48:26.061592643 +0000 UTC m=+44.962344009" observedRunningTime="2026-04-16 16:48:27.121362481 +0000 UTC m=+46.022113866" watchObservedRunningTime="2026-04-16 16:48:27.122234558 +0000 UTC m=+46.022985939"
Apr 16 16:48:27.122493 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:27.122463    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4" podStartSLOduration=38.907371303 podStartE2EDuration="45.12245255s" podCreationTimestamp="2026-04-16 16:47:42 +0000 UTC" firstStartedPulling="2026-04-16 16:48:15.842576831 +0000 UTC m=+34.743328192" lastFinishedPulling="2026-04-16 16:48:22.057658074 +0000 UTC m=+40.958409439" observedRunningTime="2026-04-16 16:48:23.149687038 +0000 UTC m=+42.050438435" watchObservedRunningTime="2026-04-16 16:48:27.12245255 +0000 UTC m=+46.023203935"
Apr 16 16:48:28.111498 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:28.111467    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" event={"ID":"8e583e75-b233-48e9-a90e-00cff442db85","Type":"ContainerStarted","Data":"818b4bb1dc26336f77410f923b58d2236456b892d034da6a2bf9d88d2c5b7911"}
Apr 16 16:48:28.111928 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:28.111505    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" event={"ID":"8e583e75-b233-48e9-a90e-00cff442db85","Type":"ContainerStarted","Data":"e291ee632b1e87d38e6461222bd52cb6849cc5e1be8c5d52d0d4c50ead1a6772"}
Apr 16 16:48:28.131037 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:28.130998    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" podStartSLOduration=34.21744163 podStartE2EDuration="46.130987183s" podCreationTimestamp="2026-04-16 16:47:42 +0000 UTC" firstStartedPulling="2026-04-16 16:48:15.84267852 +0000 UTC m=+34.743429888" lastFinishedPulling="2026-04-16 16:48:27.756224062 +0000 UTC m=+46.656975441" observedRunningTime="2026-04-16 16:48:28.129977771 +0000 UTC m=+47.030729156" watchObservedRunningTime="2026-04-16 16:48:28.130987183 +0000 UTC m=+47.031738567"
Apr 16 16:48:30.381438 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:30.381402    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:30.381874 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:30.381467    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:30.381874 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:30.381542    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Apr 16 16:48:30.381874 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:30.381562    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848fcfd69-2p7x4: secret "image-registry-tls" not found
Apr 16 16:48:30.381874 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:30.381548    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Apr 16 16:48:30.381874 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:30.381609    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls podName:bbc01d7b-9e55-46bf-a370-eb85e14c347b nodeName:}" failed. No retries permitted until 2026-04-16 16:48:46.381594047 +0000 UTC m=+65.282345409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls") pod "image-registry-848fcfd69-2p7x4" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b") : secret "image-registry-tls" not found
Apr 16 16:48:30.381874 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:30.381701    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert podName:77527e40-fe4f-4ffd-9e9f-6f9daa905db4 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:46.381684607 +0000 UTC m=+65.282435969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert") pod "ingress-canary-lwxz6" (UID: "77527e40-fe4f-4ffd-9e9f-6f9daa905db4") : secret "canary-serving-cert" not found
Apr 16 16:48:30.482450 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:30.482420    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:30.482586 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:30.482510    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Apr 16 16:48:30.482586 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:30.482552    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls podName:4b383d53-c55b-43dc-865b-bcf9daa5c109 nodeName:}" failed. No retries permitted until 2026-04-16 16:48:46.482539647 +0000 UTC m=+65.383291009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls") pod "dns-default-xsmg4" (UID: "4b383d53-c55b-43dc-865b-bcf9daa5c109") : secret "dns-default-metrics-tls" not found
Apr 16 16:48:41.057328 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:41.057299    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7xdk"
Apr 16 16:48:46.391442 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.391408    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:48:46.391442 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.391443    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:48:46.391931 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.391484    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:48:46.391931 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:46.391560    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Apr 16 16:48:46.391931 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:46.391563    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Apr 16 16:48:46.391931 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:46.391582    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848fcfd69-2p7x4: secret "image-registry-tls" not found
Apr 16 16:48:46.391931 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:46.391607    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert podName:77527e40-fe4f-4ffd-9e9f-6f9daa905db4 nodeName:}" failed. No retries permitted until 2026-04-16 16:49:18.391594472 +0000 UTC m=+97.292345833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert") pod "ingress-canary-lwxz6" (UID: "77527e40-fe4f-4ffd-9e9f-6f9daa905db4") : secret "canary-serving-cert" not found
Apr 16 16:48:46.391931 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:46.391631    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls podName:bbc01d7b-9e55-46bf-a370-eb85e14c347b nodeName:}" failed. No retries permitted until 2026-04-16 16:49:18.391617705 +0000 UTC m=+97.292369072 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls") pod "image-registry-848fcfd69-2p7x4" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b") : secret "image-registry-tls" not found
Apr 16 16:48:46.394079 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.394064    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Apr 16 16:48:46.402467 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:46.402443    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Apr 16 16:48:46.402555 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:46.402492    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs podName:cffe5d0c-d081-4b1e-b883-472bec4cfc56 nodeName:}" failed. No retries permitted until 2026-04-16 16:49:50.402478162 +0000 UTC m=+129.303229523 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs") pod "network-metrics-daemon-t57ts" (UID: "cffe5d0c-d081-4b1e-b883-472bec4cfc56") : secret "metrics-daemon-secret" not found
Apr 16 16:48:46.491847 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.491826    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:48:46.491920 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.491883    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6gcw\" (UniqueName: \"kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw\") pod \"network-check-target-c7j5m\" (UID: \"172397d5-6eec-4fb9-a90f-18f769743e08\") " pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:46.491968 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:46.491942    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Apr 16 16:48:46.492012 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:48:46.491978    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls podName:4b383d53-c55b-43dc-865b-bcf9daa5c109 nodeName:}" failed. No retries permitted until 2026-04-16 16:49:18.491968086 +0000 UTC m=+97.392719448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls") pod "dns-default-xsmg4" (UID: "4b383d53-c55b-43dc-865b-bcf9daa5c109") : secret "dns-default-metrics-tls" not found
Apr 16 16:48:46.494947 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.494932    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Apr 16 16:48:46.505425 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.505406    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Apr 16 16:48:46.515109 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.515091    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6gcw\" (UniqueName: \"kubernetes.io/projected/172397d5-6eec-4fb9-a90f-18f769743e08-kube-api-access-b6gcw\") pod \"network-check-target-c7j5m\" (UID: \"172397d5-6eec-4fb9-a90f-18f769743e08\") " pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:46.537978 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.537954    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wrbkk\""
Apr 16 16:48:46.545242 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.545223    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:46.666051 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:46.665993    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c7j5m"]
Apr 16 16:48:46.668806 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:48:46.668768    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172397d5_6eec_4fb9_a90f_18f769743e08.slice/crio-50159b45147d23edd86ce6de331edaa7d103e1bc002ecea2fa129cbc8d9eafea WatchSource:0}: Error finding container 50159b45147d23edd86ce6de331edaa7d103e1bc002ecea2fa129cbc8d9eafea: Status 404 returned error can't find the container with id 50159b45147d23edd86ce6de331edaa7d103e1bc002ecea2fa129cbc8d9eafea
Apr 16 16:48:47.159365 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:47.159323    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c7j5m" event={"ID":"172397d5-6eec-4fb9-a90f-18f769743e08","Type":"ContainerStarted","Data":"50159b45147d23edd86ce6de331edaa7d103e1bc002ecea2fa129cbc8d9eafea"}
Apr 16 16:48:50.169985 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:50.169957    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c7j5m" event={"ID":"172397d5-6eec-4fb9-a90f-18f769743e08","Type":"ContainerStarted","Data":"4ca3f31827c45cad7b1c5ae87601f6d15fc57b141c6c2deb0b586065694fe7a6"}
Apr 16 16:48:50.170343 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:50.170072    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:48:50.186051 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:48:50.186013    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c7j5m" podStartSLOduration=66.277717704 podStartE2EDuration="1m9.186001094s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="2026-04-16 16:48:46.670762612 +0000 UTC m=+65.571513975" lastFinishedPulling="2026-04-16 16:48:49.579046004 +0000 UTC m=+68.479797365" observedRunningTime="2026-04-16 16:48:50.185070327 +0000 UTC m=+69.085821712" watchObservedRunningTime="2026-04-16 16:48:50.186001094 +0000 UTC m=+69.086752470"
Apr 16 16:49:18.412526 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:49:18.412412    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:49:18.412526 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:49:18.412460    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:49:18.413019 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:49:18.412571    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Apr 16 16:49:18.413019 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:49:18.412572    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Apr 16 16:49:18.413019 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:49:18.412648    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert podName:77527e40-fe4f-4ffd-9e9f-6f9daa905db4 nodeName:}" failed. No retries permitted until 2026-04-16 16:50:22.412630224 +0000 UTC m=+161.313381600 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert") pod "ingress-canary-lwxz6" (UID: "77527e40-fe4f-4ffd-9e9f-6f9daa905db4") : secret "canary-serving-cert" not found
Apr 16 16:49:18.413019 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:49:18.412591    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848fcfd69-2p7x4: secret "image-registry-tls" not found
Apr 16 16:49:18.413019 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:49:18.412728    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls podName:bbc01d7b-9e55-46bf-a370-eb85e14c347b nodeName:}" failed. No retries permitted until 2026-04-16 16:50:22.412716781 +0000 UTC m=+161.313468142 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls") pod "image-registry-848fcfd69-2p7x4" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b") : secret "image-registry-tls" not found
Apr 16 16:49:18.512707 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:49:18.512680    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:49:18.512831 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:49:18.512816    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Apr 16 16:49:18.512881 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:49:18.512859    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls podName:4b383d53-c55b-43dc-865b-bcf9daa5c109 nodeName:}" failed. No retries permitted until 2026-04-16 16:50:22.512848944 +0000 UTC m=+161.413600305 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls") pod "dns-default-xsmg4" (UID: "4b383d53-c55b-43dc-865b-bcf9daa5c109") : secret "dns-default-metrics-tls" not found
Apr 16 16:49:21.175080 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:49:21.175044    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c7j5m"
Apr 16 16:49:50.427096 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:49:50.427059    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:49:50.427556 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:49:50.427175    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Apr 16 16:49:50.427556 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:49:50.427225    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs podName:cffe5d0c-d081-4b1e-b883-472bec4cfc56 nodeName:}" failed. No retries permitted until 2026-04-16 16:51:52.427211519 +0000 UTC m=+251.327962880 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs") pod "network-metrics-daemon-t57ts" (UID: "cffe5d0c-d081-4b1e-b883-472bec4cfc56") : secret "metrics-daemon-secret" not found
Apr 16 16:49:51.313126 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:49:51.313102    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-szz5j_cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c/dns-node-resolver/0.log"
Apr 16 16:49:51.712552 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:49:51.712478    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k8bx9_e6e03468-e748-4fcf-bc8a-7ee1b325454e/node-ca/0.log"
Apr 16 16:50:17.540111 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:50:17.540070    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4" podUID="bbc01d7b-9e55-46bf-a370-eb85e14c347b"
Apr 16 16:50:17.564487 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:50:17.564465    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-lwxz6" podUID="77527e40-fe4f-4ffd-9e9f-6f9daa905db4"
Apr 16 16:50:17.595737 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:50:17.595718    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xsmg4" podUID="4b383d53-c55b-43dc-865b-bcf9daa5c109"
Apr 16 16:50:17.727530 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:50:17.727500    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-t57ts" podUID="cffe5d0c-d081-4b1e-b883-472bec4cfc56"
Apr 16 16:50:18.376583 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:18.376553    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:50:18.376762 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:18.376552    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:50:20.309572 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.309540    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2xd9v"]
Apr 16 16:50:20.312675 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.312659    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.316198 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.316178    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Apr 16 16:50:20.316330 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.316316    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Apr 16 16:50:20.317376 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.317355    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Apr 16 16:50:20.317376 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.317362    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nbldh\""
Apr 16 16:50:20.317513 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.317417    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Apr 16 16:50:20.340589 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.340570    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2xd9v"]
Apr 16 16:50:20.432546 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.432524    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f99c6da4-6e1f-4cf5-9958-749fb93050ce-crio-socket\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.432709 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.432558    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f99c6da4-6e1f-4cf5-9958-749fb93050ce-data-volume\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.432709 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.432584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rghf9\" (UniqueName: \"kubernetes.io/projected/f99c6da4-6e1f-4cf5-9958-749fb93050ce-kube-api-access-rghf9\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.432709 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.432632    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f99c6da4-6e1f-4cf5-9958-749fb93050ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.432709 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.432667    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f99c6da4-6e1f-4cf5-9958-749fb93050ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.533751 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.533728    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f99c6da4-6e1f-4cf5-9958-749fb93050ce-crio-socket\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.533888 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.533761    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f99c6da4-6e1f-4cf5-9958-749fb93050ce-data-volume\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.533888 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.533785    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rghf9\" (UniqueName: \"kubernetes.io/projected/f99c6da4-6e1f-4cf5-9958-749fb93050ce-kube-api-access-rghf9\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.533888 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.533828    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f99c6da4-6e1f-4cf5-9958-749fb93050ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.533888 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.533860    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f99c6da4-6e1f-4cf5-9958-749fb93050ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.533888 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.533860    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f99c6da4-6e1f-4cf5-9958-749fb93050ce-crio-socket\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.534129 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.534114    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f99c6da4-6e1f-4cf5-9958-749fb93050ce-data-volume\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.534357 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.534335    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f99c6da4-6e1f-4cf5-9958-749fb93050ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.536114 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.536088    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f99c6da4-6e1f-4cf5-9958-749fb93050ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.543534 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.543515    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rghf9\" (UniqueName: \"kubernetes.io/projected/f99c6da4-6e1f-4cf5-9958-749fb93050ce-kube-api-access-rghf9\") pod \"insights-runtime-extractor-2xd9v\" (UID: \"f99c6da4-6e1f-4cf5-9958-749fb93050ce\") " pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.621512 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.621462    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2xd9v"
Apr 16 16:50:20.731988 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:20.731960    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2xd9v"]
Apr 16 16:50:20.736037 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:50:20.736013    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99c6da4_6e1f_4cf5_9958_749fb93050ce.slice/crio-de2fadab0f6389a22fee698de46b249ba28559f2eabcf2b7871782cf60151866 WatchSource:0}: Error finding container de2fadab0f6389a22fee698de46b249ba28559f2eabcf2b7871782cf60151866: Status 404 returned error can't find the container with id de2fadab0f6389a22fee698de46b249ba28559f2eabcf2b7871782cf60151866
Apr 16 16:50:21.386465 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:21.386432    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xd9v" event={"ID":"f99c6da4-6e1f-4cf5-9958-749fb93050ce","Type":"ContainerStarted","Data":"320e8c5330254f3263ce403c224f639715dd8de46ca9a4b510ec8360d62339e1"}
Apr 16 16:50:21.386465 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:21.386469    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xd9v" event={"ID":"f99c6da4-6e1f-4cf5-9958-749fb93050ce","Type":"ContainerStarted","Data":"de2fadab0f6389a22fee698de46b249ba28559f2eabcf2b7871782cf60151866"}
Apr 16 16:50:22.390590 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.390557    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xd9v" event={"ID":"f99c6da4-6e1f-4cf5-9958-749fb93050ce","Type":"ContainerStarted","Data":"3c10097a5cd38a3fe29a2314c86d228d29b7dca1867f26c8fcafbe3ad7c5c03c"}
Apr 16 16:50:22.392036 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.392011    2569 generic.go:358] "Generic (PLEG): container finished" podID="8509b8ec-b1d5-4995-a05f-20d6f7418127" containerID="298b92888b75999e88529d5ee99440c19204a1029dd5bf0aa41701f8c4dbd2b0" exitCode=255
Apr 16 16:50:22.392145 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.392085    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn" event={"ID":"8509b8ec-b1d5-4995-a05f-20d6f7418127","Type":"ContainerDied","Data":"298b92888b75999e88529d5ee99440c19204a1029dd5bf0aa41701f8c4dbd2b0"}
Apr 16 16:50:22.392468 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.392439    2569 scope.go:117] "RemoveContainer" containerID="298b92888b75999e88529d5ee99440c19204a1029dd5bf0aa41701f8c4dbd2b0"
Apr 16 16:50:22.393537 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.393494    2569 generic.go:358] "Generic (PLEG): container finished" podID="85c6826a-2212-4fb5-bc8b-b975ac9af043" containerID="74215aa472466a9dd9a0879c908c0df3806bd4d70098974f9a8e6105bd2bbcfa" exitCode=1
Apr 16 16:50:22.393655 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.393541    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4" event={"ID":"85c6826a-2212-4fb5-bc8b-b975ac9af043","Type":"ContainerDied","Data":"74215aa472466a9dd9a0879c908c0df3806bd4d70098974f9a8e6105bd2bbcfa"}
Apr 16 16:50:22.393874 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.393851    2569 scope.go:117] "RemoveContainer" containerID="74215aa472466a9dd9a0879c908c0df3806bd4d70098974f9a8e6105bd2bbcfa"
Apr 16 16:50:22.450009 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.449983    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:50:22.450189 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.450168    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:50:22.452395 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.452374    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77527e40-fe4f-4ffd-9e9f-6f9daa905db4-cert\") pod \"ingress-canary-lwxz6\" (UID: \"77527e40-fe4f-4ffd-9e9f-6f9daa905db4\") " pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:50:22.452656 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.452634    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"image-registry-848fcfd69-2p7x4\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") " pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:50:22.551237 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.551167    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:50:22.553764 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.553742    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b383d53-c55b-43dc-865b-bcf9daa5c109-metrics-tls\") pod \"dns-default-xsmg4\" (UID: \"4b383d53-c55b-43dc-865b-bcf9daa5c109\") " pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:50:22.580199 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.580175    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c25vw\""
Apr 16 16:50:22.580325 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.580230    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-djqlx\""
Apr 16 16:50:22.588280 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.588256    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:50:22.588379 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:22.588346    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lwxz6"
Apr 16 16:50:23.003634 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.003561    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-848fcfd69-2p7x4"]
Apr 16 16:50:23.006662 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:50:23.006634    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc01d7b_9e55_46bf_a370_eb85e14c347b.slice/crio-7e2dcd227a275788b527a8ec8c0437a82fd80deb506dc19fa6da8333831157c9 WatchSource:0}: Error finding container 7e2dcd227a275788b527a8ec8c0437a82fd80deb506dc19fa6da8333831157c9: Status 404 returned error can't find the container with id 7e2dcd227a275788b527a8ec8c0437a82fd80deb506dc19fa6da8333831157c9
Apr 16 16:50:23.017185 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.017162    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lwxz6"]
Apr 16 16:50:23.020045 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:50:23.020023    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77527e40_fe4f_4ffd_9e9f_6f9daa905db4.slice/crio-7d2d4aa115b24415bd50cca097e8ad97d42c91686a19faf80f0b7dd236367200 WatchSource:0}: Error finding container 7d2d4aa115b24415bd50cca097e8ad97d42c91686a19faf80f0b7dd236367200: Status 404 returned error can't find the container with id 7d2d4aa115b24415bd50cca097e8ad97d42c91686a19faf80f0b7dd236367200
Apr 16 16:50:23.095677 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.095655    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:50:23.400454 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.400418    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4" event={"ID":"bbc01d7b-9e55-46bf-a370-eb85e14c347b","Type":"ContainerStarted","Data":"cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af"}
Apr 16 16:50:23.400454 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.400454    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4" event={"ID":"bbc01d7b-9e55-46bf-a370-eb85e14c347b","Type":"ContainerStarted","Data":"7e2dcd227a275788b527a8ec8c0437a82fd80deb506dc19fa6da8333831157c9"}
Apr 16 16:50:23.400896 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.400507    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:50:23.401441 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.401421    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lwxz6" event={"ID":"77527e40-fe4f-4ffd-9e9f-6f9daa905db4","Type":"ContainerStarted","Data":"7d2d4aa115b24415bd50cca097e8ad97d42c91686a19faf80f0b7dd236367200"}
Apr 16 16:50:23.402763 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.402742    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5845f779bf-kjbzn" event={"ID":"8509b8ec-b1d5-4995-a05f-20d6f7418127","Type":"ContainerStarted","Data":"4df59258155b816803611e50eb00c2c016d576b5a3f1ee3243ac114d01dafe20"}
Apr 16 16:50:23.404266 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.404247    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4" event={"ID":"85c6826a-2212-4fb5-bc8b-b975ac9af043","Type":"ContainerStarted","Data":"49ea38a016b0d601ca2e6abb9fcf8f38333dce8d66c02de2a94ae7155c2b8550"}
Apr 16 16:50:23.404434 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.404421    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:50:23.405131 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.405113    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554687b794-m5vz4"
Apr 16 16:50:23.406165 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.406142    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xd9v" event={"ID":"f99c6da4-6e1f-4cf5-9958-749fb93050ce","Type":"ContainerStarted","Data":"40243c1697ed8984496ccda0702aa93ced1bb5f4e123aa152bca350f2ec25e6b"}
Apr 16 16:50:23.423257 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.423189    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4" podStartSLOduration=162.423178151 podStartE2EDuration="2m42.423178151s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 16:50:23.422108025 +0000 UTC m=+162.322859412" watchObservedRunningTime="2026-04-16 16:50:23.423178151 +0000 UTC m=+162.323929534"
Apr 16 16:50:23.458406 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:23.458363    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2xd9v" podStartSLOduration=1.319172632 podStartE2EDuration="3.458350795s" podCreationTimestamp="2026-04-16 16:50:20 +0000 UTC" firstStartedPulling="2026-04-16 16:50:20.787419302 +0000 UTC m=+159.688170664" lastFinishedPulling="2026-04-16 16:50:22.926597453 +0000 UTC m=+161.827348827" observedRunningTime="2026-04-16 16:50:23.45707619 +0000 UTC m=+162.357827576" watchObservedRunningTime="2026-04-16 16:50:23.458350795 +0000 UTC m=+162.359102198"
Apr 16 16:50:25.412670 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:25.412634    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lwxz6" event={"ID":"77527e40-fe4f-4ffd-9e9f-6f9daa905db4","Type":"ContainerStarted","Data":"8b95128a2d1bb5453687e107870203f7c3cc2b6be7bcd91b57a9d46142ebf8c4"}
Apr 16 16:50:28.708443 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:28.708415    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:50:28.711412 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:28.711395    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-99nwp\""
Apr 16 16:50:28.719619 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:28.719596    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:50:28.830410 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:28.830366    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lwxz6" podStartSLOduration=133.351901906 podStartE2EDuration="2m14.830350248s" podCreationTimestamp="2026-04-16 16:48:14 +0000 UTC" firstStartedPulling="2026-04-16 16:50:23.021768211 +0000 UTC m=+161.922519577" lastFinishedPulling="2026-04-16 16:50:24.500216557 +0000 UTC m=+163.400967919" observedRunningTime="2026-04-16 16:50:25.427064924 +0000 UTC m=+164.327816309" watchObservedRunningTime="2026-04-16 16:50:28.830350248 +0000 UTC m=+167.731101631"
Apr 16 16:50:28.831237 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:28.831164    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xsmg4"]
Apr 16 16:50:28.833505 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:50:28.833482    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b383d53_c55b_43dc_865b_bcf9daa5c109.slice/crio-06c448a2416269a93eef887c4d1dda114198734c41346ae748bb9a32277fe77f WatchSource:0}: Error finding container 06c448a2416269a93eef887c4d1dda114198734c41346ae748bb9a32277fe77f: Status 404 returned error can't find the container with id 06c448a2416269a93eef887c4d1dda114198734c41346ae748bb9a32277fe77f
Apr 16 16:50:29.189116 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.189086    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9qz28"]
Apr 16 16:50:29.193937 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.193918    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.196729 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.196710    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Apr 16 16:50:29.196847 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.196767    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Apr 16 16:50:29.197149 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.197132    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Apr 16 16:50:29.197208 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.197175    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Apr 16 16:50:29.198050 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.198031    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-66nmg\""
Apr 16 16:50:29.198162 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.198064    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Apr 16 16:50:29.198162 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.198064    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Apr 16 16:50:29.299625 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.299602    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f1312d7-24d4-4f92-9244-ca6e1685be48-root\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.299760 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.299636    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-tls\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.299760 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.299664    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.299760 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.299748    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f1312d7-24d4-4f92-9244-ca6e1685be48-sys\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.299955 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.299807    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxkqd\" (UniqueName: \"kubernetes.io/projected/9f1312d7-24d4-4f92-9244-ca6e1685be48-kube-api-access-xxkqd\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.299955 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.299837    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f1312d7-24d4-4f92-9244-ca6e1685be48-metrics-client-ca\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.299955 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.299882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.299955 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.299930    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-wtmp\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.300139 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.299985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-textfile\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401053 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401025    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f1312d7-24d4-4f92-9244-ca6e1685be48-sys\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401197 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401070    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkqd\" (UniqueName: \"kubernetes.io/projected/9f1312d7-24d4-4f92-9244-ca6e1685be48-kube-api-access-xxkqd\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401197 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401140    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f1312d7-24d4-4f92-9244-ca6e1685be48-sys\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401197 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401185    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f1312d7-24d4-4f92-9244-ca6e1685be48-metrics-client-ca\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401349 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401239    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401349 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401272    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-wtmp\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401349 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401306    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-textfile\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401490 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401360    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f1312d7-24d4-4f92-9244-ca6e1685be48-root\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401490 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401384    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-tls\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401490 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401410    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401490 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401480    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-wtmp\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401680 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401540    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f1312d7-24d4-4f92-9244-ca6e1685be48-root\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401738 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:50:29.401724    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Apr 16 16:50:29.401787 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401773    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f1312d7-24d4-4f92-9244-ca6e1685be48-metrics-client-ca\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401861 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:50:29.401815    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-tls podName:9f1312d7-24d4-4f92-9244-ca6e1685be48 nodeName:}" failed. No retries permitted until 2026-04-16 16:50:29.901776093 +0000 UTC m=+168.802527467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-tls") pod "node-exporter-9qz28" (UID: "9f1312d7-24d4-4f92-9244-ca6e1685be48") : secret "node-exporter-tls" not found
Apr 16 16:50:29.401932 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401913    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.401991 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.401945    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-textfile\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.403709 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.403690    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.410945 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.410924    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxkqd\" (UniqueName: \"kubernetes.io/projected/9f1312d7-24d4-4f92-9244-ca6e1685be48-kube-api-access-xxkqd\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.424770 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.424744    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xsmg4" event={"ID":"4b383d53-c55b-43dc-865b-bcf9daa5c109","Type":"ContainerStarted","Data":"06c448a2416269a93eef887c4d1dda114198734c41346ae748bb9a32277fe77f"}
Apr 16 16:50:29.905484 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.905451    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-tls\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:29.908063 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:29.908033    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f1312d7-24d4-4f92-9244-ca6e1685be48-node-exporter-tls\") pod \"node-exporter-9qz28\" (UID: \"9f1312d7-24d4-4f92-9244-ca6e1685be48\") " pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:30.103920 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:30.103897    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qz28"
Apr 16 16:50:30.429571 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:30.429487    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xsmg4" event={"ID":"4b383d53-c55b-43dc-865b-bcf9daa5c109","Type":"ContainerStarted","Data":"6bc00b062407ce896148b44facab8ee7bbc689a429e866b6303984b234826fc1"}
Apr 16 16:50:30.429571 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:30.429527    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xsmg4" event={"ID":"4b383d53-c55b-43dc-865b-bcf9daa5c109","Type":"ContainerStarted","Data":"55f0f0569d6408ddbdb9aba82d9afc823c7997a87964e81a4180609c6ebfb76a"}
Apr 16 16:50:30.429778 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:30.429613    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:50:30.430594 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:30.430563    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qz28" event={"ID":"9f1312d7-24d4-4f92-9244-ca6e1685be48","Type":"ContainerStarted","Data":"9df9f9aca69d5273cb30a3bff074e79a678a2437cf449bb1b7c768ba5e94965a"}
Apr 16 16:50:30.448602 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:30.448556    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-xsmg4" podStartSLOduration=135.1889033 podStartE2EDuration="2m16.448542872s" podCreationTimestamp="2026-04-16 16:48:14 +0000 UTC" firstStartedPulling="2026-04-16 16:50:28.835337187 +0000 UTC m=+167.736088549" lastFinishedPulling="2026-04-16 16:50:30.094976747 +0000 UTC m=+168.995728121" observedRunningTime="2026-04-16 16:50:30.447968083 +0000 UTC m=+169.348719467" watchObservedRunningTime="2026-04-16 16:50:30.448542872 +0000 UTC m=+169.349294256"
Apr 16 16:50:30.709095 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:30.709024    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:50:31.433813 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:31.433765    2569 generic.go:358] "Generic (PLEG): container finished" podID="9f1312d7-24d4-4f92-9244-ca6e1685be48" containerID="0c0ca5bcac31f387b4b1d845c6c03512e0ebb19113ba8981d5d6c4366855049e" exitCode=0
Apr 16 16:50:31.434183 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:31.433852    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qz28" event={"ID":"9f1312d7-24d4-4f92-9244-ca6e1685be48","Type":"ContainerDied","Data":"0c0ca5bcac31f387b4b1d845c6c03512e0ebb19113ba8981d5d6c4366855049e"}
Apr 16 16:50:32.438095 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:32.438062    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qz28" event={"ID":"9f1312d7-24d4-4f92-9244-ca6e1685be48","Type":"ContainerStarted","Data":"469ca9a31dcc12ae02a2ae4776b3588050b5302c4c76ff36857666b20949a0b5"}
Apr 16 16:50:32.438095 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:32.438100    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qz28" event={"ID":"9f1312d7-24d4-4f92-9244-ca6e1685be48","Type":"ContainerStarted","Data":"64d8718e54353214264698c7a4e7c248a57433fba2d6d8512b18b6b064049c36"}
Apr 16 16:50:32.459851 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:32.459786    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9qz28" podStartSLOduration=2.654967229 podStartE2EDuration="3.459771344s" podCreationTimestamp="2026-04-16 16:50:29 +0000 UTC" firstStartedPulling="2026-04-16 16:50:30.115023641 +0000 UTC m=+169.015775016" lastFinishedPulling="2026-04-16 16:50:30.919827755 +0000 UTC m=+169.820579131" observedRunningTime="2026-04-16 16:50:32.457994365 +0000 UTC m=+171.358745749" watchObservedRunningTime="2026-04-16 16:50:32.459771344 +0000 UTC m=+171.360522729"
Apr 16 16:50:40.436429 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:40.436402    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xsmg4"
Apr 16 16:50:42.594424 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:42.594388    2569 patch_prober.go:28] interesting pod/image-registry-848fcfd69-2p7x4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Apr 16 16:50:42.594773 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:42.594440    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4" podUID="bbc01d7b-9e55-46bf-a370-eb85e14c347b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Apr 16 16:50:43.010602 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:43.010520    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-848fcfd69-2p7x4"]
Apr 16 16:50:43.015448 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:43.015422    2569 patch_prober.go:28] interesting pod/image-registry-848fcfd69-2p7x4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Apr 16 16:50:43.015583 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:43.015464    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4" podUID="bbc01d7b-9e55-46bf-a370-eb85e14c347b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Apr 16 16:50:53.014565 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:53.014535    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:50:54.818789 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:50:54.818755    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" podUID="8e583e75-b233-48e9-a90e-00cff442db85" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Apr 16 16:51:04.818917 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:04.818872    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" podUID="8e583e75-b233-48e9-a90e-00cff442db85" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Apr 16 16:51:08.029269 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.029203    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4" podUID="bbc01d7b-9e55-46bf-a370-eb85e14c347b" containerName="registry" containerID="cri-o://cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af" gracePeriod=30
Apr 16 16:51:08.265153 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.265128    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:51:08.365689 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.365653    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-image-registry-private-configuration\") pod \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") "
Apr 16 16:51:08.365895 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.365723    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-trusted-ca\") pod \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") "
Apr 16 16:51:08.365895 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.365766    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") pod \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") "
Apr 16 16:51:08.365895 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.365786    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-bound-sa-token\") pod \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") "
Apr 16 16:51:08.365895 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.365838    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bbc01d7b-9e55-46bf-a370-eb85e14c347b-ca-trust-extracted\") pod \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") "
Apr 16 16:51:08.365895 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.365866    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-certificates\") pod \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") "
Apr 16 16:51:08.366136 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.365906    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5px6b\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-kube-api-access-5px6b\") pod \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") "
Apr 16 16:51:08.366136 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.365933    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-installation-pull-secrets\") pod \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\" (UID: \"bbc01d7b-9e55-46bf-a370-eb85e14c347b\") "
Apr 16 16:51:08.366467 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.366313    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bbc01d7b-9e55-46bf-a370-eb85e14c347b" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 16 16:51:08.366467 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.366408    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bbc01d7b-9e55-46bf-a370-eb85e14c347b" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 16 16:51:08.366675 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.366548    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-certificates\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 16:51:08.366675 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.366570    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bbc01d7b-9e55-46bf-a370-eb85e14c347b-trusted-ca\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 16:51:08.368365 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.368330    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bbc01d7b-9e55-46bf-a370-eb85e14c347b" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 16 16:51:08.368365 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.368343    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bbc01d7b-9e55-46bf-a370-eb85e14c347b" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 16 16:51:08.368534 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.368427    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bbc01d7b-9e55-46bf-a370-eb85e14c347b" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 16 16:51:08.368534 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.368487    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-kube-api-access-5px6b" (OuterVolumeSpecName: "kube-api-access-5px6b") pod "bbc01d7b-9e55-46bf-a370-eb85e14c347b" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b"). InnerVolumeSpecName "kube-api-access-5px6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 16 16:51:08.368614 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.368598    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bbc01d7b-9e55-46bf-a370-eb85e14c347b" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 16 16:51:08.377507 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.377466    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc01d7b-9e55-46bf-a370-eb85e14c347b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bbc01d7b-9e55-46bf-a370-eb85e14c347b" (UID: "bbc01d7b-9e55-46bf-a370-eb85e14c347b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 16 16:51:08.467475 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.467436    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-registry-tls\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 16:51:08.467475 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.467467    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-bound-sa-token\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 16:51:08.467475 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.467477    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bbc01d7b-9e55-46bf-a370-eb85e14c347b-ca-trust-extracted\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 16:51:08.467703 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.467486    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5px6b\" (UniqueName: \"kubernetes.io/projected/bbc01d7b-9e55-46bf-a370-eb85e14c347b-kube-api-access-5px6b\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 16:51:08.467703 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.467497    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-installation-pull-secrets\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 16:51:08.467703 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.467507    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bbc01d7b-9e55-46bf-a370-eb85e14c347b-image-registry-private-configuration\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 16:51:08.539318 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.539271    2569 generic.go:358] "Generic (PLEG): container finished" podID="bbc01d7b-9e55-46bf-a370-eb85e14c347b" containerID="cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af" exitCode=0
Apr 16 16:51:08.539518 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.539327    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4" event={"ID":"bbc01d7b-9e55-46bf-a370-eb85e14c347b","Type":"ContainerDied","Data":"cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af"}
Apr 16 16:51:08.539518 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.539364    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4" event={"ID":"bbc01d7b-9e55-46bf-a370-eb85e14c347b","Type":"ContainerDied","Data":"7e2dcd227a275788b527a8ec8c0437a82fd80deb506dc19fa6da8333831157c9"}
Apr 16 16:51:08.539518 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.539386    2569 scope.go:117] "RemoveContainer" containerID="cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af"
Apr 16 16:51:08.539518 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.539391    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848fcfd69-2p7x4"
Apr 16 16:51:08.547366 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.547346    2569 scope.go:117] "RemoveContainer" containerID="cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af"
Apr 16 16:51:08.547667 ip-10-0-139-227 kubenswrapper[2569]: E0416 16:51:08.547645    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af\": container with ID starting with cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af not found: ID does not exist" containerID="cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af"
Apr 16 16:51:08.547735 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.547676    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af"} err="failed to get container status \"cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af\": rpc error: code = NotFound desc = could not find container \"cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af\": container with ID starting with cebbc258ab08e2e850cefb680a718afea2300213f4efc46e30de71b56d0326af not found: ID does not exist"
Apr 16 16:51:08.559859 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.559824    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-848fcfd69-2p7x4"]
Apr 16 16:51:08.563057 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:08.563017    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-848fcfd69-2p7x4"]
Apr 16 16:51:09.712108 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:09.712079    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbc01d7b-9e55-46bf-a370-eb85e14c347b" path="/var/lib/kubelet/pods/bbc01d7b-9e55-46bf-a370-eb85e14c347b/volumes"
Apr 16 16:51:14.818476 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:14.818438    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" podUID="8e583e75-b233-48e9-a90e-00cff442db85" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Apr 16 16:51:14.818988 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:14.818513    2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95"
Apr 16 16:51:14.819165 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:14.819140    2569 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"818b4bb1dc26336f77410f923b58d2236456b892d034da6a2bf9d88d2c5b7911"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Apr 16 16:51:14.819231 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:14.819191    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" podUID="8e583e75-b233-48e9-a90e-00cff442db85" containerName="service-proxy" containerID="cri-o://818b4bb1dc26336f77410f923b58d2236456b892d034da6a2bf9d88d2c5b7911" gracePeriod=30
Apr 16 16:51:15.558758 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:15.558724    2569 generic.go:358] "Generic (PLEG): container finished" podID="8e583e75-b233-48e9-a90e-00cff442db85" containerID="818b4bb1dc26336f77410f923b58d2236456b892d034da6a2bf9d88d2c5b7911" exitCode=2
Apr 16 16:51:15.558937 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:15.558805    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" event={"ID":"8e583e75-b233-48e9-a90e-00cff442db85","Type":"ContainerDied","Data":"818b4bb1dc26336f77410f923b58d2236456b892d034da6a2bf9d88d2c5b7911"}
Apr 16 16:51:15.558937 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:15.558848    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d6475b-c2r95" event={"ID":"8e583e75-b233-48e9-a90e-00cff442db85","Type":"ContainerStarted","Data":"bd424a79a59c6b77ca055674ede2256f019ab34091eca81167e3a75827a2d044"}
Apr 16 16:51:52.481010 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:52.480965    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:51:52.483320 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:52.483297    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cffe5d0c-d081-4b1e-b883-472bec4cfc56-metrics-certs\") pod \"network-metrics-daemon-t57ts\" (UID: \"cffe5d0c-d081-4b1e-b883-472bec4cfc56\") " pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:51:52.612842 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:52.612818    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-877l2\""
Apr 16 16:51:52.620032 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:52.620011    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t57ts"
Apr 16 16:51:52.731523 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:52.731462    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t57ts"]
Apr 16 16:51:52.734635 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:51:52.734605    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcffe5d0c_d081_4b1e_b883_472bec4cfc56.slice/crio-8a3e93acb1cf167739bbc3b47eb5d1e6e29399c389899733d4d2dff48d23cc5e WatchSource:0}: Error finding container 8a3e93acb1cf167739bbc3b47eb5d1e6e29399c389899733d4d2dff48d23cc5e: Status 404 returned error can't find the container with id 8a3e93acb1cf167739bbc3b47eb5d1e6e29399c389899733d4d2dff48d23cc5e
Apr 16 16:51:53.654314 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:53.654281    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t57ts" event={"ID":"cffe5d0c-d081-4b1e-b883-472bec4cfc56","Type":"ContainerStarted","Data":"8a3e93acb1cf167739bbc3b47eb5d1e6e29399c389899733d4d2dff48d23cc5e"}
Apr 16 16:51:54.657903 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:54.657870    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t57ts" event={"ID":"cffe5d0c-d081-4b1e-b883-472bec4cfc56","Type":"ContainerStarted","Data":"d2fb0d25a8a6b493e27595aa8c0ffb020b36cd87f853f689319c68f1e1da1ba9"}
Apr 16 16:51:54.657903 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:54.657907    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t57ts" event={"ID":"cffe5d0c-d081-4b1e-b883-472bec4cfc56","Type":"ContainerStarted","Data":"f03c80d6d7fbda99bda1d3d6d8932b815dcbc2c958087b4dd0ad9d89a48c3fae"}
Apr 16 16:51:54.677357 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:51:54.677307    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t57ts" podStartSLOduration=252.739879083 podStartE2EDuration="4m13.677290577s" podCreationTimestamp="2026-04-16 16:47:41 +0000 UTC" firstStartedPulling="2026-04-16 16:51:52.736378402 +0000 UTC m=+251.637129771" lastFinishedPulling="2026-04-16 16:51:53.673789903 +0000 UTC m=+252.574541265" observedRunningTime="2026-04-16 16:51:54.676091818 +0000 UTC m=+253.576843213" watchObservedRunningTime="2026-04-16 16:51:54.677290577 +0000 UTC m=+253.578041961"
Apr 16 16:52:41.599642 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:52:41.599616    2569 kubelet.go:1628] "Image garbage collection succeeded"
Apr 16 16:53:38.380818 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.380761    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-cf49989db-z8rgk"]
Apr 16 16:53:38.381271 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.381027    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc01d7b-9e55-46bf-a370-eb85e14c347b" containerName="registry"
Apr 16 16:53:38.381271 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.381038    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc01d7b-9e55-46bf-a370-eb85e14c347b" containerName="registry"
Apr 16 16:53:38.381271 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.381091    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbc01d7b-9e55-46bf-a370-eb85e14c347b" containerName="registry"
Apr 16 16:53:38.383858 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.383838    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-z8rgk"
Apr 16 16:53:38.386419 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.386396    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Apr 16 16:53:38.386679 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.386663    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Apr 16 16:53:38.387751 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.387734    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Apr 16 16:53:38.387843 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.387741    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-fj5x5\""
Apr 16 16:53:38.387904 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.387890    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Apr 16 16:53:38.400879 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.400859    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-z8rgk"]
Apr 16 16:53:38.465318 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.465294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbj89\" (UniqueName: \"kubernetes.io/projected/14a35d23-ae26-4977-91ad-13c3c706e0f1-kube-api-access-hbj89\") pod \"keda-admission-cf49989db-z8rgk\" (UID: \"14a35d23-ae26-4977-91ad-13c3c706e0f1\") " pod="openshift-keda/keda-admission-cf49989db-z8rgk"
Apr 16 16:53:38.465403 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.465336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/14a35d23-ae26-4977-91ad-13c3c706e0f1-certificates\") pod \"keda-admission-cf49989db-z8rgk\" (UID: \"14a35d23-ae26-4977-91ad-13c3c706e0f1\") " pod="openshift-keda/keda-admission-cf49989db-z8rgk"
Apr 16 16:53:38.566066 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.566044    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/14a35d23-ae26-4977-91ad-13c3c706e0f1-certificates\") pod \"keda-admission-cf49989db-z8rgk\" (UID: \"14a35d23-ae26-4977-91ad-13c3c706e0f1\") " pod="openshift-keda/keda-admission-cf49989db-z8rgk"
Apr 16 16:53:38.566158 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.566087    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbj89\" (UniqueName: \"kubernetes.io/projected/14a35d23-ae26-4977-91ad-13c3c706e0f1-kube-api-access-hbj89\") pod \"keda-admission-cf49989db-z8rgk\" (UID: \"14a35d23-ae26-4977-91ad-13c3c706e0f1\") " pod="openshift-keda/keda-admission-cf49989db-z8rgk"
Apr 16 16:53:38.568319 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.568294    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/14a35d23-ae26-4977-91ad-13c3c706e0f1-certificates\") pod \"keda-admission-cf49989db-z8rgk\" (UID: \"14a35d23-ae26-4977-91ad-13c3c706e0f1\") " pod="openshift-keda/keda-admission-cf49989db-z8rgk"
Apr 16 16:53:38.580823 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.580792    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbj89\" (UniqueName: \"kubernetes.io/projected/14a35d23-ae26-4977-91ad-13c3c706e0f1-kube-api-access-hbj89\") pod \"keda-admission-cf49989db-z8rgk\" (UID: \"14a35d23-ae26-4977-91ad-13c3c706e0f1\") " pod="openshift-keda/keda-admission-cf49989db-z8rgk"
Apr 16 16:53:38.694006 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.693952    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-z8rgk"
Apr 16 16:53:38.826156 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.826131    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-z8rgk"]
Apr 16 16:53:38.828432 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:53:38.828408    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a35d23_ae26_4977_91ad_13c3c706e0f1.slice/crio-870ff2f7fa84c4283014c30d462169a854e782d73feddb149cc04e1bca6cf5e4 WatchSource:0}: Error finding container 870ff2f7fa84c4283014c30d462169a854e782d73feddb149cc04e1bca6cf5e4: Status 404 returned error can't find the container with id 870ff2f7fa84c4283014c30d462169a854e782d73feddb149cc04e1bca6cf5e4
Apr 16 16:53:38.829578 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.829562    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 16 16:53:38.915822 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:38.915779    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-z8rgk" event={"ID":"14a35d23-ae26-4977-91ad-13c3c706e0f1","Type":"ContainerStarted","Data":"870ff2f7fa84c4283014c30d462169a854e782d73feddb149cc04e1bca6cf5e4"}
Apr 16 16:53:41.923662 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:41.923629    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-z8rgk" event={"ID":"14a35d23-ae26-4977-91ad-13c3c706e0f1","Type":"ContainerStarted","Data":"0e19b71a8172c02c5ff81ae9eba3f58fc1be34db032fcd8b702a1f944a87a6c6"}
Apr 16 16:53:41.924036 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:41.923762    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-cf49989db-z8rgk"
Apr 16 16:53:41.959229 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:53:41.959187    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-admission-cf49989db-z8rgk" podStartSLOduration=1.725820678 podStartE2EDuration="3.959174717s" podCreationTimestamp="2026-04-16 16:53:38 +0000 UTC" firstStartedPulling="2026-04-16 16:53:38.829687839 +0000 UTC m=+357.730439201" lastFinishedPulling="2026-04-16 16:53:41.063041864 +0000 UTC m=+359.963793240" observedRunningTime="2026-04-16 16:53:41.958520843 +0000 UTC m=+360.859272221" watchObservedRunningTime="2026-04-16 16:53:41.959174717 +0000 UTC m=+360.859926100"
Apr 16 16:54:02.928208 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:02.928178    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-cf49989db-z8rgk"
Apr 16 16:54:46.221790 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.221760    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-86cc847c5c-8b2fh"]
Apr 16 16:54:46.224864 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.224834    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-86cc847c5c-8b2fh"
Apr 16 16:54:46.228491 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.228465    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Apr 16 16:54:46.229564 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.229542    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Apr 16 16:54:46.229564 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.229556    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Apr 16 16:54:46.229725 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.229615    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-9c52w\""
Apr 16 16:54:46.234123 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.234094    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-86cc847c5c-8b2fh"]
Apr 16 16:54:46.305680 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.305647    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb9jx\" (UniqueName: \"kubernetes.io/projected/d0c32075-e4ea-4e0d-b9b7-566df0fe2e97-kube-api-access-jb9jx\") pod \"seaweedfs-86cc847c5c-8b2fh\" (UID: \"d0c32075-e4ea-4e0d-b9b7-566df0fe2e97\") " pod="kserve/seaweedfs-86cc847c5c-8b2fh"
Apr 16 16:54:46.305814 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.305685    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d0c32075-e4ea-4e0d-b9b7-566df0fe2e97-data\") pod \"seaweedfs-86cc847c5c-8b2fh\" (UID: \"d0c32075-e4ea-4e0d-b9b7-566df0fe2e97\") " pod="kserve/seaweedfs-86cc847c5c-8b2fh"
Apr 16 16:54:46.406902 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.406879    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jb9jx\" (UniqueName: \"kubernetes.io/projected/d0c32075-e4ea-4e0d-b9b7-566df0fe2e97-kube-api-access-jb9jx\") pod \"seaweedfs-86cc847c5c-8b2fh\" (UID: \"d0c32075-e4ea-4e0d-b9b7-566df0fe2e97\") " pod="kserve/seaweedfs-86cc847c5c-8b2fh"
Apr 16 16:54:46.406979 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.406912    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d0c32075-e4ea-4e0d-b9b7-566df0fe2e97-data\") pod \"seaweedfs-86cc847c5c-8b2fh\" (UID: \"d0c32075-e4ea-4e0d-b9b7-566df0fe2e97\") " pod="kserve/seaweedfs-86cc847c5c-8b2fh"
Apr 16 16:54:46.407229 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.407213    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d0c32075-e4ea-4e0d-b9b7-566df0fe2e97-data\") pod \"seaweedfs-86cc847c5c-8b2fh\" (UID: \"d0c32075-e4ea-4e0d-b9b7-566df0fe2e97\") " pod="kserve/seaweedfs-86cc847c5c-8b2fh"
Apr 16 16:54:46.415830 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.415786    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb9jx\" (UniqueName: \"kubernetes.io/projected/d0c32075-e4ea-4e0d-b9b7-566df0fe2e97-kube-api-access-jb9jx\") pod \"seaweedfs-86cc847c5c-8b2fh\" (UID: \"d0c32075-e4ea-4e0d-b9b7-566df0fe2e97\") " pod="kserve/seaweedfs-86cc847c5c-8b2fh"
Apr 16 16:54:46.534117 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.534044    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-86cc847c5c-8b2fh"
Apr 16 16:54:46.647292 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:46.647268    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-86cc847c5c-8b2fh"]
Apr 16 16:54:46.649730 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:54:46.649691    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c32075_e4ea_4e0d_b9b7_566df0fe2e97.slice/crio-24f6ab44b1c782eb68d2fe1ff0c8ce6eba220631fd2666cb0e6b26cfc390246d WatchSource:0}: Error finding container 24f6ab44b1c782eb68d2fe1ff0c8ce6eba220631fd2666cb0e6b26cfc390246d: Status 404 returned error can't find the container with id 24f6ab44b1c782eb68d2fe1ff0c8ce6eba220631fd2666cb0e6b26cfc390246d
Apr 16 16:54:47.080676 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:47.080628    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-86cc847c5c-8b2fh" event={"ID":"d0c32075-e4ea-4e0d-b9b7-566df0fe2e97","Type":"ContainerStarted","Data":"24f6ab44b1c782eb68d2fe1ff0c8ce6eba220631fd2666cb0e6b26cfc390246d"}
Apr 16 16:54:50.088901 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:50.088863    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-86cc847c5c-8b2fh" event={"ID":"d0c32075-e4ea-4e0d-b9b7-566df0fe2e97","Type":"ContainerStarted","Data":"73b485a4aa61a411f44a222b3cb2ff4a0772c702b6473330a409360f03902b77"}
Apr 16 16:54:50.089265 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:50.088918    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-86cc847c5c-8b2fh"
Apr 16 16:54:50.106253 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:50.106201    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-86cc847c5c-8b2fh" podStartSLOduration=1.617425334 podStartE2EDuration="4.106181822s" podCreationTimestamp="2026-04-16 16:54:46 +0000 UTC" firstStartedPulling="2026-04-16 16:54:46.651370658 +0000 UTC m=+425.552122020" lastFinishedPulling="2026-04-16 16:54:49.140127141 +0000 UTC m=+428.040878508" observedRunningTime="2026-04-16 16:54:50.105008662 +0000 UTC m=+429.005760045" watchObservedRunningTime="2026-04-16 16:54:50.106181822 +0000 UTC m=+429.006933207"
Apr 16 16:54:56.098252 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:54:56.098183    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-86cc847c5c-8b2fh"
Apr 16 16:55:23.048268 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.048230    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6986579898-k2kd8"]
Apr 16 16:55:23.052566 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.052545    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6986579898-k2kd8"
Apr 16 16:55:23.056203 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.056179    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-xpbhb\""
Apr 16 16:55:23.056321 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.056187    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Apr 16 16:55:23.061149 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.061127    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6986579898-k2kd8"]
Apr 16 16:55:23.143593 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.143569    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c77e11-adaf-476f-af1c-e20b14f29899-cert\") pod \"kserve-controller-manager-6986579898-k2kd8\" (UID: \"15c77e11-adaf-476f-af1c-e20b14f29899\") " pod="kserve/kserve-controller-manager-6986579898-k2kd8"
Apr 16 16:55:23.143699 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.143602    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfqt7\" (UniqueName: \"kubernetes.io/projected/15c77e11-adaf-476f-af1c-e20b14f29899-kube-api-access-vfqt7\") pod \"kserve-controller-manager-6986579898-k2kd8\" (UID: \"15c77e11-adaf-476f-af1c-e20b14f29899\") " pod="kserve/kserve-controller-manager-6986579898-k2kd8"
Apr 16 16:55:23.244047 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.244018    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c77e11-adaf-476f-af1c-e20b14f29899-cert\") pod \"kserve-controller-manager-6986579898-k2kd8\" (UID: \"15c77e11-adaf-476f-af1c-e20b14f29899\") " pod="kserve/kserve-controller-manager-6986579898-k2kd8"
Apr 16 16:55:23.244160 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.244054    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfqt7\" (UniqueName: \"kubernetes.io/projected/15c77e11-adaf-476f-af1c-e20b14f29899-kube-api-access-vfqt7\") pod \"kserve-controller-manager-6986579898-k2kd8\" (UID: \"15c77e11-adaf-476f-af1c-e20b14f29899\") " pod="kserve/kserve-controller-manager-6986579898-k2kd8"
Apr 16 16:55:23.246423 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.246402    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c77e11-adaf-476f-af1c-e20b14f29899-cert\") pod \"kserve-controller-manager-6986579898-k2kd8\" (UID: \"15c77e11-adaf-476f-af1c-e20b14f29899\") " pod="kserve/kserve-controller-manager-6986579898-k2kd8"
Apr 16 16:55:23.252894 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.252874    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfqt7\" (UniqueName: \"kubernetes.io/projected/15c77e11-adaf-476f-af1c-e20b14f29899-kube-api-access-vfqt7\") pod \"kserve-controller-manager-6986579898-k2kd8\" (UID: \"15c77e11-adaf-476f-af1c-e20b14f29899\") " pod="kserve/kserve-controller-manager-6986579898-k2kd8"
Apr 16 16:55:23.362179 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.362143    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6986579898-k2kd8"
Apr 16 16:55:23.473953 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:23.473908    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6986579898-k2kd8"]
Apr 16 16:55:23.475982 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:55:23.475954    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c77e11_adaf_476f_af1c_e20b14f29899.slice/crio-0a33f5e2c1d9f8d5974f50d31f5ff6e2742e8c3a42a8ee660f8dd62fc58a0b84 WatchSource:0}: Error finding container 0a33f5e2c1d9f8d5974f50d31f5ff6e2742e8c3a42a8ee660f8dd62fc58a0b84: Status 404 returned error can't find the container with id 0a33f5e2c1d9f8d5974f50d31f5ff6e2742e8c3a42a8ee660f8dd62fc58a0b84
Apr 16 16:55:24.178115 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:24.178074    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6986579898-k2kd8" event={"ID":"15c77e11-adaf-476f-af1c-e20b14f29899","Type":"ContainerStarted","Data":"0a33f5e2c1d9f8d5974f50d31f5ff6e2742e8c3a42a8ee660f8dd62fc58a0b84"}
Apr 16 16:55:26.184941 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:26.184859    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6986579898-k2kd8" event={"ID":"15c77e11-adaf-476f-af1c-e20b14f29899","Type":"ContainerStarted","Data":"9c45750f967a21ca772a4adc54ce133c12189b17d8cdc3b6e94f4dc5cbb80fe9"}
Apr 16 16:55:26.185353 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:26.184970    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6986579898-k2kd8"
Apr 16 16:55:26.201344 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:26.201302    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6986579898-k2kd8" podStartSLOduration=0.831684023 podStartE2EDuration="3.201289089s" podCreationTimestamp="2026-04-16 16:55:23 +0000 UTC" firstStartedPulling="2026-04-16 16:55:23.477172526 +0000 UTC m=+462.377923888" lastFinishedPulling="2026-04-16 16:55:25.846777581 +0000 UTC m=+464.747528954" observedRunningTime="2026-04-16 16:55:26.199435306 +0000 UTC m=+465.100186691" watchObservedRunningTime="2026-04-16 16:55:26.201289089 +0000 UTC m=+465.102040473"
Apr 16 16:55:57.192975 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:57.192941    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6986579898-k2kd8"
Apr 16 16:55:58.219323 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.219295    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-86f7b4b499-rgkjz"]
Apr 16 16:55:58.221740 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.221723    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-rgkjz"
Apr 16 16:55:58.227515 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.227490    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-wsd44\""
Apr 16 16:55:58.227645 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.227491    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Apr 16 16:55:58.313084 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.313054    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-rgkjz"]
Apr 16 16:55:58.376223 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.376198    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad272d7-52d0-49d0-90fc-7305eafef58d-tls-certs\") pod \"model-serving-api-86f7b4b499-rgkjz\" (UID: \"0ad272d7-52d0-49d0-90fc-7305eafef58d\") " pod="kserve/model-serving-api-86f7b4b499-rgkjz"
Apr 16 16:55:58.376332 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.376242    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2vml\" (UniqueName: \"kubernetes.io/projected/0ad272d7-52d0-49d0-90fc-7305eafef58d-kube-api-access-z2vml\") pod \"model-serving-api-86f7b4b499-rgkjz\" (UID: \"0ad272d7-52d0-49d0-90fc-7305eafef58d\") " pod="kserve/model-serving-api-86f7b4b499-rgkjz"
Apr 16 16:55:58.477111 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.477057    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2vml\" (UniqueName: \"kubernetes.io/projected/0ad272d7-52d0-49d0-90fc-7305eafef58d-kube-api-access-z2vml\") pod \"model-serving-api-86f7b4b499-rgkjz\" (UID: \"0ad272d7-52d0-49d0-90fc-7305eafef58d\") " pod="kserve/model-serving-api-86f7b4b499-rgkjz"
Apr 16 16:55:58.477111 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.477097    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad272d7-52d0-49d0-90fc-7305eafef58d-tls-certs\") pod \"model-serving-api-86f7b4b499-rgkjz\" (UID: \"0ad272d7-52d0-49d0-90fc-7305eafef58d\") " pod="kserve/model-serving-api-86f7b4b499-rgkjz"
Apr 16 16:55:58.479374 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.479357    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad272d7-52d0-49d0-90fc-7305eafef58d-tls-certs\") pod \"model-serving-api-86f7b4b499-rgkjz\" (UID: \"0ad272d7-52d0-49d0-90fc-7305eafef58d\") " pod="kserve/model-serving-api-86f7b4b499-rgkjz"
Apr 16 16:55:58.486364 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.486342    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2vml\" (UniqueName: \"kubernetes.io/projected/0ad272d7-52d0-49d0-90fc-7305eafef58d-kube-api-access-z2vml\") pod \"model-serving-api-86f7b4b499-rgkjz\" (UID: \"0ad272d7-52d0-49d0-90fc-7305eafef58d\") " pod="kserve/model-serving-api-86f7b4b499-rgkjz"
Apr 16 16:55:58.531863 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.531841    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-rgkjz"
Apr 16 16:55:58.647061 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:58.647031    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-rgkjz"]
Apr 16 16:55:58.650882 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:55:58.650852    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad272d7_52d0_49d0_90fc_7305eafef58d.slice/crio-d440a0f65312f941b9563025d23c43166bc211f7ec0467147ca69c0cb4cdd8ee WatchSource:0}: Error finding container d440a0f65312f941b9563025d23c43166bc211f7ec0467147ca69c0cb4cdd8ee: Status 404 returned error can't find the container with id d440a0f65312f941b9563025d23c43166bc211f7ec0467147ca69c0cb4cdd8ee
Apr 16 16:55:59.269482 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:55:59.269448    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-rgkjz" event={"ID":"0ad272d7-52d0-49d0-90fc-7305eafef58d","Type":"ContainerStarted","Data":"d440a0f65312f941b9563025d23c43166bc211f7ec0467147ca69c0cb4cdd8ee"}
Apr 16 16:56:00.272974 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:00.272941    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-rgkjz" event={"ID":"0ad272d7-52d0-49d0-90fc-7305eafef58d","Type":"ContainerStarted","Data":"d4ca8d84ffd33a88f88011a5a0d443388e363ac91b74ebc96f9e859b28813903"}
Apr 16 16:56:00.273374 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:00.273050    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-86f7b4b499-rgkjz"
Apr 16 16:56:00.307215 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:00.307170    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/model-serving-api-86f7b4b499-rgkjz" podStartSLOduration=0.909295125 podStartE2EDuration="2.30715332s" podCreationTimestamp="2026-04-16 16:55:58 +0000 UTC" firstStartedPulling="2026-04-16 16:55:58.652556691 +0000 UTC m=+497.553308052" lastFinishedPulling="2026-04-16 16:56:00.050414884 +0000 UTC m=+498.951166247" observedRunningTime="2026-04-16 16:56:00.3058921 +0000 UTC m=+499.206643499" watchObservedRunningTime="2026-04-16 16:56:00.30715332 +0000 UTC m=+499.207904704"
Apr 16 16:56:11.280173 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:11.280144    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-86f7b4b499-rgkjz"
Apr 16 16:56:45.001347 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.001314    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"]
Apr 16 16:56:45.003768 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.003746    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"
Apr 16 16:56:45.006294 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.006273    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\""
Apr 16 16:56:45.006413 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.006292    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\""
Apr 16 16:56:45.012283 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.012259    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"]
Apr 16 16:56:45.098600 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.098563    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-7fd5766db9-8zjpx\" (UID: \"33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"
Apr 16 16:56:45.098759 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.098644    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvrsv\" (UniqueName: \"kubernetes.io/projected/33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc-kube-api-access-vvrsv\") pod \"seaweedfs-tls-serving-7fd5766db9-8zjpx\" (UID: \"33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"
Apr 16 16:56:45.098759 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.098686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc-data\") pod \"seaweedfs-tls-serving-7fd5766db9-8zjpx\" (UID: \"33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"
Apr 16 16:56:45.199660 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.199616    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc-data\") pod \"seaweedfs-tls-serving-7fd5766db9-8zjpx\" (UID: \"33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"
Apr 16 16:56:45.199889 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.199671    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-7fd5766db9-8zjpx\" (UID: \"33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"
Apr 16 16:56:45.199889 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.199731    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvrsv\" (UniqueName: \"kubernetes.io/projected/33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc-kube-api-access-vvrsv\") pod \"seaweedfs-tls-serving-7fd5766db9-8zjpx\" (UID: \"33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"
Apr 16 16:56:45.200149 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.200115    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc-data\") pod \"seaweedfs-tls-serving-7fd5766db9-8zjpx\" (UID: \"33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"
Apr 16 16:56:45.202231 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.202207    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-7fd5766db9-8zjpx\" (UID: \"33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"
Apr 16 16:56:45.208592 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.208566    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvrsv\" (UniqueName: \"kubernetes.io/projected/33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc-kube-api-access-vvrsv\") pod \"seaweedfs-tls-serving-7fd5766db9-8zjpx\" (UID: \"33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"
Apr 16 16:56:45.313170 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.313140    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"
Apr 16 16:56:45.434171 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:45.434142    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx"]
Apr 16 16:56:45.436722 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:56:45.436693    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33103e6f_fc10_4ea2_a8c4_4ef63a5b48fc.slice/crio-ef7abdcada1e444248598cda5044a9b15734b747dae137fb9ca2aa071237ffcc WatchSource:0}: Error finding container ef7abdcada1e444248598cda5044a9b15734b747dae137fb9ca2aa071237ffcc: Status 404 returned error can't find the container with id ef7abdcada1e444248598cda5044a9b15734b747dae137fb9ca2aa071237ffcc
Apr 16 16:56:46.395269 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:46.395236    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx" event={"ID":"33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc","Type":"ContainerStarted","Data":"d5ccf67057df3dc947332c0bbfe4d49ba21ce0acfbb84eb7a73f81321e8ee111"}
Apr 16 16:56:46.395269 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:46.395274    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx" event={"ID":"33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc","Type":"ContainerStarted","Data":"ef7abdcada1e444248598cda5044a9b15734b747dae137fb9ca2aa071237ffcc"}
Apr 16 16:56:46.410397 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:56:46.410353    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-7fd5766db9-8zjpx" podStartSLOduration=2.138578797 podStartE2EDuration="2.410338714s" podCreationTimestamp="2026-04-16 16:56:44 +0000 UTC" firstStartedPulling="2026-04-16 16:56:45.438004015 +0000 UTC m=+544.338755377" lastFinishedPulling="2026-04-16 16:56:45.709763929 +0000 UTC m=+544.610515294" observedRunningTime="2026-04-16 16:56:46.409931066 +0000 UTC m=+545.310682452" watchObservedRunningTime="2026-04-16 16:56:46.410338714 +0000 UTC m=+545.311090099"
Apr 16 16:59:55.209605 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:55.209574    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-wc8z9"]
Apr 16 16:59:55.211612 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:55.211587    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-wc8z9"
Apr 16 16:59:55.213975 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:55.213955    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-5ftrw\""
Apr 16 16:59:55.220237 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:55.220216    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-wc8z9"]
Apr 16 16:59:55.221395 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:55.221375    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-wc8z9"
Apr 16 16:59:55.341964 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:55.341942    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-wc8z9"]
Apr 16 16:59:55.344358 ip-10-0-139-227 kubenswrapper[2569]: W0416 16:59:55.344332    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3582f567_99bb_4b29_910d_79d4b21d3942.slice/crio-48671ef674e2a8f2963123e1ae64ef51f57e1a82dfe1c0bd5fbba36b2c0d89fc WatchSource:0}: Error finding container 48671ef674e2a8f2963123e1ae64ef51f57e1a82dfe1c0bd5fbba36b2c0d89fc: Status 404 returned error can't find the container with id 48671ef674e2a8f2963123e1ae64ef51f57e1a82dfe1c0bd5fbba36b2c0d89fc
Apr 16 16:59:55.346097 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:55.346079    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 16 16:59:55.880093 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:55.880057    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-wc8z9" event={"ID":"3582f567-99bb-4b29-910d-79d4b21d3942","Type":"ContainerStarted","Data":"48671ef674e2a8f2963123e1ae64ef51f57e1a82dfe1c0bd5fbba36b2c0d89fc"}
Apr 16 16:59:56.884128 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:56.884092    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-wc8z9" event={"ID":"3582f567-99bb-4b29-910d-79d4b21d3942","Type":"ContainerStarted","Data":"4a5cfbc486831f5715b652d50b1de7997c375724942fb79fda00190e9c879b16"}
Apr 16 16:59:56.884575 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:56.884347    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-wc8z9"
Apr 16 16:59:56.885698 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:56.885683    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-wc8z9"
Apr 16 16:59:56.898215 ip-10-0-139-227 kubenswrapper[2569]: I0416 16:59:56.898121    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-wc8z9" podStartSLOduration=1.012764264 podStartE2EDuration="1.8981102s" podCreationTimestamp="2026-04-16 16:59:55 +0000 UTC" firstStartedPulling="2026-04-16 16:59:55.346205687 +0000 UTC m=+734.246957049" lastFinishedPulling="2026-04-16 16:59:56.231551621 +0000 UTC m=+735.132302985" observedRunningTime="2026-04-16 16:59:56.897896108 +0000 UTC m=+735.798647492" watchObservedRunningTime="2026-04-16 16:59:56.8981102 +0000 UTC m=+735.798861585"
Apr 16 17:25:11.812207 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:11.812173    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b"]
Apr 16 17:25:11.815439 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:11.815418    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b"
Apr 16 17:25:11.823291 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:11.823267    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b"]
Apr 16 17:25:11.970478 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:11.970412    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61d020cf-a9ae-4870-ae47-1424b6a6ba48-kserve-provision-location\") pod \"isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b\" (UID: \"61d020cf-a9ae-4870-ae47-1424b6a6ba48\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b"
Apr 16 17:25:12.071655 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:12.071620    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61d020cf-a9ae-4870-ae47-1424b6a6ba48-kserve-provision-location\") pod \"isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b\" (UID: \"61d020cf-a9ae-4870-ae47-1424b6a6ba48\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b"
Apr 16 17:25:12.072001 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:12.071985    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61d020cf-a9ae-4870-ae47-1424b6a6ba48-kserve-provision-location\") pod \"isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b\" (UID: \"61d020cf-a9ae-4870-ae47-1424b6a6ba48\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b"
Apr 16 17:25:12.126356 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:12.126337    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b"
Apr 16 17:25:12.241817 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:12.241725    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b"]
Apr 16 17:25:12.245846 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:25:12.245816    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d020cf_a9ae_4870_ae47_1424b6a6ba48.slice/crio-02b3cc706897bbe480e82f4edc035da9dd736b940c794493b5a9db36a4f81bba WatchSource:0}: Error finding container 02b3cc706897bbe480e82f4edc035da9dd736b940c794493b5a9db36a4f81bba: Status 404 returned error can't find the container with id 02b3cc706897bbe480e82f4edc035da9dd736b940c794493b5a9db36a4f81bba
Apr 16 17:25:12.247934 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:12.247916    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 16 17:25:12.819327 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:12.819297    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b" event={"ID":"61d020cf-a9ae-4870-ae47-1424b6a6ba48","Type":"ContainerStarted","Data":"02b3cc706897bbe480e82f4edc035da9dd736b940c794493b5a9db36a4f81bba"}
Apr 16 17:25:16.833093 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:16.833051    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b" event={"ID":"61d020cf-a9ae-4870-ae47-1424b6a6ba48","Type":"ContainerStarted","Data":"5f2deccd069081a7a222a2bb3a17b9c06022ec1de6d8b643c42c946db6e064df"}
Apr 16 17:25:20.843922 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:20.843886    2569 generic.go:358] "Generic (PLEG): container finished" podID="61d020cf-a9ae-4870-ae47-1424b6a6ba48" containerID="5f2deccd069081a7a222a2bb3a17b9c06022ec1de6d8b643c42c946db6e064df" exitCode=0
Apr 16 17:25:20.844299 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:20.843961    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b" event={"ID":"61d020cf-a9ae-4870-ae47-1424b6a6ba48","Type":"ContainerDied","Data":"5f2deccd069081a7a222a2bb3a17b9c06022ec1de6d8b643c42c946db6e064df"}
Apr 16 17:25:42.913984 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:42.913949    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b" event={"ID":"61d020cf-a9ae-4870-ae47-1424b6a6ba48","Type":"ContainerStarted","Data":"6e6da1719c8ac367aa339d3f1ab0d09b02c24762485ffe1055c5d62d694d1475"}
Apr 16 17:25:42.914406 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:42.914200    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b"
Apr 16 17:25:42.929847 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:25:42.929783    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b" podStartSLOduration=2.312540015 podStartE2EDuration="31.929771257s" podCreationTimestamp="2026-04-16 17:25:11 +0000 UTC" firstStartedPulling="2026-04-16 17:25:12.248049959 +0000 UTC m=+2251.148801321" lastFinishedPulling="2026-04-16 17:25:41.865281202 +0000 UTC m=+2280.766032563" observedRunningTime="2026-04-16 17:25:42.929099518 +0000 UTC m=+2281.829850938" watchObservedRunningTime="2026-04-16 17:25:42.929771257 +0000 UTC m=+2281.830522641"
Apr 16 17:26:13.918239 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:26:13.918192    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b" podUID="61d020cf-a9ae-4870-ae47-1424b6a6ba48" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.19:8080/v2/models/isvc-predictive-xgboost-v2/ready\": dial tcp 10.133.0.19:8080: connect: connection refused"
Apr 16 17:26:23.918300 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:26:23.918253    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b" podUID="61d020cf-a9ae-4870-ae47-1424b6a6ba48" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.19:8080/v2/models/isvc-predictive-xgboost-v2/ready\": dial tcp 10.133.0.19:8080: connect: connection refused"
Apr 16 17:26:33.917435 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:26:33.917388    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b" podUID="61d020cf-a9ae-4870-ae47-1424b6a6ba48" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.19:8080/v2/models/isvc-predictive-xgboost-v2/ready\": dial tcp 10.133.0.19:8080: connect: connection refused"
Apr 16 17:26:43.917733 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:26:43.917689    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b" podUID="61d020cf-a9ae-4870-ae47-1424b6a6ba48" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.19:8080/v2/models/isvc-predictive-xgboost-v2/ready\": dial tcp 10.133.0.19:8080: connect: connection refused"
Apr 16 17:26:50.709397 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:26:50.709360    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b" podUID="61d020cf-a9ae-4870-ae47-1424b6a6ba48" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.19:8080/v2/models/isvc-predictive-xgboost-v2/ready\": dial tcp 10.133.0.19:8080: connect: connection refused"
Apr 16 17:27:00.713453 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:00.713412    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b"
Apr 16 17:27:02.030704 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:02.030674    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp"]
Apr 16 17:27:02.034007 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:02.033986    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp"
Apr 16 17:27:02.041091 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:02.041068    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp"]
Apr 16 17:27:02.066314 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:02.066291    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5ad07efd-b324-4f93-a649-5cd15175bc0a-kserve-provision-location\") pod \"isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp\" (UID: \"5ad07efd-b324-4f93-a649-5cd15175bc0a\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp"
Apr 16 17:27:02.166792 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:02.166761    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5ad07efd-b324-4f93-a649-5cd15175bc0a-kserve-provision-location\") pod \"isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp\" (UID: \"5ad07efd-b324-4f93-a649-5cd15175bc0a\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp"
Apr 16 17:27:02.167221 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:02.167198    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5ad07efd-b324-4f93-a649-5cd15175bc0a-kserve-provision-location\") pod \"isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp\" (UID: \"5ad07efd-b324-4f93-a649-5cd15175bc0a\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp"
Apr 16 17:27:02.350148 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:02.350115    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp"
Apr 16 17:27:02.463338 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:02.463227    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp"]
Apr 16 17:27:02.466231 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:27:02.466199    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad07efd_b324_4f93_a649_5cd15175bc0a.slice/crio-8fb9c0efe52293fe6c5cfc511616bd6c375e381a223ea2090239530a5bcb8147 WatchSource:0}: Error finding container 8fb9c0efe52293fe6c5cfc511616bd6c375e381a223ea2090239530a5bcb8147: Status 404 returned error can't find the container with id 8fb9c0efe52293fe6c5cfc511616bd6c375e381a223ea2090239530a5bcb8147
Apr 16 17:27:03.125005 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:03.124967    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp" event={"ID":"5ad07efd-b324-4f93-a649-5cd15175bc0a","Type":"ContainerStarted","Data":"badfec8a20514685c906eda9b9f45b9671bf8f2f29a49906782049f0860e3cf4"}
Apr 16 17:27:03.125005 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:03.125007    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp" event={"ID":"5ad07efd-b324-4f93-a649-5cd15175bc0a","Type":"ContainerStarted","Data":"8fb9c0efe52293fe6c5cfc511616bd6c375e381a223ea2090239530a5bcb8147"}
Apr 16 17:27:07.137673 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:07.137640    2569 generic.go:358] "Generic (PLEG): container finished" podID="5ad07efd-b324-4f93-a649-5cd15175bc0a" containerID="badfec8a20514685c906eda9b9f45b9671bf8f2f29a49906782049f0860e3cf4" exitCode=0
Apr 16 17:27:07.138081 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:07.137711    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp" event={"ID":"5ad07efd-b324-4f93-a649-5cd15175bc0a","Type":"ContainerDied","Data":"badfec8a20514685c906eda9b9f45b9671bf8f2f29a49906782049f0860e3cf4"}
Apr 16 17:27:08.141697 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:08.141660    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp" event={"ID":"5ad07efd-b324-4f93-a649-5cd15175bc0a","Type":"ContainerStarted","Data":"6a857dfdc0c6efe7623106e0914b748efe3caf94b46b5347cc1b5224f88397c3"}
Apr 16 17:27:08.142058 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:08.141881    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp"
Apr 16 17:27:08.158848 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:08.158788    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp" podStartSLOduration=6.158777049 podStartE2EDuration="6.158777049s" podCreationTimestamp="2026-04-16 17:27:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 17:27:08.157403276 +0000 UTC m=+2367.058154659" watchObservedRunningTime="2026-04-16 17:27:08.158777049 +0000 UTC m=+2367.059528430"
Apr 16 17:27:39.146737 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:39.146698    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp" podUID="5ad07efd-b324-4f93-a649-5cd15175bc0a" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.20:8080/v2/models/isvc-predictive-lightgbm-v2/ready\": dial tcp 10.133.0.20:8080: connect: connection refused"
Apr 16 17:27:49.144771 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:49.144724    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp" podUID="5ad07efd-b324-4f93-a649-5cd15175bc0a" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.20:8080/v2/models/isvc-predictive-lightgbm-v2/ready\": dial tcp 10.133.0.20:8080: connect: connection refused"
Apr 16 17:27:59.144972 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:27:59.144887    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp" podUID="5ad07efd-b324-4f93-a649-5cd15175bc0a" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.20:8080/v2/models/isvc-predictive-lightgbm-v2/ready\": dial tcp 10.133.0.20:8080: connect: connection refused"
Apr 16 17:28:09.145067 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:28:09.145024    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp" podUID="5ad07efd-b324-4f93-a649-5cd15175bc0a" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.20:8080/v2/models/isvc-predictive-lightgbm-v2/ready\": dial tcp 10.133.0.20:8080: connect: connection refused"
Apr 16 17:28:19.149231 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:28:19.149186    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp"
Apr 16 17:32:05.969915 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:05.969882    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj"]
Apr 16 17:32:05.972983 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:05.972965    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj"
Apr 16 17:32:05.981140 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:05.981119    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj"]
Apr 16 17:32:06.059946 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:06.059917    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2be47088-cae2-4fca-8ee7-a6830bc260cb-kserve-provision-location\") pod \"isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj\" (UID: \"2be47088-cae2-4fca-8ee7-a6830bc260cb\") " pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj"
Apr 16 17:32:06.160731 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:06.160705    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2be47088-cae2-4fca-8ee7-a6830bc260cb-kserve-provision-location\") pod \"isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj\" (UID: \"2be47088-cae2-4fca-8ee7-a6830bc260cb\") " pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj"
Apr 16 17:32:06.161023 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:06.161007    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2be47088-cae2-4fca-8ee7-a6830bc260cb-kserve-provision-location\") pod \"isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj\" (UID: \"2be47088-cae2-4fca-8ee7-a6830bc260cb\") " pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj"
Apr 16 17:32:06.283125 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:06.283070    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj"
Apr 16 17:32:06.394885 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:06.394864    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj"]
Apr 16 17:32:06.398260 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:32:06.398232    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be47088_cae2_4fca_8ee7_a6830bc260cb.slice/crio-a9abb7f40a45705b462ad4d48bd4c2aa576fb37886389afd0b4312404701cfc6 WatchSource:0}: Error finding container a9abb7f40a45705b462ad4d48bd4c2aa576fb37886389afd0b4312404701cfc6: Status 404 returned error can't find the container with id a9abb7f40a45705b462ad4d48bd4c2aa576fb37886389afd0b4312404701cfc6
Apr 16 17:32:06.400489 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:06.400472    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 16 17:32:06.951762 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:06.951724    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" event={"ID":"2be47088-cae2-4fca-8ee7-a6830bc260cb","Type":"ContainerStarted","Data":"33be4924f9a946ba952b75ddc812e880ab9488eb5a712b8d9e03e8ce5c982dc6"}
Apr 16 17:32:06.951762 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:06.951761    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" event={"ID":"2be47088-cae2-4fca-8ee7-a6830bc260cb","Type":"ContainerStarted","Data":"a9abb7f40a45705b462ad4d48bd4c2aa576fb37886389afd0b4312404701cfc6"}
Apr 16 17:32:10.964125 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:10.964092    2569 generic.go:358] "Generic (PLEG): container finished" podID="2be47088-cae2-4fca-8ee7-a6830bc260cb" containerID="33be4924f9a946ba952b75ddc812e880ab9488eb5a712b8d9e03e8ce5c982dc6" exitCode=0
Apr 16 17:32:10.964537 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:10.964144    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" event={"ID":"2be47088-cae2-4fca-8ee7-a6830bc260cb","Type":"ContainerDied","Data":"33be4924f9a946ba952b75ddc812e880ab9488eb5a712b8d9e03e8ce5c982dc6"}
Apr 16 17:32:19.994107 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:19.994073    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" event={"ID":"2be47088-cae2-4fca-8ee7-a6830bc260cb","Type":"ContainerStarted","Data":"b9e3aa871efa0a90a199ae9765115cc5ae25b8c5eb397e9acf5cbd209974523c"}
Apr 16 17:32:19.994460 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:19.994353    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj"
Apr 16 17:32:19.995625 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:19.995600    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" podUID="2be47088-cae2-4fca-8ee7-a6830bc260cb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Apr 16 17:32:20.010831 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:20.010774    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" podStartSLOduration=6.695716302 podStartE2EDuration="15.010764129s" podCreationTimestamp="2026-04-16 17:32:05 +0000 UTC" firstStartedPulling="2026-04-16 17:32:10.965093374 +0000 UTC m=+2669.865844740" lastFinishedPulling="2026-04-16 17:32:19.280141204 +0000 UTC m=+2678.180892567" observedRunningTime="2026-04-16 17:32:20.009911886 +0000 UTC m=+2678.910663270" watchObservedRunningTime="2026-04-16 17:32:20.010764129 +0000 UTC m=+2678.911515512"
Apr 16 17:32:20.997576 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:20.997537    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" podUID="2be47088-cae2-4fca-8ee7-a6830bc260cb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Apr 16 17:32:30.998171 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:30.998121    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" podUID="2be47088-cae2-4fca-8ee7-a6830bc260cb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Apr 16 17:32:40.998597 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:40.998549    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" podUID="2be47088-cae2-4fca-8ee7-a6830bc260cb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Apr 16 17:32:50.998456 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:32:50.998413    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" podUID="2be47088-cae2-4fca-8ee7-a6830bc260cb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Apr 16 17:33:00.997706 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:00.997656    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" podUID="2be47088-cae2-4fca-8ee7-a6830bc260cb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Apr 16 17:33:10.997934 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:10.997895    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" podUID="2be47088-cae2-4fca-8ee7-a6830bc260cb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Apr 16 17:33:20.998090 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:20.998038    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj" podUID="2be47088-cae2-4fca-8ee7-a6830bc260cb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Apr 16 17:33:25.712529 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:25.712499    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj"
Apr 16 17:33:26.180768 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:26.180736    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j"]
Apr 16 17:33:26.183986 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:26.183967    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j"
Apr 16 17:33:26.190163 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:26.190142    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j"]
Apr 16 17:33:26.220994 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:26.220970    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ddd6ca36-f864-4590-acad-c7e3b0ca88e9-kserve-provision-location\") pod \"isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j\" (UID: \"ddd6ca36-f864-4590-acad-c7e3b0ca88e9\") " pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j"
Apr 16 17:33:26.321401 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:26.321378    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ddd6ca36-f864-4590-acad-c7e3b0ca88e9-kserve-provision-location\") pod \"isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j\" (UID: \"ddd6ca36-f864-4590-acad-c7e3b0ca88e9\") " pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j"
Apr 16 17:33:26.321673 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:26.321657    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ddd6ca36-f864-4590-acad-c7e3b0ca88e9-kserve-provision-location\") pod \"isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j\" (UID: \"ddd6ca36-f864-4590-acad-c7e3b0ca88e9\") " pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j"
Apr 16 17:33:26.495147 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:26.495087    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j"
Apr 16 17:33:26.611889 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:26.611853    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j"]
Apr 16 17:33:26.614178 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:33:26.614149    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd6ca36_f864_4590_acad_c7e3b0ca88e9.slice/crio-272dff4ac286bdb448f2fb1759b0a42b319dab20cec0bd2434f5c890e8f75da7 WatchSource:0}: Error finding container 272dff4ac286bdb448f2fb1759b0a42b319dab20cec0bd2434f5c890e8f75da7: Status 404 returned error can't find the container with id 272dff4ac286bdb448f2fb1759b0a42b319dab20cec0bd2434f5c890e8f75da7
Apr 16 17:33:27.186334 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:27.186296    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" event={"ID":"ddd6ca36-f864-4590-acad-c7e3b0ca88e9","Type":"ContainerStarted","Data":"271023b2e4af17f3d86f99a28157467b4ba251cf1492b29e3eaff6e41f20ddc9"}
Apr 16 17:33:27.186837 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:27.186345    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" event={"ID":"ddd6ca36-f864-4590-acad-c7e3b0ca88e9","Type":"ContainerStarted","Data":"272dff4ac286bdb448f2fb1759b0a42b319dab20cec0bd2434f5c890e8f75da7"}
Apr 16 17:33:31.198356 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:31.198325    2569 generic.go:358] "Generic (PLEG): container finished" podID="ddd6ca36-f864-4590-acad-c7e3b0ca88e9" containerID="271023b2e4af17f3d86f99a28157467b4ba251cf1492b29e3eaff6e41f20ddc9" exitCode=0
Apr 16 17:33:31.198356 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:31.198359    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" event={"ID":"ddd6ca36-f864-4590-acad-c7e3b0ca88e9","Type":"ContainerDied","Data":"271023b2e4af17f3d86f99a28157467b4ba251cf1492b29e3eaff6e41f20ddc9"}
Apr 16 17:33:32.201831 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:32.201783    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" event={"ID":"ddd6ca36-f864-4590-acad-c7e3b0ca88e9","Type":"ContainerStarted","Data":"4c2411535be4e38b08108c7f6b9185c31414c3409d31959dd40f23be43f13110"}
Apr 16 17:33:32.202204 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:32.202184    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j"
Apr 16 17:33:32.203232 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:32.203204    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" podUID="ddd6ca36-f864-4590-acad-c7e3b0ca88e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Apr 16 17:33:32.217187 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:32.217141    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" podStartSLOduration=6.217128654 podStartE2EDuration="6.217128654s" podCreationTimestamp="2026-04-16 17:33:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 17:33:32.216278411 +0000 UTC m=+2751.117029795" watchObservedRunningTime="2026-04-16 17:33:32.217128654 +0000 UTC m=+2751.117880037"
Apr 16 17:33:33.204746 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:33.204711    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" podUID="ddd6ca36-f864-4590-acad-c7e3b0ca88e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Apr 16 17:33:43.204989 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:43.204947    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" podUID="ddd6ca36-f864-4590-acad-c7e3b0ca88e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Apr 16 17:33:53.204920 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:33:53.204876    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" podUID="ddd6ca36-f864-4590-acad-c7e3b0ca88e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Apr 16 17:34:03.205663 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:03.205579    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" podUID="ddd6ca36-f864-4590-acad-c7e3b0ca88e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Apr 16 17:34:13.204787 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:13.204746    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" podUID="ddd6ca36-f864-4590-acad-c7e3b0ca88e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Apr 16 17:34:23.205527 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:23.205485    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j" podUID="ddd6ca36-f864-4590-acad-c7e3b0ca88e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Apr 16 17:34:33.205994 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:33.205963    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j"
Apr 16 17:34:36.402849 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:36.402817    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr"]
Apr 16 17:34:36.406099 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:36.406083    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr"
Apr 16 17:34:36.413105 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:36.412734    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr"]
Apr 16 17:34:36.506395 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:36.506361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87e4cf4b-343b-4020-8668-4109915a39d4-kserve-provision-location\") pod \"isvc-tensorflow-predictor-88f6f6cb7-9v5tr\" (UID: \"87e4cf4b-343b-4020-8668-4109915a39d4\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr"
Apr 16 17:34:36.606987 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:36.606959    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87e4cf4b-343b-4020-8668-4109915a39d4-kserve-provision-location\") pod \"isvc-tensorflow-predictor-88f6f6cb7-9v5tr\" (UID: \"87e4cf4b-343b-4020-8668-4109915a39d4\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr"
Apr 16 17:34:36.607413 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:36.607392    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87e4cf4b-343b-4020-8668-4109915a39d4-kserve-provision-location\") pod \"isvc-tensorflow-predictor-88f6f6cb7-9v5tr\" (UID: \"87e4cf4b-343b-4020-8668-4109915a39d4\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr"
Apr 16 17:34:36.717127 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:36.717050    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr"
Apr 16 17:34:36.832461 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:36.832306    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr"]
Apr 16 17:34:36.834835 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:34:36.834751    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e4cf4b_343b_4020_8668_4109915a39d4.slice/crio-86e2d648271f419cbf8bf66cc97ed0c268d48007eae402e655a84dc18a96c883 WatchSource:0}: Error finding container 86e2d648271f419cbf8bf66cc97ed0c268d48007eae402e655a84dc18a96c883: Status 404 returned error can't find the container with id 86e2d648271f419cbf8bf66cc97ed0c268d48007eae402e655a84dc18a96c883
Apr 16 17:34:37.389969 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:37.389929    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr" event={"ID":"87e4cf4b-343b-4020-8668-4109915a39d4","Type":"ContainerStarted","Data":"6bd5050a2257b3a70b0045d95111104f45ffd71965496022f795381ee21c22d6"}
Apr 16 17:34:37.389969 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:37.389967    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr" event={"ID":"87e4cf4b-343b-4020-8668-4109915a39d4","Type":"ContainerStarted","Data":"86e2d648271f419cbf8bf66cc97ed0c268d48007eae402e655a84dc18a96c883"}
Apr 16 17:34:41.402671 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:41.402638    2569 generic.go:358] "Generic (PLEG): container finished" podID="87e4cf4b-343b-4020-8668-4109915a39d4" containerID="6bd5050a2257b3a70b0045d95111104f45ffd71965496022f795381ee21c22d6" exitCode=0
Apr 16 17:34:41.403053 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:41.402709    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr" event={"ID":"87e4cf4b-343b-4020-8668-4109915a39d4","Type":"ContainerDied","Data":"6bd5050a2257b3a70b0045d95111104f45ffd71965496022f795381ee21c22d6"}
Apr 16 17:34:45.416505 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:45.416471    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr" event={"ID":"87e4cf4b-343b-4020-8668-4109915a39d4","Type":"ContainerStarted","Data":"838bf135a42afe2a3f6a8f1eb103b9b2a34cd411039a1e02dc19e506317cfc54"}
Apr 16 17:34:45.416906 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:45.416765    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr"
Apr 16 17:34:45.418186 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:45.418160    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr" podUID="87e4cf4b-343b-4020-8668-4109915a39d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Apr 16 17:34:45.439186 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:45.439140    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr" podStartSLOduration=5.818988204 podStartE2EDuration="9.439128537s" podCreationTimestamp="2026-04-16 17:34:36 +0000 UTC" firstStartedPulling="2026-04-16 17:34:41.40387776 +0000 UTC m=+2820.304629122" lastFinishedPulling="2026-04-16 17:34:45.024018089 +0000 UTC m=+2823.924769455" observedRunningTime="2026-04-16 17:34:45.438504855 +0000 UTC m=+2824.339256253" watchObservedRunningTime="2026-04-16 17:34:45.439128537 +0000 UTC m=+2824.339879920"
Apr 16 17:34:46.419234 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:46.419191    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr" podUID="87e4cf4b-343b-4020-8668-4109915a39d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Apr 16 17:34:56.420194 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:34:56.420167    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-88f6f6cb7-9v5tr"
Apr 16 17:35:06.589818 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:06.589772    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58"]
Apr 16 17:35:06.598972 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:06.598949    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58"
Apr 16 17:35:06.602256 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:06.602229    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58"]
Apr 16 17:35:06.731461 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:06.731432    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ae4030d-4e94-4b2c-9d67-b7f9e25e2451-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-854bdff69c-25n58\" (UID: \"9ae4030d-4e94-4b2c-9d67-b7f9e25e2451\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58"
Apr 16 17:35:06.832332 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:06.832293    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ae4030d-4e94-4b2c-9d67-b7f9e25e2451-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-854bdff69c-25n58\" (UID: \"9ae4030d-4e94-4b2c-9d67-b7f9e25e2451\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58"
Apr 16 17:35:06.832651 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:06.832634    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ae4030d-4e94-4b2c-9d67-b7f9e25e2451-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-854bdff69c-25n58\" (UID: \"9ae4030d-4e94-4b2c-9d67-b7f9e25e2451\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58"
Apr 16 17:35:06.909592 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:06.909539    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58"
Apr 16 17:35:07.029365 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:07.029333    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58"]
Apr 16 17:35:07.032653 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:35:07.032620    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae4030d_4e94_4b2c_9d67_b7f9e25e2451.slice/crio-5b9e4494694d90116d7ab3195214c56c4da244f0878f33b410d8a61b69368aba WatchSource:0}: Error finding container 5b9e4494694d90116d7ab3195214c56c4da244f0878f33b410d8a61b69368aba: Status 404 returned error can't find the container with id 5b9e4494694d90116d7ab3195214c56c4da244f0878f33b410d8a61b69368aba
Apr 16 17:35:07.479324 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:07.479278    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58" event={"ID":"9ae4030d-4e94-4b2c-9d67-b7f9e25e2451","Type":"ContainerStarted","Data":"0bea7c802c3618331089ef8e89893cef32c9e09b2256822906b35007d1172395"}
Apr 16 17:35:07.479485 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:07.479330    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58" event={"ID":"9ae4030d-4e94-4b2c-9d67-b7f9e25e2451","Type":"ContainerStarted","Data":"5b9e4494694d90116d7ab3195214c56c4da244f0878f33b410d8a61b69368aba"}
Apr 16 17:35:12.494479 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:12.494442    2569 generic.go:358] "Generic (PLEG): container finished" podID="9ae4030d-4e94-4b2c-9d67-b7f9e25e2451" containerID="0bea7c802c3618331089ef8e89893cef32c9e09b2256822906b35007d1172395" exitCode=0
Apr 16 17:35:12.494920 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:12.494484    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58" event={"ID":"9ae4030d-4e94-4b2c-9d67-b7f9e25e2451","Type":"ContainerDied","Data":"0bea7c802c3618331089ef8e89893cef32c9e09b2256822906b35007d1172395"}
Apr 16 17:35:13.498633 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:13.498596    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58" event={"ID":"9ae4030d-4e94-4b2c-9d67-b7f9e25e2451","Type":"ContainerStarted","Data":"87ac84b69d00b67da4e26f359f9d87d2c15e46c138a73fa024ad7499ea56aac3"}
Apr 16 17:35:13.499126 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:13.498905    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58"
Apr 16 17:35:13.500002 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:13.499978    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58" podUID="9ae4030d-4e94-4b2c-9d67-b7f9e25e2451" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Apr 16 17:35:13.513918 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:13.513871    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58" podStartSLOduration=7.51385902 podStartE2EDuration="7.51385902s" podCreationTimestamp="2026-04-16 17:35:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 17:35:13.513129265 +0000 UTC m=+2852.413880662" watchObservedRunningTime="2026-04-16 17:35:13.51385902 +0000 UTC m=+2852.414610406"
Apr 16 17:35:14.502040 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:14.502003    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58" podUID="9ae4030d-4e94-4b2c-9d67-b7f9e25e2451" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Apr 16 17:35:24.502816 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:24.502761    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-854bdff69c-25n58"
Apr 16 17:35:26.709479 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:26.709399    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6"]
Apr 16 17:35:26.714050 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:26.714029    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6"
Apr 16 17:35:26.721067 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:26.721045    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6"]
Apr 16 17:35:26.765926 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:26.765902    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61396d55-de1b-438d-9988-a1a58e30f2b4-kserve-provision-location\") pod \"isvc-triton-predictor-85f9f46646-qbbq6\" (UID: \"61396d55-de1b-438d-9988-a1a58e30f2b4\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6"
Apr 16 17:35:26.867164 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:26.867137    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61396d55-de1b-438d-9988-a1a58e30f2b4-kserve-provision-location\") pod \"isvc-triton-predictor-85f9f46646-qbbq6\" (UID: \"61396d55-de1b-438d-9988-a1a58e30f2b4\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6"
Apr 16 17:35:26.867520 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:26.867495    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61396d55-de1b-438d-9988-a1a58e30f2b4-kserve-provision-location\") pod \"isvc-triton-predictor-85f9f46646-qbbq6\" (UID: \"61396d55-de1b-438d-9988-a1a58e30f2b4\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6"
Apr 16 17:35:27.025057 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:27.025003    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6"
Apr 16 17:35:27.141585 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:27.141536    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6"]
Apr 16 17:35:27.144499 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:35:27.144471    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61396d55_de1b_438d_9988_a1a58e30f2b4.slice/crio-f83220dba71be3ad1cfd0cb6bfc4042cf48b0a395226092edc50777909992a12 WatchSource:0}: Error finding container f83220dba71be3ad1cfd0cb6bfc4042cf48b0a395226092edc50777909992a12: Status 404 returned error can't find the container with id f83220dba71be3ad1cfd0cb6bfc4042cf48b0a395226092edc50777909992a12
Apr 16 17:35:27.537934 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:27.537895    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6" event={"ID":"61396d55-de1b-438d-9988-a1a58e30f2b4","Type":"ContainerStarted","Data":"658919d0f40f6208e6e697ff8f01d609f0255d790c8d42aa462c697053451d21"}
Apr 16 17:35:27.538160 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:27.537941    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6" event={"ID":"61396d55-de1b-438d-9988-a1a58e30f2b4","Type":"ContainerStarted","Data":"f83220dba71be3ad1cfd0cb6bfc4042cf48b0a395226092edc50777909992a12"}
Apr 16 17:35:31.552295 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:31.552267    2569 generic.go:358] "Generic (PLEG): container finished" podID="61396d55-de1b-438d-9988-a1a58e30f2b4" containerID="658919d0f40f6208e6e697ff8f01d609f0255d790c8d42aa462c697053451d21" exitCode=0
Apr 16 17:35:31.552667 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:35:31.552348    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6" event={"ID":"61396d55-de1b-438d-9988-a1a58e30f2b4","Type":"ContainerDied","Data":"658919d0f40f6208e6e697ff8f01d609f0255d790c8d42aa462c697053451d21"}
Apr 16 17:37:25.983638 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:25.983601    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6" event={"ID":"61396d55-de1b-438d-9988-a1a58e30f2b4","Type":"ContainerStarted","Data":"02e74b441882713561876bd95dd08b8c6c8f3360fe65653addf1ea32024733eb"}
Apr 16 17:37:25.984134 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:25.983892    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6"
Apr 16 17:37:25.985198 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:25.985170    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6" podUID="61396d55-de1b-438d-9988-a1a58e30f2b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Apr 16 17:37:26.004513 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:26.004459    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6" podStartSLOduration=6.348438337 podStartE2EDuration="2m0.004443524s" podCreationTimestamp="2026-04-16 17:35:26 +0000 UTC" firstStartedPulling="2026-04-16 17:35:31.553383206 +0000 UTC m=+2870.454134571" lastFinishedPulling="2026-04-16 17:37:25.209388393 +0000 UTC m=+2984.110139758" observedRunningTime="2026-04-16 17:37:26.003185103 +0000 UTC m=+2984.903936485" watchObservedRunningTime="2026-04-16 17:37:26.004443524 +0000 UTC m=+2984.905194908"
Apr 16 17:37:26.987307 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:26.987269    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6" podUID="61396d55-de1b-438d-9988-a1a58e30f2b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Apr 16 17:37:36.988684 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:36.988648    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-85f9f46646-qbbq6"
Apr 16 17:37:47.159675 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:47.159636    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb"]
Apr 16 17:37:47.179765 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:47.179727    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb"]
Apr 16 17:37:47.179943 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:47.179819    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb"
Apr 16 17:37:47.304340 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:47.304303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/53b723af-5354-4c47-9d53-ec7b8ff55d1a-kserve-provision-location\") pod \"isvc-xgboost-predictor-6dbc9d6d47-wzbfb\" (UID: \"53b723af-5354-4c47-9d53-ec7b8ff55d1a\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb"
Apr 16 17:37:47.405247 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:47.405207    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/53b723af-5354-4c47-9d53-ec7b8ff55d1a-kserve-provision-location\") pod \"isvc-xgboost-predictor-6dbc9d6d47-wzbfb\" (UID: \"53b723af-5354-4c47-9d53-ec7b8ff55d1a\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb"
Apr 16 17:37:47.405606 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:47.405586    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/53b723af-5354-4c47-9d53-ec7b8ff55d1a-kserve-provision-location\") pod \"isvc-xgboost-predictor-6dbc9d6d47-wzbfb\" (UID: \"53b723af-5354-4c47-9d53-ec7b8ff55d1a\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb"
Apr 16 17:37:47.490722 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:47.490680    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb"
Apr 16 17:37:47.609254 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:47.609107    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb"]
Apr 16 17:37:47.612017 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:37:47.611986    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b723af_5354_4c47_9d53_ec7b8ff55d1a.slice/crio-da2752fb1c49dfbec9efae34172ce784d242838d47150c215abdcad74f40ce4e WatchSource:0}: Error finding container da2752fb1c49dfbec9efae34172ce784d242838d47150c215abdcad74f40ce4e: Status 404 returned error can't find the container with id da2752fb1c49dfbec9efae34172ce784d242838d47150c215abdcad74f40ce4e
Apr 16 17:37:47.613848 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:47.613821    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 16 17:37:48.055663 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:48.055628    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" event={"ID":"53b723af-5354-4c47-9d53-ec7b8ff55d1a","Type":"ContainerStarted","Data":"7feeab0451cfb6899744ed367a0c21e974be4e0a8fc6ace887790cb08fa73cd2"}
Apr 16 17:37:48.055852 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:48.055669    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" event={"ID":"53b723af-5354-4c47-9d53-ec7b8ff55d1a","Type":"ContainerStarted","Data":"da2752fb1c49dfbec9efae34172ce784d242838d47150c215abdcad74f40ce4e"}
Apr 16 17:37:52.069759 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:52.069723    2569 generic.go:358] "Generic (PLEG): container finished" podID="53b723af-5354-4c47-9d53-ec7b8ff55d1a" containerID="7feeab0451cfb6899744ed367a0c21e974be4e0a8fc6ace887790cb08fa73cd2" exitCode=0
Apr 16 17:37:52.070271 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:37:52.069824    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" event={"ID":"53b723af-5354-4c47-9d53-ec7b8ff55d1a","Type":"ContainerDied","Data":"7feeab0451cfb6899744ed367a0c21e974be4e0a8fc6ace887790cb08fa73cd2"}
Apr 16 17:38:12.136811 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:38:12.136768    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" event={"ID":"53b723af-5354-4c47-9d53-ec7b8ff55d1a","Type":"ContainerStarted","Data":"ce20398c50919c50866ad84d112c53452ab6ba9c9371c5cfc7a696b58059f81e"}
Apr 16 17:38:12.137222 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:38:12.137182    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb"
Apr 16 17:38:12.138242 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:38:12.138216    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" podUID="53b723af-5354-4c47-9d53-ec7b8ff55d1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Apr 16 17:38:12.153056 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:38:12.153008    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" podStartSLOduration=5.908899142 podStartE2EDuration="25.152994558s" podCreationTimestamp="2026-04-16 17:37:47 +0000 UTC" firstStartedPulling="2026-04-16 17:37:52.071128346 +0000 UTC m=+3010.971879709" lastFinishedPulling="2026-04-16 17:38:11.315223752 +0000 UTC m=+3030.215975125" observedRunningTime="2026-04-16 17:38:12.151791686 +0000 UTC m=+3031.052543061" watchObservedRunningTime="2026-04-16 17:38:12.152994558 +0000 UTC m=+3031.053745941"
Apr 16 17:38:13.140041 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:38:13.139998    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" podUID="53b723af-5354-4c47-9d53-ec7b8ff55d1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Apr 16 17:38:23.140814 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:38:23.140762    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" podUID="53b723af-5354-4c47-9d53-ec7b8ff55d1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Apr 16 17:38:33.140236 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:38:33.140191    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" podUID="53b723af-5354-4c47-9d53-ec7b8ff55d1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Apr 16 17:38:43.140483 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:38:43.140441    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" podUID="53b723af-5354-4c47-9d53-ec7b8ff55d1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Apr 16 17:38:53.139974 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:38:53.139932    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" podUID="53b723af-5354-4c47-9d53-ec7b8ff55d1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Apr 16 17:39:03.140229 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:39:03.140188    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb" podUID="53b723af-5354-4c47-9d53-ec7b8ff55d1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Apr 16 17:39:13.140583 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:39:13.140551    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-6dbc9d6d47-wzbfb"
Apr 16 17:40:37.730849 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:37.730822    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2"]
Apr 16 17:40:37.734181 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:37.734161    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2"
Apr 16 17:40:37.742172 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:37.742151    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2"]
Apr 16 17:40:37.796244 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:37.796218    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd7adc61-daa5-4c47-a831-4c3cfa4785e4-kserve-provision-location\") pod \"isvc-xgboost-runtime-predictor-687c7765c9-mw2j2\" (UID: \"dd7adc61-daa5-4c47-a831-4c3cfa4785e4\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2"
Apr 16 17:40:37.896633 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:37.896598    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd7adc61-daa5-4c47-a831-4c3cfa4785e4-kserve-provision-location\") pod \"isvc-xgboost-runtime-predictor-687c7765c9-mw2j2\" (UID: \"dd7adc61-daa5-4c47-a831-4c3cfa4785e4\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2"
Apr 16 17:40:37.896924 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:37.896909    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd7adc61-daa5-4c47-a831-4c3cfa4785e4-kserve-provision-location\") pod \"isvc-xgboost-runtime-predictor-687c7765c9-mw2j2\" (UID: \"dd7adc61-daa5-4c47-a831-4c3cfa4785e4\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2"
Apr 16 17:40:38.044281 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:38.044220    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2"
Apr 16 17:40:38.163193 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:38.163165    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2"]
Apr 16 17:40:38.165164 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:40:38.165141    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd7adc61_daa5_4c47_a831_4c3cfa4785e4.slice/crio-970e50888b2b501002797d7ccb097988bf422a8e26294a415c0f1d9b48d23df3 WatchSource:0}: Error finding container 970e50888b2b501002797d7ccb097988bf422a8e26294a415c0f1d9b48d23df3: Status 404 returned error can't find the container with id 970e50888b2b501002797d7ccb097988bf422a8e26294a415c0f1d9b48d23df3
Apr 16 17:40:38.591810 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:38.591762    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" event={"ID":"dd7adc61-daa5-4c47-a831-4c3cfa4785e4","Type":"ContainerStarted","Data":"a53a459e19fa190883ede29331813abf775ec20b33cad2e5eaab6f85a9ac93d2"}
Apr 16 17:40:38.591970 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:38.591815    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" event={"ID":"dd7adc61-daa5-4c47-a831-4c3cfa4785e4","Type":"ContainerStarted","Data":"970e50888b2b501002797d7ccb097988bf422a8e26294a415c0f1d9b48d23df3"}
Apr 16 17:40:42.606156 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:42.606122    2569 generic.go:358] "Generic (PLEG): container finished" podID="dd7adc61-daa5-4c47-a831-4c3cfa4785e4" containerID="a53a459e19fa190883ede29331813abf775ec20b33cad2e5eaab6f85a9ac93d2" exitCode=0
Apr 16 17:40:42.606519 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:42.606190    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" event={"ID":"dd7adc61-daa5-4c47-a831-4c3cfa4785e4","Type":"ContainerDied","Data":"a53a459e19fa190883ede29331813abf775ec20b33cad2e5eaab6f85a9ac93d2"}
Apr 16 17:40:43.610522 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:43.610484    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" event={"ID":"dd7adc61-daa5-4c47-a831-4c3cfa4785e4","Type":"ContainerStarted","Data":"7defd01561d3f09928076b78c52eadf27f27f39df92ed1aa4b4c2a4c43ca26a6"}
Apr 16 17:40:43.611015 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:43.610864    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2"
Apr 16 17:40:43.612074 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:43.612048    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" podUID="dd7adc61-daa5-4c47-a831-4c3cfa4785e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Apr 16 17:40:43.625560 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:43.625519    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" podStartSLOduration=6.625506689 podStartE2EDuration="6.625506689s" podCreationTimestamp="2026-04-16 17:40:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 17:40:43.624538556 +0000 UTC m=+3182.525289943" watchObservedRunningTime="2026-04-16 17:40:43.625506689 +0000 UTC m=+3182.526258072"
Apr 16 17:40:44.614428 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:44.614391    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" podUID="dd7adc61-daa5-4c47-a831-4c3cfa4785e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Apr 16 17:40:54.614744 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:40:54.614691    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" podUID="dd7adc61-daa5-4c47-a831-4c3cfa4785e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Apr 16 17:41:04.614662 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:41:04.614622    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" podUID="dd7adc61-daa5-4c47-a831-4c3cfa4785e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Apr 16 17:41:14.615074 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:41:14.615028    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" podUID="dd7adc61-daa5-4c47-a831-4c3cfa4785e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Apr 16 17:41:24.614696 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:41:24.614645    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" podUID="dd7adc61-daa5-4c47-a831-4c3cfa4785e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Apr 16 17:41:34.615216 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:41:34.615174    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2" podUID="dd7adc61-daa5-4c47-a831-4c3cfa4785e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Apr 16 17:41:44.615986 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:41:44.615952    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2"
Apr 16 17:42:38.083580 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:38.083552    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w"]
Apr 16 17:42:38.086965 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:38.086947    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w"
Apr 16 17:42:38.092298 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:38.092270    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w"]
Apr 16 17:42:38.166405 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:38.166383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65dd09e9-2e2e-4756-8e14-75abbe99f4b1-kserve-provision-location\") pod \"isvc-xgboost-v2-predictor-5db5686f9f-55j7w\" (UID: \"65dd09e9-2e2e-4756-8e14-75abbe99f4b1\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w"
Apr 16 17:42:38.267376 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:38.267340    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65dd09e9-2e2e-4756-8e14-75abbe99f4b1-kserve-provision-location\") pod \"isvc-xgboost-v2-predictor-5db5686f9f-55j7w\" (UID: \"65dd09e9-2e2e-4756-8e14-75abbe99f4b1\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w"
Apr 16 17:42:38.267731 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:38.267711    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65dd09e9-2e2e-4756-8e14-75abbe99f4b1-kserve-provision-location\") pod \"isvc-xgboost-v2-predictor-5db5686f9f-55j7w\" (UID: \"65dd09e9-2e2e-4756-8e14-75abbe99f4b1\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w"
Apr 16 17:42:38.397916 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:38.397846    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w"
Apr 16 17:42:38.721408 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:38.721325    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w"]
Apr 16 17:42:38.728409 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:42:38.728384    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65dd09e9_2e2e_4756_8e14_75abbe99f4b1.slice/crio-2d60183c44b25c3751167265cfd28ba324e85d6d1e508d5a1d147f7df8204e95 WatchSource:0}: Error finding container 2d60183c44b25c3751167265cfd28ba324e85d6d1e508d5a1d147f7df8204e95: Status 404 returned error can't find the container with id 2d60183c44b25c3751167265cfd28ba324e85d6d1e508d5a1d147f7df8204e95
Apr 16 17:42:38.982110 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:38.982036    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" event={"ID":"65dd09e9-2e2e-4756-8e14-75abbe99f4b1","Type":"ContainerStarted","Data":"f153c6bd663bdf679d461ae162a16236b59b7d43a42bfab4ca0ca80e254fb399"}
Apr 16 17:42:38.982110 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:38.982069    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" event={"ID":"65dd09e9-2e2e-4756-8e14-75abbe99f4b1","Type":"ContainerStarted","Data":"2d60183c44b25c3751167265cfd28ba324e85d6d1e508d5a1d147f7df8204e95"}
Apr 16 17:42:42.999322 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:42.999291    2569 generic.go:358] "Generic (PLEG): container finished" podID="65dd09e9-2e2e-4756-8e14-75abbe99f4b1" containerID="f153c6bd663bdf679d461ae162a16236b59b7d43a42bfab4ca0ca80e254fb399" exitCode=0
Apr 16 17:42:42.999770 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:42.999369    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" event={"ID":"65dd09e9-2e2e-4756-8e14-75abbe99f4b1","Type":"ContainerDied","Data":"f153c6bd663bdf679d461ae162a16236b59b7d43a42bfab4ca0ca80e254fb399"}
Apr 16 17:42:44.004060 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:44.004029    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" event={"ID":"65dd09e9-2e2e-4756-8e14-75abbe99f4b1","Type":"ContainerStarted","Data":"19ce0c2abb3f26edd2f414fe2223a5394e0fdacda5cce35c412650abd38a5ca5"}
Apr 16 17:42:44.004436 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:44.004298    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w"
Apr 16 17:42:44.005616 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:44.005587    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" podUID="65dd09e9-2e2e-4756-8e14-75abbe99f4b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Apr 16 17:42:44.020128 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:44.020089    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" podStartSLOduration=6.020076863 podStartE2EDuration="6.020076863s" podCreationTimestamp="2026-04-16 17:42:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 17:42:44.018601272 +0000 UTC m=+3302.919352656" watchObservedRunningTime="2026-04-16 17:42:44.020076863 +0000 UTC m=+3302.920828325"
Apr 16 17:42:45.007463 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:45.007430    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" podUID="65dd09e9-2e2e-4756-8e14-75abbe99f4b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Apr 16 17:42:55.008175 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:42:55.008071    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" podUID="65dd09e9-2e2e-4756-8e14-75abbe99f4b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Apr 16 17:43:05.008436 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:05.008346    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" podUID="65dd09e9-2e2e-4756-8e14-75abbe99f4b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Apr 16 17:43:15.007414 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:15.007374    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" podUID="65dd09e9-2e2e-4756-8e14-75abbe99f4b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Apr 16 17:43:25.007819 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:25.007762    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" podUID="65dd09e9-2e2e-4756-8e14-75abbe99f4b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Apr 16 17:43:35.008111 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:35.008074    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w" podUID="65dd09e9-2e2e-4756-8e14-75abbe99f4b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Apr 16 17:43:45.008683 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:45.008640    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-5db5686f9f-55j7w"
Apr 16 17:43:48.256683 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:48.256641    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7"]
Apr 16 17:43:48.260519 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:48.260497    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7"
Apr 16 17:43:48.262920 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:48.262894    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"storage-config\""
Apr 16 17:43:48.265479 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:48.265461    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7"]
Apr 16 17:43:48.273212 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:48.273187    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322-kserve-provision-location\") pod \"isvc-sklearn-s3-predictor-669df85bbb-v2gs7\" (UID: \"0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7"
Apr 16 17:43:48.374085 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:48.374056    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322-kserve-provision-location\") pod \"isvc-sklearn-s3-predictor-669df85bbb-v2gs7\" (UID: \"0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7"
Apr 16 17:43:48.374416 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:48.374398    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322-kserve-provision-location\") pod \"isvc-sklearn-s3-predictor-669df85bbb-v2gs7\" (UID: \"0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7"
Apr 16 17:43:48.573134 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:48.573111    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7"
Apr 16 17:43:48.693903 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:48.693878    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7"]
Apr 16 17:43:48.697716 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:43:48.697678    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7c9f56_4bf3_4d3d_b7d4_dfea94ae3322.slice/crio-b6889cdafef07b885d08d1e0e7b234bf5405419a38b963c8b6243c6f022a1759 WatchSource:0}: Error finding container b6889cdafef07b885d08d1e0e7b234bf5405419a38b963c8b6243c6f022a1759: Status 404 returned error can't find the container with id b6889cdafef07b885d08d1e0e7b234bf5405419a38b963c8b6243c6f022a1759
Apr 16 17:43:48.699915 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:48.699895    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 16 17:43:49.216642 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:49.216605    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" event={"ID":"0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322","Type":"ContainerStarted","Data":"c6bfa54948be5fcd0c89b14a1d6dd03bacfd500eb5018916846fd012801525f0"}
Apr 16 17:43:49.216820 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:49.216647    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" event={"ID":"0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322","Type":"ContainerStarted","Data":"b6889cdafef07b885d08d1e0e7b234bf5405419a38b963c8b6243c6f022a1759"}
Apr 16 17:43:50.220888 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:50.220856    2569 generic.go:358] "Generic (PLEG): container finished" podID="0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322" containerID="c6bfa54948be5fcd0c89b14a1d6dd03bacfd500eb5018916846fd012801525f0" exitCode=0
Apr 16 17:43:50.221275 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:50.220944    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" event={"ID":"0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322","Type":"ContainerDied","Data":"c6bfa54948be5fcd0c89b14a1d6dd03bacfd500eb5018916846fd012801525f0"}
Apr 16 17:43:51.225437 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:51.225399    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" event={"ID":"0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322","Type":"ContainerStarted","Data":"a5111bf6f8510d147f05015263aeb2a040f9a042ad537d7753f4e1887a5d3c03"}
Apr 16 17:43:51.225823 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:51.225631    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7"
Apr 16 17:43:51.226774 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:51.226751    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" podUID="0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Apr 16 17:43:51.241521 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:51.241483    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" podStartSLOduration=3.2414713920000002 podStartE2EDuration="3.241471392s" podCreationTimestamp="2026-04-16 17:43:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 17:43:51.239522301 +0000 UTC m=+3370.140273685" watchObservedRunningTime="2026-04-16 17:43:51.241471392 +0000 UTC m=+3370.142222775"
Apr 16 17:43:52.228731 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:43:52.228697    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" podUID="0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Apr 16 17:44:02.229500 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:02.229465    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" podUID="0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Apr 16 17:44:12.229187 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:12.229149    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" podUID="0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Apr 16 17:44:22.228732 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:22.228689    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" podUID="0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Apr 16 17:44:32.228717 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:32.228666    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" podUID="0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Apr 16 17:44:42.229933 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:42.229892    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7" podUID="0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Apr 16 17:44:52.229913 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:52.229886    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-s3-predictor-669df85bbb-v2gs7"
Apr 16 17:44:58.494919 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.494886    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"]
Apr 16 17:44:58.498354 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.498334    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:44:58.501286 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.501268    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Apr 16 17:44:58.508755 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.508732    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"]
Apr 16 17:44:58.562703 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.562677    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e30b512e-7e65-4f94-a44b-23710ac46e17-cabundle-cert\") pod \"isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4\" (UID: \"e30b512e-7e65-4f94-a44b-23710ac46e17\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:44:58.562844 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.562722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e30b512e-7e65-4f94-a44b-23710ac46e17-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4\" (UID: \"e30b512e-7e65-4f94-a44b-23710ac46e17\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:44:58.663217 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.663191    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e30b512e-7e65-4f94-a44b-23710ac46e17-cabundle-cert\") pod \"isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4\" (UID: \"e30b512e-7e65-4f94-a44b-23710ac46e17\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:44:58.663303 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.663227    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e30b512e-7e65-4f94-a44b-23710ac46e17-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4\" (UID: \"e30b512e-7e65-4f94-a44b-23710ac46e17\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:44:58.663530 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.663514    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e30b512e-7e65-4f94-a44b-23710ac46e17-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4\" (UID: \"e30b512e-7e65-4f94-a44b-23710ac46e17\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:44:58.663789 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.663770    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e30b512e-7e65-4f94-a44b-23710ac46e17-cabundle-cert\") pod \"isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4\" (UID: \"e30b512e-7e65-4f94-a44b-23710ac46e17\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:44:58.808966 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.808943    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:44:58.930257 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:58.930235    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"]
Apr 16 17:44:58.932489 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:44:58.932458    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30b512e_7e65_4f94_a44b_23710ac46e17.slice/crio-d74c68e7a780c6b63cb0d2e3a96b60372a4679c5d9bbf02de35d7aff4362fc63 WatchSource:0}: Error finding container d74c68e7a780c6b63cb0d2e3a96b60372a4679c5d9bbf02de35d7aff4362fc63: Status 404 returned error can't find the container with id d74c68e7a780c6b63cb0d2e3a96b60372a4679c5d9bbf02de35d7aff4362fc63
Apr 16 17:44:59.444577 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:59.444527    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" event={"ID":"e30b512e-7e65-4f94-a44b-23710ac46e17","Type":"ContainerStarted","Data":"86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd"}
Apr 16 17:44:59.444577 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:44:59.444580    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" event={"ID":"e30b512e-7e65-4f94-a44b-23710ac46e17","Type":"ContainerStarted","Data":"d74c68e7a780c6b63cb0d2e3a96b60372a4679c5d9bbf02de35d7aff4362fc63"}
Apr 16 17:45:00.449241 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:00.449204    2569 generic.go:358] "Generic (PLEG): container finished" podID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerID="86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd" exitCode=0
Apr 16 17:45:00.449642 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:00.449292    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" event={"ID":"e30b512e-7e65-4f94-a44b-23710ac46e17","Type":"ContainerDied","Data":"86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd"}
Apr 16 17:45:01.453500 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:01.453464    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" event={"ID":"e30b512e-7e65-4f94-a44b-23710ac46e17","Type":"ContainerStarted","Data":"efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237"}
Apr 16 17:45:01.453927 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:01.453674    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:45:01.454777 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:01.454749    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Apr 16 17:45:01.469297 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:01.469248    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" podStartSLOduration=3.469234464 podStartE2EDuration="3.469234464s" podCreationTimestamp="2026-04-16 17:44:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 17:45:01.4682055 +0000 UTC m=+3440.368956895" watchObservedRunningTime="2026-04-16 17:45:01.469234464 +0000 UTC m=+3440.369985849"
Apr 16 17:45:02.457377 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:02.457336    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Apr 16 17:45:12.458105 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:12.458060    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Apr 16 17:45:22.458415 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:22.458369    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Apr 16 17:45:32.458115 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:32.458074    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Apr 16 17:45:42.458125 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:42.458081    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Apr 16 17:45:52.457337 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:45:52.457296    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Apr 16 17:46:02.457451 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:02.457409    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Apr 16 17:46:03.712345 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:03.712321    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:46:08.523627 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:08.523590    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"]
Apr 16 17:46:08.524122 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:08.523859    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container" containerID="cri-o://efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237" gracePeriod=30
Apr 16 17:46:09.581941 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:09.581906    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"]
Apr 16 17:46:09.585475 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:09.585452    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"
Apr 16 17:46:09.592776 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:09.592750    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"]
Apr 16 17:46:09.688918 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:09.688886    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d1c501b-bfb4-4022-b89d-26bed7a1683e-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd\" (UID: \"8d1c501b-bfb4-4022-b89d-26bed7a1683e\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"
Apr 16 17:46:09.789559 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:09.789517    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d1c501b-bfb4-4022-b89d-26bed7a1683e-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd\" (UID: \"8d1c501b-bfb4-4022-b89d-26bed7a1683e\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"
Apr 16 17:46:09.789939 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:09.789917    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d1c501b-bfb4-4022-b89d-26bed7a1683e-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd\" (UID: \"8d1c501b-bfb4-4022-b89d-26bed7a1683e\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"
Apr 16 17:46:09.896533 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:09.896449    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"
Apr 16 17:46:10.021583 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:10.021555    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"]
Apr 16 17:46:10.024320 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:46:10.024277    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1c501b_bfb4_4022_b89d_26bed7a1683e.slice/crio-a1a9590d6adbc01a3c063c924558fd0a4f0571d98eafbd579517205f6a928238 WatchSource:0}: Error finding container a1a9590d6adbc01a3c063c924558fd0a4f0571d98eafbd579517205f6a928238: Status 404 returned error can't find the container with id a1a9590d6adbc01a3c063c924558fd0a4f0571d98eafbd579517205f6a928238
Apr 16 17:46:10.684157 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:10.684113    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd" event={"ID":"8d1c501b-bfb4-4022-b89d-26bed7a1683e","Type":"ContainerStarted","Data":"b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6"}
Apr 16 17:46:10.684566 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:10.684167    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd" event={"ID":"8d1c501b-bfb4-4022-b89d-26bed7a1683e","Type":"ContainerStarted","Data":"a1a9590d6adbc01a3c063c924558fd0a4f0571d98eafbd579517205f6a928238"}
Apr 16 17:46:13.375557 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.375535    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:46:13.420064 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.419995    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e30b512e-7e65-4f94-a44b-23710ac46e17-cabundle-cert\") pod \"e30b512e-7e65-4f94-a44b-23710ac46e17\" (UID: \"e30b512e-7e65-4f94-a44b-23710ac46e17\") "
Apr 16 17:46:13.420064 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.420037    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e30b512e-7e65-4f94-a44b-23710ac46e17-kserve-provision-location\") pod \"e30b512e-7e65-4f94-a44b-23710ac46e17\" (UID: \"e30b512e-7e65-4f94-a44b-23710ac46e17\") "
Apr 16 17:46:13.420329 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.420309    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e30b512e-7e65-4f94-a44b-23710ac46e17-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "e30b512e-7e65-4f94-a44b-23710ac46e17" (UID: "e30b512e-7e65-4f94-a44b-23710ac46e17"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 16 17:46:13.420370 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.420326    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30b512e-7e65-4f94-a44b-23710ac46e17-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e30b512e-7e65-4f94-a44b-23710ac46e17" (UID: "e30b512e-7e65-4f94-a44b-23710ac46e17"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 16 17:46:13.520512 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.520488    2569 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e30b512e-7e65-4f94-a44b-23710ac46e17-cabundle-cert\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 17:46:13.520512 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.520510    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e30b512e-7e65-4f94-a44b-23710ac46e17-kserve-provision-location\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 17:46:13.695622 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.695542    2569 generic.go:358] "Generic (PLEG): container finished" podID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerID="efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237" exitCode=0
Apr 16 17:46:13.695622 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.695600    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" event={"ID":"e30b512e-7e65-4f94-a44b-23710ac46e17","Type":"ContainerDied","Data":"efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237"}
Apr 16 17:46:13.695622 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.695604    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"
Apr 16 17:46:13.695906 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.695626    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4" event={"ID":"e30b512e-7e65-4f94-a44b-23710ac46e17","Type":"ContainerDied","Data":"d74c68e7a780c6b63cb0d2e3a96b60372a4679c5d9bbf02de35d7aff4362fc63"}
Apr 16 17:46:13.695906 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.695641    2569 scope.go:117] "RemoveContainer" containerID="efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237"
Apr 16 17:46:13.707012 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.706997    2569 scope.go:117] "RemoveContainer" containerID="86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd"
Apr 16 17:46:13.714376 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.714355    2569 scope.go:117] "RemoveContainer" containerID="efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237"
Apr 16 17:46:13.714589 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:46:13.714572    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237\": container with ID starting with efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237 not found: ID does not exist" containerID="efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237"
Apr 16 17:46:13.714633 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.714597    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237"} err="failed to get container status \"efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237\": rpc error: code = NotFound desc = could not find container \"efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237\": container with ID starting with efea9c0f6332b5e3b3b44592afc7c2bfc7b326b5651d53c20fd475d6b0300237 not found: ID does not exist"
Apr 16 17:46:13.714633 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.714615    2569 scope.go:117] "RemoveContainer" containerID="86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd"
Apr 16 17:46:13.714787 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:46:13.714772    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd\": container with ID starting with 86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd not found: ID does not exist" containerID="86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd"
Apr 16 17:46:13.714850 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.714790    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd"} err="failed to get container status \"86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd\": rpc error: code = NotFound desc = could not find container \"86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd\": container with ID starting with 86ee3e0903ec581834a1cc5836f9a46c6dbb8910cc9c6cef445ff6bbf966a6dd not found: ID does not exist"
Apr 16 17:46:13.719018 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.718992    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"]
Apr 16 17:46:13.722764 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:13.722746    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-pass-predictor-78646ff9cd-8nqq4"]
Apr 16 17:46:15.704395 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:15.704369    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd_8d1c501b-bfb4-4022-b89d-26bed7a1683e/storage-initializer/0.log"
Apr 16 17:46:15.704806 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:15.704405    2569 generic.go:358] "Generic (PLEG): container finished" podID="8d1c501b-bfb4-4022-b89d-26bed7a1683e" containerID="b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6" exitCode=1
Apr 16 17:46:15.704806 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:15.704471    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd" event={"ID":"8d1c501b-bfb4-4022-b89d-26bed7a1683e","Type":"ContainerDied","Data":"b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6"}
Apr 16 17:46:15.712499 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:15.712478    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" path="/var/lib/kubelet/pods/e30b512e-7e65-4f94-a44b-23710ac46e17/volumes"
Apr 16 17:46:16.709325 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:16.709292    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd_8d1c501b-bfb4-4022-b89d-26bed7a1683e/storage-initializer/0.log"
Apr 16 17:46:16.709852 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:16.709368    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd" event={"ID":"8d1c501b-bfb4-4022-b89d-26bed7a1683e","Type":"ContainerStarted","Data":"37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075"}
Apr 16 17:46:19.630586 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:19.630552    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"]
Apr 16 17:46:19.631011 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:19.630823    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd" podUID="8d1c501b-bfb4-4022-b89d-26bed7a1683e" containerName="storage-initializer" containerID="cri-o://37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075" gracePeriod=30
Apr 16 17:46:20.661902 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.661868    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"]
Apr 16 17:46:20.662435 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.662240    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container"
Apr 16 17:46:20.662435 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.662252    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container"
Apr 16 17:46:20.662435 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.662274    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="storage-initializer"
Apr 16 17:46:20.662435 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.662282    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="storage-initializer"
Apr 16 17:46:20.662435 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.662374    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="e30b512e-7e65-4f94-a44b-23710ac46e17" containerName="kserve-container"
Apr 16 17:46:20.665753 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.665728    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:46:20.668172 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.668149    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Apr 16 17:46:20.675325 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.675295    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"]
Apr 16 17:46:20.778688 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.778638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/270cdd59-b71f-4124-993e-fa8d8c1146e6-cabundle-cert\") pod \"isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd\" (UID: \"270cdd59-b71f-4124-993e-fa8d8c1146e6\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:46:20.778881 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.778711    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/270cdd59-b71f-4124-993e-fa8d8c1146e6-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd\" (UID: \"270cdd59-b71f-4124-993e-fa8d8c1146e6\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:46:20.879401 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.879361    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/270cdd59-b71f-4124-993e-fa8d8c1146e6-cabundle-cert\") pod \"isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd\" (UID: \"270cdd59-b71f-4124-993e-fa8d8c1146e6\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:46:20.879578 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.879420    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/270cdd59-b71f-4124-993e-fa8d8c1146e6-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd\" (UID: \"270cdd59-b71f-4124-993e-fa8d8c1146e6\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:46:20.879817 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.879776    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/270cdd59-b71f-4124-993e-fa8d8c1146e6-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd\" (UID: \"270cdd59-b71f-4124-993e-fa8d8c1146e6\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:46:20.880008 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.879987    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/270cdd59-b71f-4124-993e-fa8d8c1146e6-cabundle-cert\") pod \"isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd\" (UID: \"270cdd59-b71f-4124-993e-fa8d8c1146e6\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:46:20.977606 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:20.977514    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:46:21.104592 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:21.104558    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"]
Apr 16 17:46:21.107407 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:46:21.107371    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270cdd59_b71f_4124_993e_fa8d8c1146e6.slice/crio-db21ea04c8cfbb825f439e49a7ab4c1dda3279f45e6d92332d543a17e434f64a WatchSource:0}: Error finding container db21ea04c8cfbb825f439e49a7ab4c1dda3279f45e6d92332d543a17e434f64a: Status 404 returned error can't find the container with id db21ea04c8cfbb825f439e49a7ab4c1dda3279f45e6d92332d543a17e434f64a
Apr 16 17:46:21.729250 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:21.729190    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" event={"ID":"270cdd59-b71f-4124-993e-fa8d8c1146e6","Type":"ContainerStarted","Data":"654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4"}
Apr 16 17:46:21.729250 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:21.729241    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" event={"ID":"270cdd59-b71f-4124-993e-fa8d8c1146e6","Type":"ContainerStarted","Data":"db21ea04c8cfbb825f439e49a7ab4c1dda3279f45e6d92332d543a17e434f64a"}
Apr 16 17:46:21.878457 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:21.878432    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd_8d1c501b-bfb4-4022-b89d-26bed7a1683e/storage-initializer/1.log"
Apr 16 17:46:21.878866 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:21.878845    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd_8d1c501b-bfb4-4022-b89d-26bed7a1683e/storage-initializer/0.log"
Apr 16 17:46:21.878948 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:21.878935    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"
Apr 16 17:46:21.986850 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:21.986746    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d1c501b-bfb4-4022-b89d-26bed7a1683e-kserve-provision-location\") pod \"8d1c501b-bfb4-4022-b89d-26bed7a1683e\" (UID: \"8d1c501b-bfb4-4022-b89d-26bed7a1683e\") "
Apr 16 17:46:21.987047 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:21.987023    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d1c501b-bfb4-4022-b89d-26bed7a1683e-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "8d1c501b-bfb4-4022-b89d-26bed7a1683e" (UID: "8d1c501b-bfb4-4022-b89d-26bed7a1683e"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 16 17:46:22.087849 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.087783    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d1c501b-bfb4-4022-b89d-26bed7a1683e-kserve-provision-location\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 17:46:22.734099 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.734059    2569 generic.go:358] "Generic (PLEG): container finished" podID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerID="654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4" exitCode=0
Apr 16 17:46:22.734578 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.734144    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" event={"ID":"270cdd59-b71f-4124-993e-fa8d8c1146e6","Type":"ContainerDied","Data":"654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4"}
Apr 16 17:46:22.735465 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.735446    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd_8d1c501b-bfb4-4022-b89d-26bed7a1683e/storage-initializer/1.log"
Apr 16 17:46:22.735807 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.735779    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd_8d1c501b-bfb4-4022-b89d-26bed7a1683e/storage-initializer/0.log"
Apr 16 17:46:22.735867 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.735835    2569 generic.go:358] "Generic (PLEG): container finished" podID="8d1c501b-bfb4-4022-b89d-26bed7a1683e" containerID="37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075" exitCode=1
Apr 16 17:46:22.735916 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.735902    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"
Apr 16 17:46:22.735994 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.735902    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd" event={"ID":"8d1c501b-bfb4-4022-b89d-26bed7a1683e","Type":"ContainerDied","Data":"37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075"}
Apr 16 17:46:22.736028 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.736011    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd" event={"ID":"8d1c501b-bfb4-4022-b89d-26bed7a1683e","Type":"ContainerDied","Data":"a1a9590d6adbc01a3c063c924558fd0a4f0571d98eafbd579517205f6a928238"}
Apr 16 17:46:22.736058 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.736028    2569 scope.go:117] "RemoveContainer" containerID="37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075"
Apr 16 17:46:22.745382 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.745361    2569 scope.go:117] "RemoveContainer" containerID="b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6"
Apr 16 17:46:22.754659 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.754636    2569 scope.go:117] "RemoveContainer" containerID="37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075"
Apr 16 17:46:22.755039 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:46:22.755015    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075\": container with ID starting with 37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075 not found: ID does not exist" containerID="37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075"
Apr 16 17:46:22.755129 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.755053    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075"} err="failed to get container status \"37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075\": rpc error: code = NotFound desc = could not find container \"37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075\": container with ID starting with 37156838c593e027ceaf157c09e3c5bacefac0b4f048a149864dca10edff6075 not found: ID does not exist"
Apr 16 17:46:22.755129 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.755079    2569 scope.go:117] "RemoveContainer" containerID="b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6"
Apr 16 17:46:22.755405 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:46:22.755385    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6\": container with ID starting with b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6 not found: ID does not exist" containerID="b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6"
Apr 16 17:46:22.755461 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.755411    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6"} err="failed to get container status \"b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6\": rpc error: code = NotFound desc = could not find container \"b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6\": container with ID starting with b56ba5b51a0e081b371a46796c1d888d0332a268d75fd74abf49d9bea8a87ba6 not found: ID does not exist"
Apr 16 17:46:22.772952 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.772909    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"]
Apr 16 17:46:22.777083 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:22.777053    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-global-fail-predictor-7fc5b776c6-b8ssd"]
Apr 16 17:46:23.713029 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:23.712988    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d1c501b-bfb4-4022-b89d-26bed7a1683e" path="/var/lib/kubelet/pods/8d1c501b-bfb4-4022-b89d-26bed7a1683e/volumes"
Apr 16 17:46:23.741863 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:23.741826    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" event={"ID":"270cdd59-b71f-4124-993e-fa8d8c1146e6","Type":"ContainerStarted","Data":"af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc"}
Apr 16 17:46:23.742385 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:23.742038    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:46:23.743454 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:23.743421    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Apr 16 17:46:23.758722 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:23.758670    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" podStartSLOduration=3.7586549590000002 podStartE2EDuration="3.758654959s" podCreationTimestamp="2026-04-16 17:46:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 17:46:23.757346688 +0000 UTC m=+3522.658098072" watchObservedRunningTime="2026-04-16 17:46:23.758654959 +0000 UTC m=+3522.659406342"
Apr 16 17:46:24.745511 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:24.745471    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Apr 16 17:46:34.745608 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:34.745563    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Apr 16 17:46:44.746425 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:44.746376    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Apr 16 17:46:54.745619 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:46:54.745571    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Apr 16 17:47:04.745975 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:04.745931    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Apr 16 17:47:14.745596 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:14.745548    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Apr 16 17:47:24.746215 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:24.746163    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Apr 16 17:47:34.746962 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:34.746929    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:47:40.702812 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:40.702758    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"]
Apr 16 17:47:40.705221 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:40.703043    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container" containerID="cri-o://af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc" gracePeriod=30
Apr 16 17:47:41.766458 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.766411    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"]
Apr 16 17:47:41.766880 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.766783    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d1c501b-bfb4-4022-b89d-26bed7a1683e" containerName="storage-initializer"
Apr 16 17:47:41.766880 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.766832    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d1c501b-bfb4-4022-b89d-26bed7a1683e" containerName="storage-initializer"
Apr 16 17:47:41.766880 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.766847    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d1c501b-bfb4-4022-b89d-26bed7a1683e" containerName="storage-initializer"
Apr 16 17:47:41.766880 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.766853    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d1c501b-bfb4-4022-b89d-26bed7a1683e" containerName="storage-initializer"
Apr 16 17:47:41.767034 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.766916    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d1c501b-bfb4-4022-b89d-26bed7a1683e" containerName="storage-initializer"
Apr 16 17:47:41.767034 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.766926    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d1c501b-bfb4-4022-b89d-26bed7a1683e" containerName="storage-initializer"
Apr 16 17:47:41.770130 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.770108    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"
Apr 16 17:47:41.777762 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.777738    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"]
Apr 16 17:47:41.780616 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.780593    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/72fa0e45-11d7-4b2b-90b6-a6c19b414eaf-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg\" (UID: \"72fa0e45-11d7-4b2b-90b6-a6c19b414eaf\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"
Apr 16 17:47:41.881450 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.881419    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/72fa0e45-11d7-4b2b-90b6-a6c19b414eaf-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg\" (UID: \"72fa0e45-11d7-4b2b-90b6-a6c19b414eaf\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"
Apr 16 17:47:41.881848 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:41.881830    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/72fa0e45-11d7-4b2b-90b6-a6c19b414eaf-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg\" (UID: \"72fa0e45-11d7-4b2b-90b6-a6c19b414eaf\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"
Apr 16 17:47:42.081743 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:42.081697    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"
Apr 16 17:47:42.203544 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:42.203516    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"]
Apr 16 17:47:42.206307 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:47:42.206278    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72fa0e45_11d7_4b2b_90b6_a6c19b414eaf.slice/crio-f35d140f3b3c479070309a0b2f9fa0ed2e047f77802a88df21fb93a79e195c02 WatchSource:0}: Error finding container f35d140f3b3c479070309a0b2f9fa0ed2e047f77802a88df21fb93a79e195c02: Status 404 returned error can't find the container with id f35d140f3b3c479070309a0b2f9fa0ed2e047f77802a88df21fb93a79e195c02
Apr 16 17:47:43.008203 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:43.008155    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg" event={"ID":"72fa0e45-11d7-4b2b-90b6-a6c19b414eaf","Type":"ContainerStarted","Data":"2502f34398a33979fe47aa631b254a579746228a5dc4167a8f5481df24babc33"}
Apr 16 17:47:43.008203 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:43.008201    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg" event={"ID":"72fa0e45-11d7-4b2b-90b6-a6c19b414eaf","Type":"ContainerStarted","Data":"f35d140f3b3c479070309a0b2f9fa0ed2e047f77802a88df21fb93a79e195c02"}
Apr 16 17:47:44.746350 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:44.746303    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Apr 16 17:47:45.352005 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:45.351983    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:47:45.408906 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:45.408818    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/270cdd59-b71f-4124-993e-fa8d8c1146e6-cabundle-cert\") pod \"270cdd59-b71f-4124-993e-fa8d8c1146e6\" (UID: \"270cdd59-b71f-4124-993e-fa8d8c1146e6\") "
Apr 16 17:47:45.408906 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:45.408859    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/270cdd59-b71f-4124-993e-fa8d8c1146e6-kserve-provision-location\") pod \"270cdd59-b71f-4124-993e-fa8d8c1146e6\" (UID: \"270cdd59-b71f-4124-993e-fa8d8c1146e6\") "
Apr 16 17:47:45.409196 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:45.409171    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/270cdd59-b71f-4124-993e-fa8d8c1146e6-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "270cdd59-b71f-4124-993e-fa8d8c1146e6" (UID: "270cdd59-b71f-4124-993e-fa8d8c1146e6"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 16 17:47:45.409263 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:45.409234    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/270cdd59-b71f-4124-993e-fa8d8c1146e6-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "270cdd59-b71f-4124-993e-fa8d8c1146e6" (UID: "270cdd59-b71f-4124-993e-fa8d8c1146e6"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 16 17:47:45.510373 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:45.510325    2569 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/270cdd59-b71f-4124-993e-fa8d8c1146e6-cabundle-cert\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 17:47:45.510373 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:45.510369    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/270cdd59-b71f-4124-993e-fa8d8c1146e6-kserve-provision-location\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 17:47:46.020336 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.020248    2569 generic.go:358] "Generic (PLEG): container finished" podID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerID="af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc" exitCode=0
Apr 16 17:47:46.020336 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.020313    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"
Apr 16 17:47:46.020821 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.020338    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" event={"ID":"270cdd59-b71f-4124-993e-fa8d8c1146e6","Type":"ContainerDied","Data":"af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc"}
Apr 16 17:47:46.020821 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.020379    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd" event={"ID":"270cdd59-b71f-4124-993e-fa8d8c1146e6","Type":"ContainerDied","Data":"db21ea04c8cfbb825f439e49a7ab4c1dda3279f45e6d92332d543a17e434f64a"}
Apr 16 17:47:46.020821 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.020397    2569 scope.go:117] "RemoveContainer" containerID="af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc"
Apr 16 17:47:46.028521 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.028503    2569 scope.go:117] "RemoveContainer" containerID="654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4"
Apr 16 17:47:46.035528 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.035510    2569 scope.go:117] "RemoveContainer" containerID="af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc"
Apr 16 17:47:46.035808 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:47:46.035753    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc\": container with ID starting with af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc not found: ID does not exist" containerID="af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc"
Apr 16 17:47:46.035912 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.035779    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc"} err="failed to get container status \"af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc\": rpc error: code = NotFound desc = could not find container \"af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc\": container with ID starting with af8bfba724f230b185c5074e8454835f3b19e3e695ff73741708acd46887e0dc not found: ID does not exist"
Apr 16 17:47:46.035912 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.035830    2569 scope.go:117] "RemoveContainer" containerID="654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4"
Apr 16 17:47:46.036237 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:47:46.036195    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4\": container with ID starting with 654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4 not found: ID does not exist" containerID="654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4"
Apr 16 17:47:46.036237 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.036228    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4"} err="failed to get container status \"654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4\": rpc error: code = NotFound desc = could not find container \"654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4\": container with ID starting with 654329822a58b47907e5d01c1f7c3470a29751bf58b1d4ebacd2a3f7dd658ea4 not found: ID does not exist"
Apr 16 17:47:46.038193 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.038175    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"]
Apr 16 17:47:46.041455 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:46.041436    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-pass-predictor-5fb587c98b-ddzcd"]
Apr 16 17:47:47.713339 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:47.713304    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" path="/var/lib/kubelet/pods/270cdd59-b71f-4124-993e-fa8d8c1146e6/volumes"
Apr 16 17:47:48.028822 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:48.028731    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg_72fa0e45-11d7-4b2b-90b6-a6c19b414eaf/storage-initializer/0.log"
Apr 16 17:47:48.028822 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:48.028766    2569 generic.go:358] "Generic (PLEG): container finished" podID="72fa0e45-11d7-4b2b-90b6-a6c19b414eaf" containerID="2502f34398a33979fe47aa631b254a579746228a5dc4167a8f5481df24babc33" exitCode=1
Apr 16 17:47:48.028822 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:48.028812    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg" event={"ID":"72fa0e45-11d7-4b2b-90b6-a6c19b414eaf","Type":"ContainerDied","Data":"2502f34398a33979fe47aa631b254a579746228a5dc4167a8f5481df24babc33"}
Apr 16 17:47:49.033812 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:49.033775    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg_72fa0e45-11d7-4b2b-90b6-a6c19b414eaf/storage-initializer/0.log"
Apr 16 17:47:49.034164 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:49.033913    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg" event={"ID":"72fa0e45-11d7-4b2b-90b6-a6c19b414eaf","Type":"ContainerStarted","Data":"cb9eb70a92586e347848372e5c79241a6e32b22b94e5d460045e2430ebdad314"}
Apr 16 17:47:51.041966 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:51.041933    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg_72fa0e45-11d7-4b2b-90b6-a6c19b414eaf/storage-initializer/1.log"
Apr 16 17:47:51.042383 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:51.042310    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg_72fa0e45-11d7-4b2b-90b6-a6c19b414eaf/storage-initializer/0.log"
Apr 16 17:47:51.042383 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:51.042338    2569 generic.go:358] "Generic (PLEG): container finished" podID="72fa0e45-11d7-4b2b-90b6-a6c19b414eaf" containerID="cb9eb70a92586e347848372e5c79241a6e32b22b94e5d460045e2430ebdad314" exitCode=1
Apr 16 17:47:51.042513 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:51.042381    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg" event={"ID":"72fa0e45-11d7-4b2b-90b6-a6c19b414eaf","Type":"ContainerDied","Data":"cb9eb70a92586e347848372e5c79241a6e32b22b94e5d460045e2430ebdad314"}
Apr 16 17:47:51.042513 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:51.042412    2569 scope.go:117] "RemoveContainer" containerID="2502f34398a33979fe47aa631b254a579746228a5dc4167a8f5481df24babc33"
Apr 16 17:47:51.042773 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:51.042756    2569 scope.go:117] "RemoveContainer" containerID="2502f34398a33979fe47aa631b254a579746228a5dc4167a8f5481df24babc33"
Apr 16 17:47:51.053464 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:47:51.053431    2569 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg_kserve-ci-e2e-test_72fa0e45-11d7-4b2b-90b6-a6c19b414eaf_0 in pod sandbox f35d140f3b3c479070309a0b2f9fa0ed2e047f77802a88df21fb93a79e195c02 from index: no such id: '2502f34398a33979fe47aa631b254a579746228a5dc4167a8f5481df24babc33'" containerID="2502f34398a33979fe47aa631b254a579746228a5dc4167a8f5481df24babc33"
Apr 16 17:47:51.053540 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:47:51.053493    2569 kuberuntime_container.go:951] "Unhandled Error" err="failed to remove pod init container \"storage-initializer\": rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg_kserve-ci-e2e-test_72fa0e45-11d7-4b2b-90b6-a6c19b414eaf_0 in pod sandbox f35d140f3b3c479070309a0b2f9fa0ed2e047f77802a88df21fb93a79e195c02 from index: no such id: '2502f34398a33979fe47aa631b254a579746228a5dc4167a8f5481df24babc33'; Skipping pod \"isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg_kserve-ci-e2e-test(72fa0e45-11d7-4b2b-90b6-a6c19b414eaf)\"" logger="UnhandledError"
Apr 16 17:47:51.054850 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:47:51.054824    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-initializer\" with CrashLoopBackOff: \"back-off 10s restarting failed container=storage-initializer pod=isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg_kserve-ci-e2e-test(72fa0e45-11d7-4b2b-90b6-a6c19b414eaf)\"" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg" podUID="72fa0e45-11d7-4b2b-90b6-a6c19b414eaf"
Apr 16 17:47:51.785894 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:51.785859    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"]
Apr 16 17:47:52.047028 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.046942    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg_72fa0e45-11d7-4b2b-90b6-a6c19b414eaf/storage-initializer/1.log"
Apr 16 17:47:52.178367 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.178344    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg_72fa0e45-11d7-4b2b-90b6-a6c19b414eaf/storage-initializer/1.log"
Apr 16 17:47:52.178511 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.178411    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"
Apr 16 17:47:52.263486 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.263452    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/72fa0e45-11d7-4b2b-90b6-a6c19b414eaf-kserve-provision-location\") pod \"72fa0e45-11d7-4b2b-90b6-a6c19b414eaf\" (UID: \"72fa0e45-11d7-4b2b-90b6-a6c19b414eaf\") "
Apr 16 17:47:52.263728 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.263705    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72fa0e45-11d7-4b2b-90b6-a6c19b414eaf-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "72fa0e45-11d7-4b2b-90b6-a6c19b414eaf" (UID: "72fa0e45-11d7-4b2b-90b6-a6c19b414eaf"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 16 17:47:52.364569 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.364529    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/72fa0e45-11d7-4b2b-90b6-a6c19b414eaf-kserve-provision-location\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 17:47:52.833108 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833071    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"]
Apr 16 17:47:52.833475 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833460    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72fa0e45-11d7-4b2b-90b6-a6c19b414eaf" containerName="storage-initializer"
Apr 16 17:47:52.833527 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833476    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="72fa0e45-11d7-4b2b-90b6-a6c19b414eaf" containerName="storage-initializer"
Apr 16 17:47:52.833527 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833497    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container"
Apr 16 17:47:52.833527 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833504    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container"
Apr 16 17:47:52.833527 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833512    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="storage-initializer"
Apr 16 17:47:52.833527 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833521    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="storage-initializer"
Apr 16 17:47:52.833689 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833593    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="270cdd59-b71f-4124-993e-fa8d8c1146e6" containerName="kserve-container"
Apr 16 17:47:52.833689 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833606    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="72fa0e45-11d7-4b2b-90b6-a6c19b414eaf" containerName="storage-initializer"
Apr 16 17:47:52.833689 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833611    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="72fa0e45-11d7-4b2b-90b6-a6c19b414eaf" containerName="storage-initializer"
Apr 16 17:47:52.833689 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833665    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72fa0e45-11d7-4b2b-90b6-a6c19b414eaf" containerName="storage-initializer"
Apr 16 17:47:52.833689 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.833671    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="72fa0e45-11d7-4b2b-90b6-a6c19b414eaf" containerName="storage-initializer"
Apr 16 17:47:52.838089 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.838070    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:47:52.840375 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.840348    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Apr 16 17:47:52.843412 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.843387    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"]
Apr 16 17:47:52.867487 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.867455    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/18029016-d0be-4b4e-9f1e-ae64f1f4d768-cabundle-cert\") pod \"isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7\" (UID: \"18029016-d0be-4b4e-9f1e-ae64f1f4d768\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:47:52.867669 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.867525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/18029016-d0be-4b4e-9f1e-ae64f1f4d768-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7\" (UID: \"18029016-d0be-4b4e-9f1e-ae64f1f4d768\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:47:52.969000 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.968953    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/18029016-d0be-4b4e-9f1e-ae64f1f4d768-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7\" (UID: \"18029016-d0be-4b4e-9f1e-ae64f1f4d768\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:47:52.969214 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.969032    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/18029016-d0be-4b4e-9f1e-ae64f1f4d768-cabundle-cert\") pod \"isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7\" (UID: \"18029016-d0be-4b4e-9f1e-ae64f1f4d768\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:47:52.969419 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.969394    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/18029016-d0be-4b4e-9f1e-ae64f1f4d768-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7\" (UID: \"18029016-d0be-4b4e-9f1e-ae64f1f4d768\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:47:52.969670 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:52.969653    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/18029016-d0be-4b4e-9f1e-ae64f1f4d768-cabundle-cert\") pod \"isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7\" (UID: \"18029016-d0be-4b4e-9f1e-ae64f1f4d768\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:47:53.051889 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:53.051866    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg_72fa0e45-11d7-4b2b-90b6-a6c19b414eaf/storage-initializer/1.log"
Apr 16 17:47:53.052289 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:53.051954    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg" event={"ID":"72fa0e45-11d7-4b2b-90b6-a6c19b414eaf","Type":"ContainerDied","Data":"f35d140f3b3c479070309a0b2f9fa0ed2e047f77802a88df21fb93a79e195c02"}
Apr 16 17:47:53.052289 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:53.051984    2569 scope.go:117] "RemoveContainer" containerID="cb9eb70a92586e347848372e5c79241a6e32b22b94e5d460045e2430ebdad314"
Apr 16 17:47:53.052289 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:53.051987    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"
Apr 16 17:47:53.083551 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:53.083455    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"]
Apr 16 17:47:53.089284 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:53.089257    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-custom-fail-predictor-66899b8948-vrzfg"]
Apr 16 17:47:53.151429 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:53.151398    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:47:53.275427 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:53.275398    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"]
Apr 16 17:47:53.277868 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:47:53.277841    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18029016_d0be_4b4e_9f1e_ae64f1f4d768.slice/crio-c98e2e9c82e98db39b07e78c03305a585489370c9f9e9b7a259ac32437915ca2 WatchSource:0}: Error finding container c98e2e9c82e98db39b07e78c03305a585489370c9f9e9b7a259ac32437915ca2: Status 404 returned error can't find the container with id c98e2e9c82e98db39b07e78c03305a585489370c9f9e9b7a259ac32437915ca2
Apr 16 17:47:53.714409 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:53.714332    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72fa0e45-11d7-4b2b-90b6-a6c19b414eaf" path="/var/lib/kubelet/pods/72fa0e45-11d7-4b2b-90b6-a6c19b414eaf/volumes"
Apr 16 17:47:54.057682 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:54.057649    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" event={"ID":"18029016-d0be-4b4e-9f1e-ae64f1f4d768","Type":"ContainerStarted","Data":"056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee"}
Apr 16 17:47:54.057682 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:54.057684    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" event={"ID":"18029016-d0be-4b4e-9f1e-ae64f1f4d768","Type":"ContainerStarted","Data":"c98e2e9c82e98db39b07e78c03305a585489370c9f9e9b7a259ac32437915ca2"}
Apr 16 17:47:55.062044 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:55.062007    2569 generic.go:358] "Generic (PLEG): container finished" podID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerID="056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee" exitCode=0
Apr 16 17:47:55.062449 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:55.062093    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" event={"ID":"18029016-d0be-4b4e-9f1e-ae64f1f4d768","Type":"ContainerDied","Data":"056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee"}
Apr 16 17:47:56.067414 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:56.067381    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" event={"ID":"18029016-d0be-4b4e-9f1e-ae64f1f4d768","Type":"ContainerStarted","Data":"d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44"}
Apr 16 17:47:56.067879 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:56.067605    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:47:56.068941 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:56.068919    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Apr 16 17:47:56.083465 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:56.083425    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" podStartSLOduration=4.083414019 podStartE2EDuration="4.083414019s" podCreationTimestamp="2026-04-16 17:47:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 17:47:56.082147059 +0000 UTC m=+3614.982898449" watchObservedRunningTime="2026-04-16 17:47:56.083414019 +0000 UTC m=+3614.984165403"
Apr 16 17:47:57.070854 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:47:57.070792    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Apr 16 17:48:07.071627 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:48:07.071586    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Apr 16 17:48:17.071642 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:48:17.071596    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Apr 16 17:48:27.071375 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:48:27.071336    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Apr 16 17:48:37.071336 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:48:37.071292    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Apr 16 17:48:47.071715 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:48:47.071673    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Apr 16 17:48:57.071422 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:48:57.071336    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Apr 16 17:49:04.710069 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:04.710040    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:49:12.874623 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:12.874588    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"]
Apr 16 17:49:12.875044 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:12.874952    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container" containerID="cri-o://d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44" gracePeriod=30
Apr 16 17:49:13.924494 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:13.924463    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"]
Apr 16 17:49:13.927725 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:13.927706    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"
Apr 16 17:49:13.937471 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:13.937446    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"]
Apr 16 17:49:13.973528 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:13.973500    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8575e68a-a384-41be-a97e-b5c008490e72-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl\" (UID: \"8575e68a-a384-41be-a97e-b5c008490e72\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"
Apr 16 17:49:14.074354 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:14.074325    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8575e68a-a384-41be-a97e-b5c008490e72-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl\" (UID: \"8575e68a-a384-41be-a97e-b5c008490e72\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"
Apr 16 17:49:14.074659 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:14.074643    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8575e68a-a384-41be-a97e-b5c008490e72-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl\" (UID: \"8575e68a-a384-41be-a97e-b5c008490e72\") " pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"
Apr 16 17:49:14.238462 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:14.238389    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"
Apr 16 17:49:14.361365 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:14.361337    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"]
Apr 16 17:49:14.363853 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:49:14.363826    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8575e68a_a384_41be_a97e_b5c008490e72.slice/crio-a89be32833bda747399268854f80bdb53f83b6334f7bfb2d32e08bafac4a8e26 WatchSource:0}: Error finding container a89be32833bda747399268854f80bdb53f83b6334f7bfb2d32e08bafac4a8e26: Status 404 returned error can't find the container with id a89be32833bda747399268854f80bdb53f83b6334f7bfb2d32e08bafac4a8e26
Apr 16 17:49:14.365683 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:14.365668    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 16 17:49:14.709603 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:14.709565    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Apr 16 17:49:15.335911 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:15.335876    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl" event={"ID":"8575e68a-a384-41be-a97e-b5c008490e72","Type":"ContainerStarted","Data":"17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4"}
Apr 16 17:49:15.335911 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:15.335913    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl" event={"ID":"8575e68a-a384-41be-a97e-b5c008490e72","Type":"ContainerStarted","Data":"a89be32833bda747399268854f80bdb53f83b6334f7bfb2d32e08bafac4a8e26"}
Apr 16 17:49:17.028476 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.028456    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:49:17.096230 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.096165    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/18029016-d0be-4b4e-9f1e-ae64f1f4d768-kserve-provision-location\") pod \"18029016-d0be-4b4e-9f1e-ae64f1f4d768\" (UID: \"18029016-d0be-4b4e-9f1e-ae64f1f4d768\") "
Apr 16 17:49:17.096230 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.096220    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/18029016-d0be-4b4e-9f1e-ae64f1f4d768-cabundle-cert\") pod \"18029016-d0be-4b4e-9f1e-ae64f1f4d768\" (UID: \"18029016-d0be-4b4e-9f1e-ae64f1f4d768\") "
Apr 16 17:49:17.096415 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.096393    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18029016-d0be-4b4e-9f1e-ae64f1f4d768-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "18029016-d0be-4b4e-9f1e-ae64f1f4d768" (UID: "18029016-d0be-4b4e-9f1e-ae64f1f4d768"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 16 17:49:17.096568 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.096550    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18029016-d0be-4b4e-9f1e-ae64f1f4d768-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "18029016-d0be-4b4e-9f1e-ae64f1f4d768" (UID: "18029016-d0be-4b4e-9f1e-ae64f1f4d768"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 16 17:49:17.197325 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.197299    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/18029016-d0be-4b4e-9f1e-ae64f1f4d768-kserve-provision-location\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 17:49:17.197325 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.197324    2569 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/18029016-d0be-4b4e-9f1e-ae64f1f4d768-cabundle-cert\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 17:49:17.347424 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.347352    2569 generic.go:358] "Generic (PLEG): container finished" podID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerID="d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44" exitCode=0
Apr 16 17:49:17.347549 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.347428    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"
Apr 16 17:49:17.347549 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.347437    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" event={"ID":"18029016-d0be-4b4e-9f1e-ae64f1f4d768","Type":"ContainerDied","Data":"d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44"}
Apr 16 17:49:17.347549 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.347482    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7" event={"ID":"18029016-d0be-4b4e-9f1e-ae64f1f4d768","Type":"ContainerDied","Data":"c98e2e9c82e98db39b07e78c03305a585489370c9f9e9b7a259ac32437915ca2"}
Apr 16 17:49:17.347549 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.347503    2569 scope.go:117] "RemoveContainer" containerID="d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44"
Apr 16 17:49:17.355862 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.355845    2569 scope.go:117] "RemoveContainer" containerID="056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee"
Apr 16 17:49:17.362751 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.362735    2569 scope.go:117] "RemoveContainer" containerID="d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44"
Apr 16 17:49:17.363031 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:49:17.363013    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44\": container with ID starting with d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44 not found: ID does not exist" containerID="d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44"
Apr 16 17:49:17.363102 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.363038    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44"} err="failed to get container status \"d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44\": rpc error: code = NotFound desc = could not find container \"d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44\": container with ID starting with d5d365d6a89a1ee3393575249215a85c3490eb1b39e66a8be3f08fc3d8f96c44 not found: ID does not exist"
Apr 16 17:49:17.363102 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.363055    2569 scope.go:117] "RemoveContainer" containerID="056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee"
Apr 16 17:49:17.363309 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:49:17.363292    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee\": container with ID starting with 056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee not found: ID does not exist" containerID="056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee"
Apr 16 17:49:17.363354 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.363314    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee"} err="failed to get container status \"056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee\": rpc error: code = NotFound desc = could not find container \"056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee\": container with ID starting with 056baf244bb502f00559d399521e4d0d125f6cd94f53a7680d35efd0138d3aee not found: ID does not exist"
Apr 16 17:49:17.368143 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.368119    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"]
Apr 16 17:49:17.371837 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.371819    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-pass-predictor-df5b57b75-mxvc7"]
Apr 16 17:49:17.713320 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:17.713243    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" path="/var/lib/kubelet/pods/18029016-d0be-4b4e-9f1e-ae64f1f4d768/volumes"
Apr 16 17:49:20.359658 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:20.359629    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl_8575e68a-a384-41be-a97e-b5c008490e72/storage-initializer/0.log"
Apr 16 17:49:20.360074 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:20.359666    2569 generic.go:358] "Generic (PLEG): container finished" podID="8575e68a-a384-41be-a97e-b5c008490e72" containerID="17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4" exitCode=1
Apr 16 17:49:20.360074 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:20.359729    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl" event={"ID":"8575e68a-a384-41be-a97e-b5c008490e72","Type":"ContainerDied","Data":"17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4"}
Apr 16 17:49:21.364604 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:21.364576    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl_8575e68a-a384-41be-a97e-b5c008490e72/storage-initializer/0.log"
Apr 16 17:49:21.365082 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:21.364678    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl" event={"ID":"8575e68a-a384-41be-a97e-b5c008490e72","Type":"ContainerStarted","Data":"33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e"}
Apr 16 17:49:23.939924 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:23.939892    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"]
Apr 16 17:49:23.940293 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:23.940110    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl" podUID="8575e68a-a384-41be-a97e-b5c008490e72" containerName="storage-initializer" containerID="cri-o://33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e" gracePeriod=30
Apr 16 17:49:26.641571 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.641533    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4sxmd/must-gather-wx8bl"]
Apr 16 17:49:26.642082 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.642063    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="storage-initializer"
Apr 16 17:49:26.642157 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.642086    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="storage-initializer"
Apr 16 17:49:26.642157 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.642117    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container"
Apr 16 17:49:26.642157 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.642127    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container"
Apr 16 17:49:26.642308 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.642211    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="18029016-d0be-4b4e-9f1e-ae64f1f4d768" containerName="kserve-container"
Apr 16 17:49:26.645306 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.645286    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sxmd/must-gather-wx8bl"
Apr 16 17:49:26.647509 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.647490    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4sxmd\"/\"openshift-service-ca.crt\""
Apr 16 17:49:26.647770 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.647751    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4sxmd\"/\"kube-root-ca.crt\""
Apr 16 17:49:26.651871 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.651853    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4sxmd/must-gather-wx8bl"]
Apr 16 17:49:26.661915 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.661885    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxlwx\" (UniqueName: \"kubernetes.io/projected/2690d826-d187-4888-86f0-cc71a918e967-kube-api-access-mxlwx\") pod \"must-gather-wx8bl\" (UID: \"2690d826-d187-4888-86f0-cc71a918e967\") " pod="openshift-must-gather-4sxmd/must-gather-wx8bl"
Apr 16 17:49:26.662020 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.661942    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2690d826-d187-4888-86f0-cc71a918e967-must-gather-output\") pod \"must-gather-wx8bl\" (UID: \"2690d826-d187-4888-86f0-cc71a918e967\") " pod="openshift-must-gather-4sxmd/must-gather-wx8bl"
Apr 16 17:49:26.763029 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.762998    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2690d826-d187-4888-86f0-cc71a918e967-must-gather-output\") pod \"must-gather-wx8bl\" (UID: \"2690d826-d187-4888-86f0-cc71a918e967\") " pod="openshift-must-gather-4sxmd/must-gather-wx8bl"
Apr 16 17:49:26.763140 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.763044    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxlwx\" (UniqueName: \"kubernetes.io/projected/2690d826-d187-4888-86f0-cc71a918e967-kube-api-access-mxlwx\") pod \"must-gather-wx8bl\" (UID: \"2690d826-d187-4888-86f0-cc71a918e967\") " pod="openshift-must-gather-4sxmd/must-gather-wx8bl"
Apr 16 17:49:26.763316 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.763299    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2690d826-d187-4888-86f0-cc71a918e967-must-gather-output\") pod \"must-gather-wx8bl\" (UID: \"2690d826-d187-4888-86f0-cc71a918e967\") " pod="openshift-must-gather-4sxmd/must-gather-wx8bl"
Apr 16 17:49:26.773543 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.773524    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxlwx\" (UniqueName: \"kubernetes.io/projected/2690d826-d187-4888-86f0-cc71a918e967-kube-api-access-mxlwx\") pod \"must-gather-wx8bl\" (UID: \"2690d826-d187-4888-86f0-cc71a918e967\") " pod="openshift-must-gather-4sxmd/must-gather-wx8bl"
Apr 16 17:49:26.955618 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:26.955534    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sxmd/must-gather-wx8bl"
Apr 16 17:49:27.073493 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.073463    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4sxmd/must-gather-wx8bl"]
Apr 16 17:49:27.076728 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:49:27.076699    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2690d826_d187_4888_86f0_cc71a918e967.slice/crio-676d29c94f6664a7620b373a2313facc49af867ae078d4959089088cae3b5c91 WatchSource:0}: Error finding container 676d29c94f6664a7620b373a2313facc49af867ae078d4959089088cae3b5c91: Status 404 returned error can't find the container with id 676d29c94f6664a7620b373a2313facc49af867ae078d4959089088cae3b5c91
Apr 16 17:49:27.178871 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.178854    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl_8575e68a-a384-41be-a97e-b5c008490e72/storage-initializer/1.log"
Apr 16 17:49:27.179204 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.179190    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl_8575e68a-a384-41be-a97e-b5c008490e72/storage-initializer/0.log"
Apr 16 17:49:27.179259 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.179250    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"
Apr 16 17:49:27.268243 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.268184    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8575e68a-a384-41be-a97e-b5c008490e72-kserve-provision-location\") pod \"8575e68a-a384-41be-a97e-b5c008490e72\" (UID: \"8575e68a-a384-41be-a97e-b5c008490e72\") "
Apr 16 17:49:27.268435 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.268413    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8575e68a-a384-41be-a97e-b5c008490e72-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "8575e68a-a384-41be-a97e-b5c008490e72" (UID: "8575e68a-a384-41be-a97e-b5c008490e72"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 16 17:49:27.369052 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.369027    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8575e68a-a384-41be-a97e-b5c008490e72-kserve-provision-location\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 17:49:27.386939 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.386919    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl_8575e68a-a384-41be-a97e-b5c008490e72/storage-initializer/1.log"
Apr 16 17:49:27.387271 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.387257    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl_8575e68a-a384-41be-a97e-b5c008490e72/storage-initializer/0.log"
Apr 16 17:49:27.387326 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.387292    2569 generic.go:358] "Generic (PLEG): container finished" podID="8575e68a-a384-41be-a97e-b5c008490e72" containerID="33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e" exitCode=1
Apr 16 17:49:27.387368 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.387353    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"
Apr 16 17:49:27.387412 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.387369    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl" event={"ID":"8575e68a-a384-41be-a97e-b5c008490e72","Type":"ContainerDied","Data":"33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e"}
Apr 16 17:49:27.387412 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.387404    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl" event={"ID":"8575e68a-a384-41be-a97e-b5c008490e72","Type":"ContainerDied","Data":"a89be32833bda747399268854f80bdb53f83b6334f7bfb2d32e08bafac4a8e26"}
Apr 16 17:49:27.387510 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.387421    2569 scope.go:117] "RemoveContainer" containerID="33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e"
Apr 16 17:49:27.388468 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.388442    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sxmd/must-gather-wx8bl" event={"ID":"2690d826-d187-4888-86f0-cc71a918e967","Type":"ContainerStarted","Data":"676d29c94f6664a7620b373a2313facc49af867ae078d4959089088cae3b5c91"}
Apr 16 17:49:27.395679 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.395660    2569 scope.go:117] "RemoveContainer" containerID="17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4"
Apr 16 17:49:27.402725 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.402708    2569 scope.go:117] "RemoveContainer" containerID="33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e"
Apr 16 17:49:27.402954 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:49:27.402936    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e\": container with ID starting with 33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e not found: ID does not exist" containerID="33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e"
Apr 16 17:49:27.403012 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.402962    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e"} err="failed to get container status \"33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e\": rpc error: code = NotFound desc = could not find container \"33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e\": container with ID starting with 33cd8f6d43d5e8fb2a237749a4a55411568b2b1c0be940cbffea6a608aca5f6e not found: ID does not exist"
Apr 16 17:49:27.403012 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.402980    2569 scope.go:117] "RemoveContainer" containerID="17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4"
Apr 16 17:49:27.403227 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:49:27.403211    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4\": container with ID starting with 17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4 not found: ID does not exist" containerID="17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4"
Apr 16 17:49:27.403271 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.403231    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4"} err="failed to get container status \"17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4\": rpc error: code = NotFound desc = could not find container \"17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4\": container with ID starting with 17f23af1fbdc579f645fd3e4ab3a8d2ca2232e57886536a3cf880abc57f446e4 not found: ID does not exist"
Apr 16 17:49:27.420309 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.420287    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"]
Apr 16 17:49:27.425587 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.425567    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-s3-tls-serving-fail-predictor-665dfd747c-k6thl"]
Apr 16 17:49:27.713032 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:27.713000    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8575e68a-a384-41be-a97e-b5c008490e72" path="/var/lib/kubelet/pods/8575e68a-a384-41be-a97e-b5c008490e72/volumes"
Apr 16 17:49:32.410491 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:32.410456    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sxmd/must-gather-wx8bl" event={"ID":"2690d826-d187-4888-86f0-cc71a918e967","Type":"ContainerStarted","Data":"7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3"}
Apr 16 17:49:32.410491 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:32.410493    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sxmd/must-gather-wx8bl" event={"ID":"2690d826-d187-4888-86f0-cc71a918e967","Type":"ContainerStarted","Data":"31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798"}
Apr 16 17:49:32.429014 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:32.428963    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4sxmd/must-gather-wx8bl" podStartSLOduration=1.5817583960000001 podStartE2EDuration="6.428948557s" podCreationTimestamp="2026-04-16 17:49:26 +0000 UTC" firstStartedPulling="2026-04-16 17:49:27.078702708 +0000 UTC m=+3705.979454073" lastFinishedPulling="2026-04-16 17:49:31.925892859 +0000 UTC m=+3710.826644234" observedRunningTime="2026-04-16 17:49:32.427034363 +0000 UTC m=+3711.327785747" watchObservedRunningTime="2026-04-16 17:49:32.428948557 +0000 UTC m=+3711.329699941"
Apr 16 17:49:40.765760 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:40.765729    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:49:40.780392 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:40.780368    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:49:40.885658 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:40.885613    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:49:40.890749 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:40.890724    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:49:41.000111 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.000085    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:49:41.008652 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.008628    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:49:41.020264 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.020215    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:49:41.029280 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.029247    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:49:41.042428 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.042407    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:49:41.052578 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.052548    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:49:41.085552 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.085533    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:49:41.094563 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.094544    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:49:41.105503 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.105487    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:49:41.141875 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.141854    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:49:41.150277 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.150257    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:49:41.158681 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.158662    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:49:41.171763 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.171748    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:49:41.180186 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.180171    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:49:41.191371 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.191357    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:49:41.199767 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.199751    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:49:41.230501 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.230486    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:49:41.239090 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.239068    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:49:41.268986 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:41.268971    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:49:43.031327 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.031285    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:49:43.036316 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.036299    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:49:43.124165 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.124141    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:49:43.129736 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.129717    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:49:43.250361 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.250339    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:49:43.259167 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.259145    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:49:43.270626 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.270604    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:49:43.278951 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.278933    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:49:43.290339 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.290290    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:49:43.299194 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.299171    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:49:43.337444 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.337422    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:49:43.345508 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.345491    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:49:43.357058 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.357038    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:49:43.368145 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.368128    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:49:43.380974 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.380957    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:49:43.388393 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.388375    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:49:43.400137 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.400122    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:49:43.408901 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.408887    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:49:43.423057 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.423039    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:49:43.432306 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.432291    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:49:43.464814 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.464776    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:49:43.473617 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.473599    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:49:43.503903 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:43.503884    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:49:45.198901 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.198873    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:49:45.203398 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.203379    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:49:45.297290 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.297267    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:49:45.301607 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.301586    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:49:45.416984 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.416960    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:49:45.426295 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.426273    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:49:45.437178 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.437162    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:49:45.445576 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.445558    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:49:45.457503 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.457457    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:49:45.466352 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.466333    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:49:45.499381 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.499361    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:49:45.508061 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.508042    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:49:45.519589 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.519573    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:49:45.528241 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.528226    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:49:45.540353 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.540336    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:49:45.548085 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.548070    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:49:45.559489 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.559473    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:49:45.568391 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.568374    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:49:45.581111 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.581094    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:49:45.589606 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.589589    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:49:45.621267 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.621244    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:49:45.630120 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.630103    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:49:45.660968 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:45.660950    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:49:47.360877 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.360849    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:49:47.365661 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.365638    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:49:47.457473 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.457442    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:49:47.463118 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.463095    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:49:47.582410 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.582389    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:49:47.591222 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.591200    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:49:47.602583 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.602562    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:49:47.611345 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.611301    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:49:47.622640 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.622621    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:49:47.631279 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.631262    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:49:47.671221 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.671204    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:49:47.680471 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.680457    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:49:47.692992 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.692977    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:49:47.701535 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.701518    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:49:47.714499 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.714471    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:49:47.722639 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.722615    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:49:47.734625 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.734609    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:49:47.743913 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.743894    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:49:47.755616 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.755597    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:49:47.765497 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.765479    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:49:47.800330 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.800311    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:49:47.809910 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.809895    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:49:47.842574 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:47.842559    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:49:49.533214 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.533180    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:49:49.537469 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.537450    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:49:49.622379 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.622351    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:49:49.627090 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.627070    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:49:49.744437 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.744407    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:49:49.753408 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.753389    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:49:49.764755 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.764735    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:49:49.774200 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.774185    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:49:49.788071 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.788028    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:49:49.799996 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.799975    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:49:49.832822 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.832786    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:49:49.841293 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.841277    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:49:49.852054 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.852039    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:49:49.860660 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.860635    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:49:49.872216 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.872199    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:49:49.880230 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.880212    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:49:49.891362 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.891344    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:49:49.899513 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.899497    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:49:49.910421 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.910404    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:49:49.919139 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.919123    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:49:49.949479 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.949462    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:49:49.958334 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.958316    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:49:49.989849 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:49.989834    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:49:51.770284 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:51.770249    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:49:51.776338 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:51.776311    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:49:51.872620 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:51.872600    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:49:51.878684 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:51.878666    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:49:51.998878 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:51.998856    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:49:52.008433 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.008415    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:49:52.020187 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.020169    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:49:52.029151 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.029109    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:49:52.041593 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.041569    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:49:52.050028 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.050013    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:49:52.089856 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.089835    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:49:52.098779 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.098762    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:49:52.113198 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.113181    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:49:52.122293 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.122276    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:49:52.134646 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.134630    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:49:52.143786 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.143773    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:49:52.157528 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.157508    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:49:52.166722 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.166704    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:49:52.178252 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.178231    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:49:52.187234 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.187215    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:49:52.221814 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.221774    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:49:52.231828 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.231811    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:49:52.302400 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:52.302336    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:49:54.164960 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.164935    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:49:54.170775 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.170751    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:49:54.278336 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.278312    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:49:54.283743 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.283722    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:49:54.400954 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.400924    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:49:54.410499 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.410474    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:49:54.426424 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.426369    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:49:54.437873 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.437850    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:49:54.448934 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.448912    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:49:54.457475 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.457432    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:49:54.493429 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.493406    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:49:54.506248 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.506233    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:49:54.521519 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.521470    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:49:54.534231 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.534199    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:49:54.549189 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.549172    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:49:54.571910 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.571883    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:49:54.587188 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.587130    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:49:54.601606 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.601585    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:49:54.614927 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.614902    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:49:54.625656 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.625640    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:49:54.664090 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.664072    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:49:54.676123 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.676105    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:49:54.722064 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:54.722016    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:49:56.507089 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.507065    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:49:56.513119 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.513098    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:49:56.614589 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.614563    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:49:56.619717 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.619698    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:49:56.771077 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.771017    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:49:56.781739 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.781716    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:49:56.794712 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.794689    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:49:56.808586 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.808565    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:49:56.823158 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.823141    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:49:56.833075 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.833061    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:49:56.870449 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.870431    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:49:56.880769 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.880744    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:49:56.893679 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.893646    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:49:56.902620 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.902601    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:49:56.915442 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.915426    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:49:56.924302 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.924281    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:49:56.936612 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.936596    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:49:56.947227 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.947209    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:49:56.961003 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.960986    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:49:56.972499 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:56.972480    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:49:57.012524 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:57.012506    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:49:57.024025 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:57.023982    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:49:57.059910 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:57.059891    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:49:58.841349 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:58.841323    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:49:58.848133 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:58.848110    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:49:58.937290 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:58.937262    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:49:58.943110 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:58.943087    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:49:59.109851 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.109776    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:49:59.120856 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.120837    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:49:59.137881 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.137854    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:49:59.146678 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.146660    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:49:59.158289 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.158272    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:49:59.167662 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.167646    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:49:59.204788 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.204753    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:49:59.215621 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.215588    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:49:59.228706 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.228689    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:49:59.238256 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.238239    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:49:59.250787 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.250771    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:49:59.259101 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.259085    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:49:59.271018 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.271002    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:49:59.281748 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.281732    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:49:59.295297 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.295282    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:49:59.307704 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.307682    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:49:59.347411 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.347395    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:49:59.360969 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.360927    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:49:59.402411 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:49:59.402388    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:01.231929 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.231899    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:01.238435 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.238413    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:01.350107 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.350077    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:01.357894 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.357876    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:01.490054 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.489990    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:01.500033 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.500014    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:01.513273 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.513254    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:01.523529 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.523507    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:01.537707 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.537689    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:01.551472 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.551457    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:01.589721 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.589700    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:01.599349 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.599313    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:01.612845 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.612827    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:01.622926 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.622908    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:01.635987 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.635972    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:01.644644 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.644623    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:01.657369 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.657346    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:01.667420 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.667405    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:01.680414 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.680398    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:01.691022 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.691007    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:01.727215 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.727195    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:01.737419 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.737404    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:01.774349 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:01.774300    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:03.544857 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.544831    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:03.558039 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.558018    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:03.653808 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.653782    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:03.660499 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.660480    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:03.786362 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.786340    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:03.795497 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.795437    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:03.807118 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.807099    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:03.815604 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.815589    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:03.826980 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.826966    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:03.835729 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.835713    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:03.867885 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.867866    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:03.876601 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.876587    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:03.889695 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.889681    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:03.900387 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.900371    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:03.914724 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.914702    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:03.924915 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.924898    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:03.936457 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.936442    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:03.950081 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.950062    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:03.962606 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.962591    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:03.971632 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:03.971613    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:04.019039 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:04.019019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:04.030363 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:04.030345    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:04.067606 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:04.067587    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:05.795173 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:05.795144    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:05.799960 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:05.799941    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:05.894385 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:05.894361    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:05.899370 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:05.899352    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:06.019199 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.019174    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:06.028956 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.028938    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:06.044214 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.044192    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:06.053533 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.053513    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:06.065880 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.065861    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:06.076510 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.076494    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:06.116018 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.115996    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:06.128658 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.128633    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:06.142953 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.142932    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:06.152524 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.152507    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:06.167476 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.167459    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:06.176156 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.176141    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:06.188103 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.188085    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:06.200157 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.200142    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:06.212362 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.212349    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:06.221912 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.221887    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:06.256366 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.256350    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:06.265742 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.265722    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:06.297978 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:06.297961    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:08.045570 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.045541    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:08.050815 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.050782    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:08.142476 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.142451    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:08.147463 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.147442    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:08.267146 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.267126    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:08.278061 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.278041    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:08.291381 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.291362    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:08.300324 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.300269    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:08.315244 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.315229    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:08.325179 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.325159    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:08.360161 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.360142    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:08.375867 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.375849    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:08.388711 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.388692    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:08.404483 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.404468    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:08.417382 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.417363    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:08.425540 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.425524    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:08.437999 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.437981    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:08.455106 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.455089    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:08.467206 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.467185    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:08.476868 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.476853    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:08.512938 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.512922    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:08.522489 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.522473    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:08.554639 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:08.554620    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:10.278077 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.278046    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:10.282390 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.282370    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:10.366625 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.366604    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:10.371545 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.371529    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:10.502709 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.502676    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:10.510845 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.510825    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:10.522092 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.522074    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:10.529736 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.529693    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:10.540705 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.540674    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:10.549081 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.549061    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:10.580267 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.580248    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:10.589137 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.589118    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:10.600300 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.600285    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:10.610573 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.610558    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:10.622696 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.622669    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:10.630554 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.630523    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:10.641719 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.641686    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:10.650692 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.650673    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:10.661464 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.661448    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:10.672882 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.672866    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:10.705752 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.705719    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:10.714436 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.714414    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:10.743464 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:10.743442    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:12.533339 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.533313    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:12.540325 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.540294    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:12.668092 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.668066    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:12.675294 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.675272    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:12.839743 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.839722    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:12.853920 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.853874    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:12.866688 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.866662    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:12.878656 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.878641    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:12.891911 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.891893    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:12.904293 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.904270    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:12.945058 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.945039    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:12.957903 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.957883    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:12.976383 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.976354    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:12.988459 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:12.988419    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:13.005149 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:13.005119    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:13.013319 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:13.013299    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:13.031762 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:13.031739    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:13.047424 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:13.047407    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:13.063734 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:13.063714    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:13.077966 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:13.077946    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:13.123662 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:13.123605    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:13.133518 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:13.133496    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:13.166518 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:13.166502    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:14.888941 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:14.888913    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:14.893486 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:14.893464    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:14.985098 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:14.985060    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:14.989825 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:14.989735    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:15.101734 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.101680    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:15.110525 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.110506    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:15.122079 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.122061    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:15.130309 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.130292    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:15.141143 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.141125    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:15.150490 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.150441    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:15.182380 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.182364    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:15.191290 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.191275    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:15.203305 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.203290    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:15.212626 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.212607    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:15.224540 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.224523    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:15.232831 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.232817    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:15.244224 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.244183    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:15.253737 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.253723    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:15.265118 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.265099    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:15.273765 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.273750    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:15.349512 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.349467    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:15.366407 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.366380    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:15.401134 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:15.401111    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:17.129730 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.129705    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:17.134519 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.134498    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:17.223866 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.223832    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:17.228459 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.228440    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:17.353721 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.353686    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:17.362950 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.362930    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:17.374814 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.374778    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:17.384131 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.384088    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:17.395681 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.395659    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:17.405583 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.405557    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:17.440275 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.440259    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:17.448761 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.448746    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:17.460446 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.460431    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:17.468744 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.468725    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:17.481293 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.481275    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:17.489394 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.489377    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:17.500858 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.500817    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:17.509746 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.509729    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:17.521032 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.521002    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:17.530136 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.530118    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:17.561624 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.561597    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:17.570177 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.570159    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:17.601353 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:17.601332    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:19.307340 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.307309    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:19.311791 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.311773    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:19.399882 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.399857    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:19.404274 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.404250    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:19.519454 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.519418    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:19.528186 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.528163    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:19.539886 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.539864    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:19.547840 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.547814    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:19.559192 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.559151    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:19.567688 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.567672    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:19.599775 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.599756    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:19.609192 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.609176    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:19.619765 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.619748    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:19.628423 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.628409    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:19.640003 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.639986    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:19.648596 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.648575    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:19.659716 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.659702    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:19.668176 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.668152    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:19.679143 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.679125    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:19.691523 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.691500    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:19.726782 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.726763    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:19.736056 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.736040    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:19.770105 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:19.770084    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:21.495620 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.495594    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:21.500316 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.500297    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:21.594408 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.594383    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:21.599360 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.599340    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:21.719323 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.719296    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:21.728349 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.728329    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:21.739890 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.739873    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:21.748756 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.748715    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:21.760690 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.760672    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:21.769395 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.769381    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:21.806335 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.806310    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:21.816540 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.816524    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:21.828994 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.828978    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:21.838331 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.838311    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:21.851372 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.851355    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:21.859608 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.859582    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:21.871471 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.871436    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:21.880608 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.880581    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:21.892322 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.892286    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:21.901884 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.901859    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:21.935258 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.935240    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:21.944357 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.944340    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:21.977306 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:21.977289    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:23.698941 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:23.698910    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:23.703994 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:23.703976    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:23.793904 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:23.793877    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:23.798330 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:23.798300    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:23.917024 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:23.916976    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:23.926754 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:23.926734    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:23.943708 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:23.943684    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:23.959205 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:23.959148    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:23.972290 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:23.972273    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:23.983233 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:23.983218    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:24.039066 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.039026    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:24.047882 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.047865    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:24.058934 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.058918    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:24.069065 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.069050    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:24.080789 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.080767    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:24.090591 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.090576    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:24.104310 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.104291    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:24.114430 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.114412    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:24.125542 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.125524    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:24.134002 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.133986    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:24.172478 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.172462    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:24.182560 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.182523    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:24.217733 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:24.217683    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:25.911138 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:25.911109    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:25.915761 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:25.915741    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:26.001017 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.000995    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:26.005594 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.005574    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:26.126111 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.126051    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:26.134590 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.134560    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:26.146157 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.146136    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:26.154355 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.154336    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:26.165880 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.165790    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:26.174919 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.174904    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:26.208036 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.208019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:26.216498 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.216481    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:26.227955 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.227939    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:26.236565 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.236547    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:26.250569 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.250547    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:26.258443 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.258425    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:26.269542 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.269525    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:26.278509 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.278494    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:26.289247 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.289231    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:26.297586 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.297570    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:26.329058 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.329040    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:26.338321 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.338305    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:26.368274 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:26.368257    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:28.110273 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.110243    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:28.115049 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.115030    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:28.206017 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.205986    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:28.211449 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.211432    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:28.335749 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.335725    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:28.344344 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.344319    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:28.355080 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.355063    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:28.365884 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.365835    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:28.379917 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.379897    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:28.388541 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.388525    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:28.420657 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.420633    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:28.428891 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.428870    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:28.439684 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.439664    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:28.448614 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.448596    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:28.461966 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.461948    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:28.470286 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.470267    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:28.482040 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.482022    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:28.490490 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.490474    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:28.501212 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.501197    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:28.509612 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.509597    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:28.542835 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.542813    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:28.551945 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.551926    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:28.586157 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:28.586139    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:30.295856 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.295824    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:30.300647 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.300622    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:30.386185 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.386162    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:30.391610 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.391591    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:30.501999 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.501978    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:30.510820 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.510783    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:30.521933 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.521917    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:30.530177 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.530161    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:30.541418 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.541398    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:30.550161 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.550117    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:30.584836 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.584791    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:30.593971 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.593954    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:30.605120 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.605100    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:30.614522 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.614505    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:30.627181 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.627164    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:30.635038 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.635018    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:30.649991 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.649975    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:30.659179 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.659162    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:30.670737 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.670722    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:30.679505 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.679487    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:30.719039 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.719020    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:30.729492 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.729474    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:30.761359 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:30.761339    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:32.459088 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.459053    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:32.463828 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.463785    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:32.557977 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.557950    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:32.563219 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.563200    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:32.678024 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.677998    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:32.686518 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.686498    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:32.697602 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.697584    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:32.706416 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.706399    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:32.717383 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.717328    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:32.725669 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.725646    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:32.757667 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.757646    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:32.784095 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.784076    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:32.795672 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.795648    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:32.804423 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.804401    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:32.816345 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.816325    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:32.824020 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.824000    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:32.834991 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.834976    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:32.843682 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.843666    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:32.854764 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.854748    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:32.863462 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.863445    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:32.897371 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.897340    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:32.906132 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.906111    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:32.936842 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:32.936822    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:34.621740 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.621714    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:34.627219 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.627199    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:34.715526 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.715504    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:34.720378 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.720341    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:34.840630 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.840604    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:34.849858 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.849834    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:34.861971 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.861949    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:34.871158 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.871138    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:34.882917 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.882864    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:34.892416 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.892397    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:34.925237 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.925217    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:34.933888 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.933867    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:34.945790 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.945773    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:34.955157 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.955140    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:34.967921 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.967904    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:34.976236 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.976220    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:34.987524 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.987508    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:34.999632 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:34.999612    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:35.012157 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:35.012142    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:35.021448 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:35.021415    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:35.057454 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:35.057438    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:35.066410 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:35.066387    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:35.097262 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:35.097246    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:36.818661 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:36.818632    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:36.823513 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:36.823492    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:36.910949 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:36.910921    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:36.915915 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:36.915896    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:37.032454 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.032433    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:37.041548 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.041527    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:37.053240 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.053223    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:37.062579 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.062564    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:37.075398 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.075349    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:37.084507 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.084488    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:37.117758 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.117739    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:37.126637 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.126620    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:37.137989 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.137970    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:37.146713 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.146695    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:37.158483 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.158459    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:37.166419 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.166400    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:37.177498 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.177482    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:37.186050 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.186030    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:37.197277 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.197258    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:37.205883 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.205864    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:37.237218 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.237200    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:37.245970 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.245949    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:37.276721 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:37.276699    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:39.004553 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.004526    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:39.009084 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.009065    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:39.096904 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.096878    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:39.101609 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.101590    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:39.216840 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.216814    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:39.226122 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.226099    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:39.238178 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.238156    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:39.247808 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.247776    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:39.259604 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.259551    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:39.268566 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.268545    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:39.300604 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.300580    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:39.308957 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.308941    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:39.320485 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.320464    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:39.329567 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.329551    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:39.344726 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.344705    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:39.352695 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.352678    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:39.364194 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.364179    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:39.373536 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.373514    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:39.384418 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.384402    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:39.393518 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.393492    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:39.425264 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.425242    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:39.434202 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.434185    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:39.466052 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:39.466035    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:41.178962 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.178930    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:41.183820 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.183787    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:41.276520 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.276491    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:41.280920 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.280899    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:41.400064 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.400040    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:41.408832 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.408776    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:41.421184 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.421160    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:41.429432 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.429384    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:41.440719 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.440700    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:41.450039 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.450017    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:41.485078 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.485057    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:41.493523 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.493490    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:41.510208 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.510187    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:41.519169 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.519153    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:41.531375 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.531352    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:41.539888 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.539869    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:41.551250 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.551233    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:41.560140 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.560125    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:41.571675 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.571655    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:41.580234 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.580216    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:41.616971 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.616952    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:41.625861 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.625843    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:41.656341 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:41.656322    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:43.359137 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.359108    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:43.363525 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.363501    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:43.454454 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.454431    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:43.459725 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.459703    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:43.570713 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.570688    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:43.579997 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.579973    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:43.592208 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.592188    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:43.600096 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.600078    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:43.611147 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.611102    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:43.619256 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.619240    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:43.650415 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.650391    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:43.663991 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.663968    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:43.675338 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.675321    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:43.683164 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.683148    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:43.695502 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.695482    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:43.703710 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.703695    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:43.716248 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.716231    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:43.724840 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.724821    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:43.735275 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.735260    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:43.743886 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.743870    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:43.777840 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.777817    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:43.786895 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.786874    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:43.819965 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:43.819946    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:45.535051 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.535018    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:45.539419 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.539400    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:45.624996 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.624964    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:45.629273 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.629241    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:45.742167 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.742140    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:45.750616 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.750595    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:45.762771 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.762752    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:45.772031 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.772010    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:45.786840 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.786781    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:45.795833 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.795812    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:45.826153 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.826134    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:45.834630 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.834609    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:45.847833 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.847813    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:45.856142 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.856123    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:45.868790 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.868770    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:45.877329 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.877313    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:45.888539 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.888524    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:45.897047 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.897026    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:45.909239 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.909216    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:45.920708 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.920691    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:45.957364 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.957345    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:45.965621 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.965604    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:45.997334 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:45.997315    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:47.698314 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:47.698288    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:47.702641 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:47.702623    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:47.790909 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:47.790886    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:47.795593 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:47.795574    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:47.914450 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:47.914420    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:47.923478 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:47.923456    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:47.935346 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:47.935328    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:47.944193 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:47.944171    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:47.955618 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:47.955567    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:47.964378 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:47.964360    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:47.998567 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:47.998545    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:48.014435 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.014411    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:48.036961 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.036936    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:48.050689 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.050668    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:48.079680 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.079651    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:48.088447 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.088428    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:48.099906 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.099876    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:48.108877 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.108862    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:48.119953 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.119937    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:48.128509 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.128495    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:48.168135 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.168108    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:48.176911 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.176888    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:48.208494 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:48.208441    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:49.907196 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:49.907173    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:49.913906 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:49.913885    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:50.001683 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.001648    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:50.006156 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.006134    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:50.118834 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.118789    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:50.127262 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.127242    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:50.138086 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.138066    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:50.146198 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.146182    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:50.157165 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.157148    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:50.167709 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.167661    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:50.200054 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.200035    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:50.208702 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.208684    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:50.219638 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.219623    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:50.228167 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.228151    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:50.242928 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.242903    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:50.250292 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.250273    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:50.261239 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.261221    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:50.269499 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.269480    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:50.280438 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.280418    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:50.288979 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.288959    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:50.329040 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.329004    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:50.336703 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.336681    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:50.367018 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:50.367000    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:52.164627 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.164598    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:52.169310 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.169289    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:52.274070 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.274041    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:52.282513 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.282487    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:52.426208 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.426143    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:52.438357 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.438338    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:52.453263 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.453245    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:52.465618 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.465603    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:52.480965 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.480946    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:52.490480 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.490460    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:52.523342 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.523321    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:52.532035 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.532019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:52.543232 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.543200    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:52.552389 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.552374    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:52.564524 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.564502    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:52.572429 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.572413    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:52.583884 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.583869    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:52.592872 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.592857    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:52.604641 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.604624    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:52.613507 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.613478    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:52.650903 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.650889    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:52.660121 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.660097    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:52.691702 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:52.691656    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:54.364544 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.364520    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:54.369351 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.369327    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:54.452991 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.452968    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:54.457536 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.457520    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:54.564187 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.564165    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:54.572600 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.572583    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:54.583584 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.583566    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:54.591851 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.591835    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:54.606022 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.606002    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:54.614181 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.614165    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:54.646538 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.646494    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:54.654580 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.654561    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:54.665308 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.665292    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:54.673902 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.673886    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:54.685602 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.685579    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:54.696497 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.696479    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:54.708173 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.708146    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:54.717398 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.717380    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:54.728623 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.728605    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:54.737233 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.737209    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:54.772553 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.772528    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:54.781414 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.781398    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:54.814419 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:54.814403    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:56.511582 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.511547    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:56.516021 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.515984    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:56.599849 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.599824    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:56.604671 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.604646    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:56.724310 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.724288    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:56.732603 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.732584    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:56.743296 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.743280    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:56.751292 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.751274    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:56.762122 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.762070    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:56.770701 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.770684    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:56.802182 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.802167    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:56.810573 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.810558    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:56.822134 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.822119    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:56.830754 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.830738    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:56.842542 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.842519    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:56.850204 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.850188    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:56.861268 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.861251    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:56.869842 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.869824    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:56.880891 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.880861    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:56.889460 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.889441    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:56.924277 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.924256    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:56.933137 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.933121    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:56.963590 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:56.963574    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:50:58.665980 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.665936    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:50:58.670695 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.670673    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:50:58.754982 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.754954    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:50:58.759392 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.759372    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:50:58.869850 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.869816    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:50:58.878513 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.878496    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:50:58.889657 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.889635    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:50:58.897973 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.897953    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:50:58.909157 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.909138    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:50:58.918378 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.918329    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:50:58.951060 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.951039    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:50:58.962062 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.962037    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:50:58.973690 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.973675    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:50:58.982769 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.982751    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:50:58.995170 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:58.995150    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:50:59.003499 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:59.003474    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:50:59.024253 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:59.024234    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:50:59.033696 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:59.033681    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:50:59.045188 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:59.045170    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:50:59.054053 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:59.054036    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:50:59.088591 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:59.088563    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:50:59.098206 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:59.098187    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:50:59.129918 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:50:59.129903    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:00.825262 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:00.825235    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:00.830330 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:00.830308    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:00.912477 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:00.912440    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:00.916717 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:00.916696    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:01.020928 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.020904    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:01.029046 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.029029    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:01.042207 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.042184    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:01.050527 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.050507    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:01.060963 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.060946    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:01.069371 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.069357    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:01.102236 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.102185    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:01.110907 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.110890    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:01.121619 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.121605    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:01.129283 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.129267    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:01.140909 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.140881    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:01.148314 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.148299    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:01.159103 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.159085    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:01.167180 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.167164    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:01.177720 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.177702    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:01.185877 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.185862    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:01.217749 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.217732    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:01.225539 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.225525    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:01.253677 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:01.253656    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:02.930505 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:02.930477    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:02.935175 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:02.935154    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:03.023996 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.023957    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:03.028895 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.028870    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:03.144811 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.144773    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:03.153532 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.153506    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:03.165458 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.165441    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:03.174489 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.174474    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:03.186237 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.186193    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:03.195705 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.195689    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:03.231987 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.231967    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:03.241194 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.241175    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:03.253388 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.253368    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:03.269231 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.269209    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:03.282312 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.282288    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:03.290454 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.290438    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:03.301966 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.301945    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:03.311391 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.311374    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:03.322757 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.322742    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:03.331442 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.331426    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:03.364965 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.364948    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:03.373938 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.373924    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:03.414744 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:03.414726    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:05.093594 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.093569    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:05.098286 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.098266    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:05.182170 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.182145    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:05.186679 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.186658    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:05.296719 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.296695    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:05.305030 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.305013    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:05.316933 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.316916    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:05.325143 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.325124    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:05.357789 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.357737    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:05.366316 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.366301    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:05.399811 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.399771    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:05.408357 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.408341    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:05.419917 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.419901    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:05.428101 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.428086    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:05.439971 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.439948    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:05.449021 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.449002    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:05.460405 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.460391    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:05.468910 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.468894    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:05.480076 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.480058    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:05.488398 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.488384    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:05.523659 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.523639    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:05.532151 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.532134    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:05.562021 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:05.562002    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:07.244859 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.244836    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:07.249509 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.249490    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:07.338224 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.338193    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:07.344038 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.344018    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:07.462780 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.462754    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:07.471467 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.471447    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:07.485419 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.485397    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:07.494299 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.494280    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:07.505745 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.505698    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:07.514683 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.514666    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:07.546955 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.546934    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:07.555565 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.555544    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:07.567371 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.567354    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:07.576390 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.576373    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:07.588996 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.588973    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:07.597381 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.597362    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:07.609081 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.609061    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:07.624401 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.624384    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:07.636241 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.636224    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:07.645907 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.645889    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:07.678359 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.678337    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:07.687119 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.687102    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:07.720294 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:07.720277    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:09.434324 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.434295    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:09.441099 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.441080    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:09.529819 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.529774    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:09.534341 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.534311    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:09.645479 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.645452    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:09.654828 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.654777    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:09.666722 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.666696    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:09.675417 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.675390    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:09.688215 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.688135    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:09.697675 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.697649    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:09.730016 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.729993    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:09.739068 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.739045    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:09.750625 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.750590    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:09.759589 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.759564    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:09.772916 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.772890    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:09.781015 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.780992    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:09.792737 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.792711    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:09.804777 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.804752    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:09.816550 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.816523    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:09.824951 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.824924    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:09.856927 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.856898    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:09.865713 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.865688    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:09.899474 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:09.899450    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:11.669165 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.669133    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:11.673987 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.673963    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:11.767029 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.766999    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:11.772078 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.772056    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:11.888420 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.888394    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:11.898369 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.898345    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:11.912987 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.912958    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:11.921903 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.921829    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:11.933505 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.933481    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:11.942626 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.942598    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:11.976372 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.976346    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:11.985593 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.985568    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:11.997725 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:11.997694    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:12.006788 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:12.006763    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:12.020259 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:12.020235    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:12.029024 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:12.029000    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:12.041306 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:12.041282    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:12.050507 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:12.050478    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:12.062854 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:12.062830    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:12.072391 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:12.072365    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:12.116179 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:12.116154    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:12.126038 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:12.126010    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:12.163441 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:12.163417    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:13.936153 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:13.936128    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:13.942048 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:13.942020    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:14.058293 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.058268    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:14.065050 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.065027    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:14.252033 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.251968    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:14.264331 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.264309    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:14.282484 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.282459    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:14.295712 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.295690    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:14.309154 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.309137    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:14.321118 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.321103    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:14.360907 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.360881    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:14.373153 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.373136    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:14.386931 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.386916    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:14.397728 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.397714    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:14.412559 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.412537    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:14.423279 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.423264    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:14.437443 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.437428    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:14.450192 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.450176    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:14.464379 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.464362    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:14.476008 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.475992    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:14.518551 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.518498    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:14.531245 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.531230    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:14.570890 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:14.570872    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:16.351194 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.351163    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:16.356513 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.356488    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:16.450873 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.450841    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:16.456582 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.456553    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:16.576061 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.576034    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:16.585884 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.585858    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:16.599218 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.599196    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:16.608774 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.608694    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:16.620670 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.620633    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:16.634504 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.634478    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:16.669850 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.669822    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:16.679615 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.679588    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:16.691922 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.691897    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:16.701374 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.701349    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:16.715059 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.715028    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:16.724093 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.724066    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:16.736483 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.736457    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:16.745947 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.745921    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:16.760927 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.760902    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:16.770263 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.770236    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:16.808988 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.808955    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:16.819079 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.819052    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:16.857065 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:16.857038    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:18.642255 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.642224    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:18.647107 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.647073    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:18.740928 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.740896    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:18.745912 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.745887    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:18.870047 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.870018    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:18.880395 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.880370    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:18.893305 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.893230    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:18.902815 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.902777    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:18.915325 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.915299    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:18.924951 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.924926    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:18.960753 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.960723    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:18.970112 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.970089    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:18.983940 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.983910    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:18.993657 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:18.993632    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:19.008457 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:19.008424    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:19.017275 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:19.017251    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:19.032160 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:19.032134    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:19.041531 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:19.041496    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:19.054048 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:19.054019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:19.063602 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:19.063568    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:19.101843 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:19.101808    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:19.111133 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:19.111105    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:19.144651 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:19.144570    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:20.946198 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:20.946167    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:20.950937 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:20.950910    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:21.040566 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.040538    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:21.045643 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.045619    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:21.161583 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.161552    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:21.170618 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.170592    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:21.183948 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.183902    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:21.192288 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.192262    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:21.204352 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.204281    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:21.212987 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.212960    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:21.245666 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.245641    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:21.254301 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.254275    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:21.266769 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.266741    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:21.275423 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.275394    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:21.288356 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.288326    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:21.296179 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.296154    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:21.307406 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.307378    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:21.316318 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.316292    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:21.327552 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.327522    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:21.336914 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.336889    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:21.369513 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.369486    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:21.378306 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.378270    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:21.411409 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:21.411384    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:23.170314 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.170274    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:23.175409 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.175386    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:23.275079 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.275050    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:23.280085 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.280062    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:23.400336 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.400307    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:23.409902 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.409876    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:23.425681 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.425604    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:23.435369 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.435341    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:23.448483 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.448447    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:23.457848 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.457822    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:23.492815 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.492781    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:23.503286 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.503261    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:23.516046 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.516016    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:23.525629 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.525605    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:23.542019 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.541968    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:23.553452 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.553419    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:23.566685 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.566656    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:23.576118 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.576085    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:23.588232 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.588206    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:23.598104 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.598079    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:23.630944 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.630915    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:23.640195 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.640171    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:23.675754 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:23.675680    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:25.438237 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.438212    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:25.443178 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.443153    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:25.546951 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.546914    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:25.551684 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.551653    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:25.667585 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.667557    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:25.676548 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.676515    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:25.688232 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.688207    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:25.696348 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.696285    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:25.709633 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.709615    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:25.718280 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.718264    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:25.749170 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.749146    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:25.757314 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.757294    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:25.769257 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.769236    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:25.777838 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.777785    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:25.790163 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.790139    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:25.799918 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.799894    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:25.812347 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.812308    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:25.821932 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.821906    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:25.834707 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.834680    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:25.843687 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.843664    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:25.875406 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.875380    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:25.885911 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.885881    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:25.921522 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:25.921496    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:27.637369 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.637340    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/kserve-container/0.log"
Apr 16 17:51:27.642019 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.641986    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp_5ad07efd-b324-4f93-a649-5cd15175bc0a/storage-initializer/0.log"
Apr 16 17:51:27.728064 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.728024    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/kserve-container/0.log"
Apr 16 17:51:27.732756 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.732734    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b_61d020cf-a9ae-4870-ae47-1424b6a6ba48/storage-initializer/0.log"
Apr 16 17:51:27.854326 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.854303    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/kserve-container/0.log"
Apr 16 17:51:27.863055 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.863036    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-s3-predictor-669df85bbb-v2gs7_0d7c9f56-4bf3-4d3d-b7d4-dfea94ae3322/storage-initializer/0.log"
Apr 16 17:51:27.875543 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.875520    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/kserve-container/0.log"
Apr 16 17:51:27.884751 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.884732    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j_ddd6ca36-f864-4590-acad-c7e3b0ca88e9/storage-initializer/0.log"
Apr 16 17:51:27.896360 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.896318    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/kserve-container/0.log"
Apr 16 17:51:27.905107 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.905091    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj_2be47088-cae2-4fca-8ee7-a6830bc260cb/storage-initializer/0.log"
Apr 16 17:51:27.936512 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.936494    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/kserve-container/0.log"
Apr 16 17:51:27.945384 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.945365    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-predictor-88f6f6cb7-9v5tr_87e4cf4b-343b-4020-8668-4109915a39d4/storage-initializer/0.log"
Apr 16 17:51:27.957134 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.957115    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/kserve-container/0.log"
Apr 16 17:51:27.965413 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.965399    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-tensorflow-runtime-predictor-854bdff69c-25n58_9ae4030d-4e94-4b2c-9d67-b7f9e25e2451/storage-initializer/0.log"
Apr 16 17:51:27.976599 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.976570    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/kserve-container/0.log"
Apr 16 17:51:27.985117 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.985103    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-triton-predictor-85f9f46646-qbbq6_61396d55-de1b-438d-9988-a1a58e30f2b4/storage-initializer/0.log"
Apr 16 17:51:27.996446 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:27.996429    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/kserve-container/0.log"
Apr 16 17:51:28.005168 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:28.005139    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-predictor-6dbc9d6d47-wzbfb_53b723af-5354-4c47-9d53-ec7b8ff55d1a/storage-initializer/0.log"
Apr 16 17:51:28.018087 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:28.018068    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/kserve-container/0.log"
Apr 16 17:51:28.026920 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:28.026906    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-runtime-predictor-687c7765c9-mw2j2_dd7adc61-daa5-4c47-a831-4c3cfa4785e4/storage-initializer/0.log"
Apr 16 17:51:28.059138 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:28.059124    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/kserve-container/0.log"
Apr 16 17:51:28.067531 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:28.067516    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-xgboost-v2-predictor-5db5686f9f-55j7w_65dd09e9-2e2e-4756-8e14-75abbe99f4b1/storage-initializer/0.log"
Apr 16 17:51:28.097777 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:28.097756    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-wc8z9_3582f567-99bb-4b29-910d-79d4b21d3942/kserve-container/0.log"
Apr 16 17:51:29.837379 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:29.837340    2569 generic.go:358] "Generic (PLEG): container finished" podID="2690d826-d187-4888-86f0-cc71a918e967" containerID="31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798" exitCode=0
Apr 16 17:51:29.837841 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:29.837411    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sxmd/must-gather-wx8bl" event={"ID":"2690d826-d187-4888-86f0-cc71a918e967","Type":"ContainerDied","Data":"31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798"}
Apr 16 17:51:29.837841 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:29.837748    2569 scope.go:117] "RemoveContainer" containerID="31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798"
Apr 16 17:51:30.459403 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:30.459371    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4sxmd_must-gather-wx8bl_2690d826-d187-4888-86f0-cc71a918e967/gather/0.log"
Apr 16 17:51:31.166899 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.166854    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dtnls/must-gather-jvmbr"]
Apr 16 17:51:31.167420 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.167400    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8575e68a-a384-41be-a97e-b5c008490e72" containerName="storage-initializer"
Apr 16 17:51:31.167497 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.167424    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8575e68a-a384-41be-a97e-b5c008490e72" containerName="storage-initializer"
Apr 16 17:51:31.167558 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.167544    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="8575e68a-a384-41be-a97e-b5c008490e72" containerName="storage-initializer"
Apr 16 17:51:31.167656 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.167643    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8575e68a-a384-41be-a97e-b5c008490e72" containerName="storage-initializer"
Apr 16 17:51:31.167711 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.167657    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8575e68a-a384-41be-a97e-b5c008490e72" containerName="storage-initializer"
Apr 16 17:51:31.167763 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.167738    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="8575e68a-a384-41be-a97e-b5c008490e72" containerName="storage-initializer"
Apr 16 17:51:31.172118 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.172090    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dtnls/must-gather-jvmbr"
Apr 16 17:51:31.175862 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.175654    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dtnls\"/\"default-dockercfg-zt7d5\""
Apr 16 17:51:31.175862 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.175665    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dtnls\"/\"openshift-service-ca.crt\""
Apr 16 17:51:31.175862 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.175667    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dtnls\"/\"kube-root-ca.crt\""
Apr 16 17:51:31.176260 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.176240    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dtnls/must-gather-jvmbr"]
Apr 16 17:51:31.261405 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.261364    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrphr\" (UniqueName: \"kubernetes.io/projected/3a7acff7-d2a1-415a-91e2-662437451c3a-kube-api-access-zrphr\") pod \"must-gather-jvmbr\" (UID: \"3a7acff7-d2a1-415a-91e2-662437451c3a\") " pod="openshift-must-gather-dtnls/must-gather-jvmbr"
Apr 16 17:51:31.261602 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.261427    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3a7acff7-d2a1-415a-91e2-662437451c3a-must-gather-output\") pod \"must-gather-jvmbr\" (UID: \"3a7acff7-d2a1-415a-91e2-662437451c3a\") " pod="openshift-must-gather-dtnls/must-gather-jvmbr"
Apr 16 17:51:31.362119 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.362079    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3a7acff7-d2a1-415a-91e2-662437451c3a-must-gather-output\") pod \"must-gather-jvmbr\" (UID: \"3a7acff7-d2a1-415a-91e2-662437451c3a\") " pod="openshift-must-gather-dtnls/must-gather-jvmbr"
Apr 16 17:51:31.362297 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.362139    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrphr\" (UniqueName: \"kubernetes.io/projected/3a7acff7-d2a1-415a-91e2-662437451c3a-kube-api-access-zrphr\") pod \"must-gather-jvmbr\" (UID: \"3a7acff7-d2a1-415a-91e2-662437451c3a\") " pod="openshift-must-gather-dtnls/must-gather-jvmbr"
Apr 16 17:51:31.362435 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.362412    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3a7acff7-d2a1-415a-91e2-662437451c3a-must-gather-output\") pod \"must-gather-jvmbr\" (UID: \"3a7acff7-d2a1-415a-91e2-662437451c3a\") " pod="openshift-must-gather-dtnls/must-gather-jvmbr"
Apr 16 17:51:31.369680 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.369647    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrphr\" (UniqueName: \"kubernetes.io/projected/3a7acff7-d2a1-415a-91e2-662437451c3a-kube-api-access-zrphr\") pod \"must-gather-jvmbr\" (UID: \"3a7acff7-d2a1-415a-91e2-662437451c3a\") " pod="openshift-must-gather-dtnls/must-gather-jvmbr"
Apr 16 17:51:31.482163 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.482076    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dtnls/must-gather-jvmbr"
Apr 16 17:51:31.600789 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.600697    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dtnls/must-gather-jvmbr"]
Apr 16 17:51:31.603612 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:51:31.603584    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a7acff7_d2a1_415a_91e2_662437451c3a.slice/crio-335f9abe4890214674e868baa096e758de6e57594533f92dc996f4423d80254a WatchSource:0}: Error finding container 335f9abe4890214674e868baa096e758de6e57594533f92dc996f4423d80254a: Status 404 returned error can't find the container with id 335f9abe4890214674e868baa096e758de6e57594533f92dc996f4423d80254a
Apr 16 17:51:31.846936 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:31.846904    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dtnls/must-gather-jvmbr" event={"ID":"3a7acff7-d2a1-415a-91e2-662437451c3a","Type":"ContainerStarted","Data":"335f9abe4890214674e868baa096e758de6e57594533f92dc996f4423d80254a"}
Apr 16 17:51:32.853589 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:32.853557    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dtnls/must-gather-jvmbr" event={"ID":"3a7acff7-d2a1-415a-91e2-662437451c3a","Type":"ContainerStarted","Data":"94a46c5fb453502486d2947b203941a4ac398363fe7092d9fecd089e0f7062d7"}
Apr 16 17:51:32.853589 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:32.853592    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dtnls/must-gather-jvmbr" event={"ID":"3a7acff7-d2a1-415a-91e2-662437451c3a","Type":"ContainerStarted","Data":"d55fa71fab94eeec88b1949a4bfccf8a7ccab28690f04903c4d017671603df19"}
Apr 16 17:51:32.867505 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:32.867446    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-dtnls/must-gather-jvmbr" podStartSLOduration=1.089919863 podStartE2EDuration="1.867427185s" podCreationTimestamp="2026-04-16 17:51:31 +0000 UTC" firstStartedPulling="2026-04-16 17:51:31.605249171 +0000 UTC m=+3830.506000535" lastFinishedPulling="2026-04-16 17:51:32.382756493 +0000 UTC m=+3831.283507857" observedRunningTime="2026-04-16 17:51:32.866970646 +0000 UTC m=+3831.767722043" watchObservedRunningTime="2026-04-16 17:51:32.867427185 +0000 UTC m=+3831.768178570"
Apr 16 17:51:33.892739 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:33.892711    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lk2fq_4937738a-3c6a-4cd4-a252-3c0653b5b6fd/global-pull-secret-syncer/0.log"
Apr 16 17:51:34.005840 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:34.005790    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-drbvd_9eff2a2f-c317-48bf-af6d-e22e8d69b90d/konnectivity-agent/0.log"
Apr 16 17:51:34.127106 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:34.127081    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-227.ec2.internal_3790cf888bcb006af761d10ed316a9f7/haproxy/0.log"
Apr 16 17:51:36.019305 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.019257    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-4sxmd/must-gather-wx8bl"]
Apr 16 17:51:36.019843 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.019564    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-4sxmd/must-gather-wx8bl" podUID="2690d826-d187-4888-86f0-cc71a918e967" containerName="copy" containerID="cri-o://7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3" gracePeriod=2
Apr 16 17:51:36.023175 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.023144    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-4sxmd/must-gather-wx8bl"]
Apr 16 17:51:36.025260 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.025220    2569 status_manager.go:895] "Failed to get status for pod" podUID="2690d826-d187-4888-86f0-cc71a918e967" pod="openshift-must-gather-4sxmd/must-gather-wx8bl" err="pods \"must-gather-wx8bl\" is forbidden: User \"system:node:ip-10-0-139-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4sxmd\": no relationship found between node 'ip-10-0-139-227.ec2.internal' and this object"
Apr 16 17:51:36.412139 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.412111    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4sxmd_must-gather-wx8bl_2690d826-d187-4888-86f0-cc71a918e967/copy/0.log"
Apr 16 17:51:36.414846 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.414826    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sxmd/must-gather-wx8bl"
Apr 16 17:51:36.417315 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.417264    2569 status_manager.go:895] "Failed to get status for pod" podUID="2690d826-d187-4888-86f0-cc71a918e967" pod="openshift-must-gather-4sxmd/must-gather-wx8bl" err="pods \"must-gather-wx8bl\" is forbidden: User \"system:node:ip-10-0-139-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4sxmd\": no relationship found between node 'ip-10-0-139-227.ec2.internal' and this object"
Apr 16 17:51:36.508509 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.508464    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2690d826-d187-4888-86f0-cc71a918e967-must-gather-output\") pod \"2690d826-d187-4888-86f0-cc71a918e967\" (UID: \"2690d826-d187-4888-86f0-cc71a918e967\") "
Apr 16 17:51:36.508846 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.508576    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxlwx\" (UniqueName: \"kubernetes.io/projected/2690d826-d187-4888-86f0-cc71a918e967-kube-api-access-mxlwx\") pod \"2690d826-d187-4888-86f0-cc71a918e967\" (UID: \"2690d826-d187-4888-86f0-cc71a918e967\") "
Apr 16 17:51:36.516554 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.516509    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2690d826-d187-4888-86f0-cc71a918e967-kube-api-access-mxlwx" (OuterVolumeSpecName: "kube-api-access-mxlwx") pod "2690d826-d187-4888-86f0-cc71a918e967" (UID: "2690d826-d187-4888-86f0-cc71a918e967"). InnerVolumeSpecName "kube-api-access-mxlwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 16 17:51:36.528647 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.528587    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2690d826-d187-4888-86f0-cc71a918e967-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "2690d826-d187-4888-86f0-cc71a918e967" (UID: "2690d826-d187-4888-86f0-cc71a918e967"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 16 17:51:36.609246 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.609209    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxlwx\" (UniqueName: \"kubernetes.io/projected/2690d826-d187-4888-86f0-cc71a918e967-kube-api-access-mxlwx\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 17:51:36.609493 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.609476    2569 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2690d826-d187-4888-86f0-cc71a918e967-must-gather-output\") on node \"ip-10-0-139-227.ec2.internal\" DevicePath \"\""
Apr 16 17:51:36.870896 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.870856    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4sxmd_must-gather-wx8bl_2690d826-d187-4888-86f0-cc71a918e967/copy/0.log"
Apr 16 17:51:36.871250 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.871222    2569 generic.go:358] "Generic (PLEG): container finished" podID="2690d826-d187-4888-86f0-cc71a918e967" containerID="7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3" exitCode=143
Apr 16 17:51:36.871420 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.871405    2569 scope.go:117] "RemoveContainer" containerID="7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3"
Apr 16 17:51:36.871564 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.871548    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sxmd/must-gather-wx8bl"
Apr 16 17:51:36.875342 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.875310    2569 status_manager.go:895] "Failed to get status for pod" podUID="2690d826-d187-4888-86f0-cc71a918e967" pod="openshift-must-gather-4sxmd/must-gather-wx8bl" err="pods \"must-gather-wx8bl\" is forbidden: User \"system:node:ip-10-0-139-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4sxmd\": no relationship found between node 'ip-10-0-139-227.ec2.internal' and this object"
Apr 16 17:51:36.884163 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.884139    2569 scope.go:117] "RemoveContainer" containerID="31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798"
Apr 16 17:51:36.907875 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.907850    2569 scope.go:117] "RemoveContainer" containerID="7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3"
Apr 16 17:51:36.908627 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:51:36.908506    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3\": container with ID starting with 7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3 not found: ID does not exist" containerID="7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3"
Apr 16 17:51:36.908627 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.908548    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3"} err="failed to get container status \"7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3\": rpc error: code = NotFound desc = could not find container \"7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3\": container with ID starting with 7d3b8ed5fa47e9a1b8eea5d8c65149211ae15d68137dbedc7bab97c2fd7d75f3 not found: ID does not exist"
Apr 16 17:51:36.908627 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.908573    2569 scope.go:117] "RemoveContainer" containerID="31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798"
Apr 16 17:51:36.909163 ip-10-0-139-227 kubenswrapper[2569]: E0416 17:51:36.909111    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798\": container with ID starting with 31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798 not found: ID does not exist" containerID="31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798"
Apr 16 17:51:36.909163 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.909139    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798"} err="failed to get container status \"31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798\": rpc error: code = NotFound desc = could not find container \"31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798\": container with ID starting with 31d16a69454b190d4a67494765041984255f336a9da4beb86c730d9e20fed798 not found: ID does not exist"
Apr 16 17:51:36.915257 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:36.915218    2569 status_manager.go:895] "Failed to get status for pod" podUID="2690d826-d187-4888-86f0-cc71a918e967" pod="openshift-must-gather-4sxmd/must-gather-wx8bl" err="pods \"must-gather-wx8bl\" is forbidden: User \"system:node:ip-10-0-139-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4sxmd\": no relationship found between node 'ip-10-0-139-227.ec2.internal' and this object"
Apr 16 17:51:37.716410 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:37.716376    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2690d826-d187-4888-86f0-cc71a918e967" path="/var/lib/kubelet/pods/2690d826-d187-4888-86f0-cc71a918e967/volumes"
Apr 16 17:51:37.891240 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:37.891208    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qz28_9f1312d7-24d4-4f92-9244-ca6e1685be48/node-exporter/0.log"
Apr 16 17:51:37.911582 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:37.911553    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qz28_9f1312d7-24d4-4f92-9244-ca6e1685be48/kube-rbac-proxy/0.log"
Apr 16 17:51:37.929416 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:37.929392    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qz28_9f1312d7-24d4-4f92-9244-ca6e1685be48/init-textfile/0.log"
Apr 16 17:51:41.195930 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.195191    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"]
Apr 16 17:51:41.195930 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.195768    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2690d826-d187-4888-86f0-cc71a918e967" containerName="gather"
Apr 16 17:51:41.195930 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.195787    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2690d826-d187-4888-86f0-cc71a918e967" containerName="gather"
Apr 16 17:51:41.195930 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.195823    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2690d826-d187-4888-86f0-cc71a918e967" containerName="copy"
Apr 16 17:51:41.195930 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.195832    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2690d826-d187-4888-86f0-cc71a918e967" containerName="copy"
Apr 16 17:51:41.195930 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.195926    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="2690d826-d187-4888-86f0-cc71a918e967" containerName="copy"
Apr 16 17:51:41.196689 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.195946    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="2690d826-d187-4888-86f0-cc71a918e967" containerName="gather"
Apr 16 17:51:41.200543 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.200518    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.205685 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.205658    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"]
Apr 16 17:51:41.252933 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.252907    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-proc\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.253082 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.252946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swrmn\" (UniqueName: \"kubernetes.io/projected/ab5d4c77-94bc-4477-a819-04cae02e8cbb-kube-api-access-swrmn\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.253324 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.253229    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-podres\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.253450 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.253371    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-sys\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.253450 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.253436    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-lib-modules\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.354202 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.354154    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swrmn\" (UniqueName: \"kubernetes.io/projected/ab5d4c77-94bc-4477-a819-04cae02e8cbb-kube-api-access-swrmn\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.354394 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.354239    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-podres\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.354394 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.354282    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-sys\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.354394 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.354333    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-lib-modules\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.354394 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.354367    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-proc\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.354638 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.354467    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-proc\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.354830 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.354787    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-sys\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.354963 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.354930    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-lib-modules\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.355133 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.355114    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab5d4c77-94bc-4477-a819-04cae02e8cbb-podres\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.363706 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.363682    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swrmn\" (UniqueName: \"kubernetes.io/projected/ab5d4c77-94bc-4477-a819-04cae02e8cbb-kube-api-access-swrmn\") pod \"perf-node-gather-daemonset-45dxh\" (UID: \"ab5d4c77-94bc-4477-a819-04cae02e8cbb\") " pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.514860 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.514773    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:41.661510 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.661487    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xsmg4_4b383d53-c55b-43dc-865b-bcf9daa5c109/dns/0.log"
Apr 16 17:51:41.679448 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.679423    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xsmg4_4b383d53-c55b-43dc-865b-bcf9daa5c109/kube-rbac-proxy/0.log"
Apr 16 17:51:41.737780 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.737757    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-szz5j_cf7e4bc2-b2b4-4b2f-b0b8-f88edc4b502c/dns-node-resolver/0.log"
Apr 16 17:51:41.849064 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.849012    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"]
Apr 16 17:51:41.851610 ip-10-0-139-227 kubenswrapper[2569]: W0416 17:51:41.851583    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podab5d4c77_94bc_4477_a819_04cae02e8cbb.slice/crio-b89d3d94f19f3bcdf43214178d45e7b2461417b309d218d9319fa1426c07c9fc WatchSource:0}: Error finding container b89d3d94f19f3bcdf43214178d45e7b2461417b309d218d9319fa1426c07c9fc: Status 404 returned error can't find the container with id b89d3d94f19f3bcdf43214178d45e7b2461417b309d218d9319fa1426c07c9fc
Apr 16 17:51:41.895762 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:41.895332    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh" event={"ID":"ab5d4c77-94bc-4477-a819-04cae02e8cbb","Type":"ContainerStarted","Data":"b89d3d94f19f3bcdf43214178d45e7b2461417b309d218d9319fa1426c07c9fc"}
Apr 16 17:51:42.135014 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:42.134940    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k8bx9_e6e03468-e748-4fcf-bc8a-7ee1b325454e/node-ca/0.log"
Apr 16 17:51:42.900623 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:42.900581    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh" event={"ID":"ab5d4c77-94bc-4477-a819-04cae02e8cbb","Type":"ContainerStarted","Data":"6d897c530a6cc32da09b5d6858c350864f21f967da8e24a3421bc136b289a0d8"}
Apr 16 17:51:42.901060 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:42.900765    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:42.916653 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:42.916586    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh" podStartSLOduration=1.916565729 podStartE2EDuration="1.916565729s" podCreationTimestamp="2026-04-16 17:51:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-16 17:51:42.914553582 +0000 UTC m=+3841.815304970" watchObservedRunningTime="2026-04-16 17:51:42.916565729 +0000 UTC m=+3841.817317114"
Apr 16 17:51:43.227960 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:43.227870    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lwxz6_77527e40-fe4f-4ffd-9e9f-6f9daa905db4/serve-healthcheck-canary/0.log"
Apr 16 17:51:43.646216 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:43.646189    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2xd9v_f99c6da4-6e1f-4cf5-9958-749fb93050ce/kube-rbac-proxy/0.log"
Apr 16 17:51:43.664334 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:43.664309    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2xd9v_f99c6da4-6e1f-4cf5-9958-749fb93050ce/exporter/0.log"
Apr 16 17:51:43.682693 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:43.682656    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2xd9v_f99c6da4-6e1f-4cf5-9958-749fb93050ce/extractor/0.log"
Apr 16 17:51:45.727034 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:45.727001    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-6986579898-k2kd8_15c77e11-adaf-476f-af1c-e20b14f29899/manager/0.log"
Apr 16 17:51:45.765556 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:45.765527    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-86f7b4b499-rgkjz_0ad272d7-52d0-49d0-90fc-7305eafef58d/server/0.log"
Apr 16 17:51:46.173167 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:46.173137    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-86cc847c5c-8b2fh_d0c32075-e4ea-4e0d-b9b7-566df0fe2e97/seaweedfs/0.log"
Apr 16 17:51:46.214111 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:46.214080    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-7fd5766db9-8zjpx_33103e6f-fc10-4ea2-a8c4-4ef63a5b48fc/seaweedfs-tls-serving/0.log"
Apr 16 17:51:48.917129 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:48.917103    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dtnls/perf-node-gather-daemonset-45dxh"
Apr 16 17:51:51.198207 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:51.198167    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7mtwf_bce462c6-480f-4662-93cd-1f3623c1ab4e/kube-multus/0.log"
Apr 16 17:51:51.471281 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:51.471249    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzrf9_220bc941-c238-4d62-abcb-aae86d4e0e35/kube-multus-additional-cni-plugins/0.log"
Apr 16 17:51:51.488593 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:51.488568    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzrf9_220bc941-c238-4d62-abcb-aae86d4e0e35/egress-router-binary-copy/0.log"
Apr 16 17:51:51.536069 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:51.536041    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzrf9_220bc941-c238-4d62-abcb-aae86d4e0e35/cni-plugins/0.log"
Apr 16 17:51:51.549256 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:51.549236    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzrf9_220bc941-c238-4d62-abcb-aae86d4e0e35/bond-cni-plugin/0.log"
Apr 16 17:51:51.565623 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:51.565605    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzrf9_220bc941-c238-4d62-abcb-aae86d4e0e35/routeoverride-cni/0.log"
Apr 16 17:51:51.584804 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:51.584772    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzrf9_220bc941-c238-4d62-abcb-aae86d4e0e35/whereabouts-cni-bincopy/0.log"
Apr 16 17:51:51.615012 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:51.614993    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzrf9_220bc941-c238-4d62-abcb-aae86d4e0e35/whereabouts-cni/0.log"
Apr 16 17:51:51.736283 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:51.736225    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t57ts_cffe5d0c-d081-4b1e-b883-472bec4cfc56/network-metrics-daemon/0.log"
Apr 16 17:51:51.751676 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:51.751657    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t57ts_cffe5d0c-d081-4b1e-b883-472bec4cfc56/kube-rbac-proxy/0.log"
Apr 16 17:51:53.089807 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:53.089770    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7xdk_850a1a3c-96d9-47b8-9797-28615fc9806a/ovn-controller/0.log"
Apr 16 17:51:53.122957 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:53.122935    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7xdk_850a1a3c-96d9-47b8-9797-28615fc9806a/ovn-acl-logging/0.log"
Apr 16 17:51:53.138720 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:53.138698    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7xdk_850a1a3c-96d9-47b8-9797-28615fc9806a/kube-rbac-proxy-node/0.log"
Apr 16 17:51:53.155424 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:53.155402    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7xdk_850a1a3c-96d9-47b8-9797-28615fc9806a/kube-rbac-proxy-ovn-metrics/0.log"
Apr 16 17:51:53.174686 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:53.174665    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7xdk_850a1a3c-96d9-47b8-9797-28615fc9806a/northd/0.log"
Apr 16 17:51:53.191517 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:53.191499    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7xdk_850a1a3c-96d9-47b8-9797-28615fc9806a/nbdb/0.log"
Apr 16 17:51:53.208790 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:53.208768    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7xdk_850a1a3c-96d9-47b8-9797-28615fc9806a/sbdb/0.log"
Apr 16 17:51:53.328654 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:53.328631    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7xdk_850a1a3c-96d9-47b8-9797-28615fc9806a/ovnkube-controller/0.log"
Apr 16 17:51:54.276478 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:54.276449    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-c7j5m_172397d5-6eec-4fb9-a90f-18f769743e08/network-check-target-container/0.log"
Apr 16 17:51:55.143153 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:55.143097    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-sl4vz_94f2fbf5-07e0-4121-85c9-882b6a9a4bbd/iptables-alerter/0.log"
Apr 16 17:51:55.778051 ip-10-0-139-227 kubenswrapper[2569]: I0416 17:51:55.778018    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-ljvpw_4ab0c49d-05ab-4c86-a82d-772183938b38/tuned/0.log"