Jun 15 05:46:12.695567 ip-10-0-141-25 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 15 05:46:12.695581 ip-10-0-141-25 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 15 05:46:12.695590 ip-10-0-141-25 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 15 05:46:12.695932 ip-10-0-141-25 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 15 05:46:22.718491 ip-10-0-141-25 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 15 05:46:22.718510 ip-10-0-141-25 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e1b3174c161f441eb03faf4fab874740 --
Jun 15 05:48:39.744363 ip-10-0-141-25 systemd[1]: Starting Kubernetes Kubelet...
Jun 15 05:48:40.168412 ip-10-0-141-25 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 15 05:48:40.168412 ip-10-0-141-25 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 15 05:48:40.168412 ip-10-0-141-25 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 15 05:48:40.168412 ip-10-0-141-25 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 15 05:48:40.168412 ip-10-0-141-25 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 15 05:48:40.170205 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.170125    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 15 05:48:40.175845 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175832    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:40.175845 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175845    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175848    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175852    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175855    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175858    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175862    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175869    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175872    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175874    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175877    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175880    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175882    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175885    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175888    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175891    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175893    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175896    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175908    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175911    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175913    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:40.175917 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175916    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175918    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175921    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175924    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175927    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175929    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175932    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175935    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175937    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175940    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175942    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175945    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175948    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175950    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175952    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175955    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175957    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175960    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175962    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175965    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:40.176413 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175967    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175970    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175972    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175975    2573 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175978    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175982    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175984    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175987    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175989    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.175991    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176000    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176002    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176005    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176007    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176011    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176013    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176016    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176018    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176021    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176023    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:40.176898 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176026    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176029    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176031    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176034    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176038    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176042    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176045    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176048    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176050    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176053    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176055    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176058    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176060    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176063    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176065    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176068    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176070    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176073    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176076    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:40.177398 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176078    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176092    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176094    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176097    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176105    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176107    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176110    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176113    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176116    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176119    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176123    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176125    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176129    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176133    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176136    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176138    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176141    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176144    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176146    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:40.177882 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176872    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176878    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176881    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176885    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176890    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176893    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176896    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176898    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176903    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176906    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176910    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176913    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176916    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176918    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176921    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176924    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176926    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176929    2573 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176932    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:40.178345 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176934    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176938    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176941    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176944    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176946    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176948    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176951    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176953    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176955    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176958    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176960    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176963    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176965    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176967    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176970    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176972    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176974    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176977    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176979    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176982    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:40.178933 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176984    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176986    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176989    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176991    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176994    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176996    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.176999    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177001    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177004    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177007    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177009    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177014    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177018    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177021    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177024    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177026    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177028    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177031    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177033    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177036    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:40.179756 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177038    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177040    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177043    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177047    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177050    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177053    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177055    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177058    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177061    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177064    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177066    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177069    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177071    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177074    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177076    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177097    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177103    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177107    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177112    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177116    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:40.180274 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177119    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177121    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177124    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177127    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177129    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177133    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177136    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177139    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177143    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177146    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177148    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177151    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177153    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177156    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177158    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177161    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177163    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177165    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177168    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177171    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:40.180764 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177535    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177539    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177542    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177545    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177547    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177550    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177552    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177555    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177559    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177562    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177564    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177567    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177570    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177573    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177577    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177581    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177584    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177587    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177590    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177594    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:40.181260 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177597    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177600    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177602    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177605    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177608    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177610    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177613    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177615    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177618    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177620    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177623    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177625    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177628    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177630    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177633    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177635    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177639    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177642    2573 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177645    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:40.181737 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177648    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177651    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177656    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177660    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177663    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177665    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177668    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177670    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177673    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177675    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177677    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177680    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177683    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177685    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177687    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177690    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177692    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177694    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177697    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177699    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:40.182213 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177701    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177704    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177706    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177708    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177711    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177713    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177715    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177718    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177720    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177723    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177725    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177728    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177730    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177733    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177735    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177738    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177740    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177743    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177746    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177748    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:40.182691 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177750    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177754    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177757    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177759    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177762    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177764    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177767    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177769    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177771    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177774    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177776    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177779    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177781    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177783    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177786    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177788    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177791    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177793    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177795    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.177798    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:40.183219 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177871    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177878    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177884    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177888    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177892    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177896    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177900    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177904    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177907    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177909    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177913    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177916    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177919    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177921    2573 flags.go:64] FLAG: --cgroup-root=""
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177924    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177927    2573 flags.go:64] FLAG: --client-ca-file=""
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177929    2573 flags.go:64] FLAG: --cloud-provider="external"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177932    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177936    2573 flags.go:64] FLAG: --cluster-domain=""
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177939    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177942    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177944    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177947    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177951    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 15 05:48:40.183697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177954    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177956    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177959    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177962    2573 flags.go:64] FLAG: --contention-profiling="false"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177965    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177967    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177970    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177973    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177977    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177979    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177982    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177984    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177988    2573 flags.go:64] FLAG: --enable-server="true"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177993    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177996    2573 flags.go:64] FLAG: --event-burst="100"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.177999    2573 flags.go:64] FLAG: --event-qps="50"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178002    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178005    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178008    2573 flags.go:64] FLAG: --eviction-hard=""
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178011    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178014    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178017    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178020    2573 flags.go:64] FLAG: --eviction-soft=""
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178023    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178025    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 15 05:48:40.184294 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178028    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178032    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178035    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178038    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178041    2573 flags.go:64] FLAG: --feature-gates=""
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178047    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178049    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178052    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178055    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178058    2573 flags.go:64] FLAG: --healthz-port="10248"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178061    2573 flags.go:64] FLAG: --help="false"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178064    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178067    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178070    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178072    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178075    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178097    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178100    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178103    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178105    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178111    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178113    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178116    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178120    2573 flags.go:64] FLAG: --kube-reserved=""
Jun 15 05:48:40.185270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178123    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178126    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178129    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178131    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178134    2573 flags.go:64] FLAG: --lock-file=""
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178137    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178139    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178142    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178148    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178150    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178154    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178156    2573 flags.go:64] FLAG: --logging-format="text"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178159    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178162    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178165    2573 flags.go:64] FLAG: --manifest-url=""
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178167    2573 flags.go:64] FLAG: --manifest-url-header=""
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178171    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178174    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178178    2573 flags.go:64] FLAG: --max-pods="110"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178181    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178183    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178186    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178189    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178191    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178194    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 15 05:48:40.186292 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178197    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178203    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178207    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178210    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178213    2573 flags.go:64] FLAG: --pod-cidr=""
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178216    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178222    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178226    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178229    2573 flags.go:64] FLAG: --pods-per-core="0"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178232    2573 flags.go:64] FLAG: --port="10250"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178235    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178238    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0de7f13e95ce7509f"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178241    2573 flags.go:64] FLAG: --qos-reserved=""
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178244    2573 flags.go:64] FLAG: --read-only-port="10255"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178247    2573 flags.go:64] FLAG: --register-node="true"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178249    2573 flags.go:64] FLAG: --register-with-taints=""
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178252    2573 flags.go:64] FLAG: --registry-burst="10"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178255    2573 flags.go:64] FLAG: --registry-qps="5"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178258    2573 flags.go:64] FLAG: --reserved-cpus=""
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178261    2573 flags.go:64] FLAG: --reserved-memory=""
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178265    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178268    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178271    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178274    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178276    2573 flags.go:64] FLAG: --runonce="false"
Jun 15 05:48:40.187198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178279    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178282    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178285    2573 flags.go:64] FLAG: --seccomp-default="false"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178288    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178290    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178293    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178296    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178298    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178301    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178303    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178307    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178310    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178313    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178316    2573 flags.go:64] FLAG: --system-cgroups=""
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178320    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178324    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178327    2573 flags.go:64] FLAG: --tls-cert-file=""
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178330    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178334    2573 flags.go:64] FLAG: --tls-min-version=""
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178336    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178339    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178342    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178344    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178347    2573 flags.go:64] FLAG: --v="2"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178351    2573 flags.go:64] FLAG: --version="false"
Jun 15 05:48:40.187865 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178355    2573 flags.go:64] FLAG: --vmodule=""
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178359    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.178363    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178470    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178473    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178476    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178479    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178481    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178484    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178488    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178491    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178494    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178497    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178500    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178503    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178506    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178509    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178516    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178518    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:40.188987 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178521    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178523    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178527    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178530    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178532    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178535    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178537    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178540    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178542    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178545    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178547    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178550    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178552    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178554    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178557    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178597    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178629    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178633    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178636    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178639    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178641    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:40.189613 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178644    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178647    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178650    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178652    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178729    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178738    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178745    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178752    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178766    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178779    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178788    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178795    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178802    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178812    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178819    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178826    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178832    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178839    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178846    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178853    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:40.190392 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178865    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178872    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178879    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178887    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178893    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178900    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178908    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178933    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178941    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178949    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178955    2573 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178962    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178975    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178982    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178989    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.178995    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179002    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179010    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179016    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179023    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:40.191258 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179029    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179040    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179047    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179055    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179062    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179077    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179104    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179111    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179119    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179127    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179134    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179142    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179149    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179156    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179161    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179165    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179169    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179179    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179184    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179188    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:40.191774 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179193    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.179197    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.179206    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.186688    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.186706    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.187811    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.187830    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187920    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187929    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187934    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187939    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187944    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187949    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187954    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187959    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:40.192475 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187964    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187968    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187973    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187978    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187982    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187986    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187991    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.187996    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188001    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188006    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188013    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188019    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188024    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188029    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188034    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188039    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188044    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188049    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188054    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188058    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:40.192868 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188063    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188067    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188071    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188075    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188098    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188103    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188107    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188111    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188116    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188120    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188124    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188129    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188133    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188137    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188141    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188145    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188149    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188154    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188158    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188163    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:40.193455 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188167    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188171    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188175    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188179    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188183    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188188    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188192    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188196    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188200    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188206    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188212    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188217    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188221    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188226    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188230    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188234    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188239    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188243    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188247    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:40.193929 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188251    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188255    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188259    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188263    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188268    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188271    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188276    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188280    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188285    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188289    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188294    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188298    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188302    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188306    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188310    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188314    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188318    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188323    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188327    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:40.194446 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188331    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188335    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188339    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188343    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188347    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188352    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188356    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188361    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188365    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188369    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188373    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188379    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188384    2573 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.188393    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188579    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:40.194901 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188588    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188593    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188597    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188602    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188606    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188609    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188613    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188619    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188623    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188627    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188631    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188635    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188640    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188644    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188648    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188652    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188658    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188665    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188669    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:40.195297 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188674    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188678    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188683    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188687    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188692    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188697    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188703    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188709    2573 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188713    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188717    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188722    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188725    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188729    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188733    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188737    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188742    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188745    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188750    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188754    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188757    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:40.195762 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188761    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188766    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188771    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188775    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188779    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188784    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188788    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188792    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188796    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188800    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188804    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188809    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188813    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188817    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188821    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188825    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188829    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188834    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188838    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188842    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:40.196322 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188846    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188850    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188854    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188858    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188862    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188866    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188870    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188874    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188878    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188882    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188886    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188890    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188894    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188898    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188903    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188908    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188912    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188916    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188920    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188924    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:40.196815 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188928    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188933    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188937    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188941    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188945    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188952    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188957    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188962    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188967    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188971    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188976    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188980    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188984    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188988    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188992    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188995    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.188999    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.189003    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:40.197331 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:40.189007    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:40.197755 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.189014    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 15 05:48:40.197755 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.189186    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 15 05:48:40.197755 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.191825    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 15 05:48:40.197755 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.193325    2573 server.go:1019] "Starting client certificate rotation"
Jun 15 05:48:40.197755 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.193446    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 15 05:48:40.197755 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.193489    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 15 05:48:40.198438 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.198421    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 15 05:48:40.208949 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.208919    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 15 05:48:40.218376 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.218359    2573 log.go:25] "Validated CRI v1 runtime API"
Jun 15 05:48:40.221422 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.221405    2573 log.go:25] "Validated CRI v1 image API"
Jun 15 05:48:40.222943 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.222835    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 15 05:48:40.228970 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.228946    2573 fs.go:135] Filesystem UUIDs: map[2d138ead-d3af-4310-ae4b-b0607cf125ba:/dev/nvme0n1p4 68108d6e-fdc8-421d-91b7-463903bdbe5f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jun 15 05:48:40.229051 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.228969    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 15 05:48:40.233880 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.233776    2573 manager.go:216] Machine: {Timestamp:2026-06-15 05:48:40.23266677 +0000 UTC m=+0.366840010 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099921 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fc9ecef867489f3e73234db6d303f SystemUUID:ec2fc9ec-ef86-7489-f3e7-3234db6d303f BootID:e1b3174c-161f-441e-b03f-af4fab874740 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6e:f2:bc:e6:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6e:f2:bc:e6:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:93:de:ac:73:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 15 05:48:40.233880 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.233879    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 15 05:48:40.233981 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.233957    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 15 05:48:40.235022 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.234995    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 15 05:48:40.235171 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.235023    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 15 05:48:40.235728 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.235719    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jun 15 05:48:40.235761 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.235731    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jun 15 05:48:40.235761 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.235738    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 15 05:48:40.237132 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.237121    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 15 05:48:40.238277 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.238266    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 15 05:48:40.240481 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.240464    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 15 05:48:40.242165 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.242152    2573 state_mem.go:36] "Initialized new in-memory state store"
Jun 15 05:48:40.242275 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.242266    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 15 05:48:40.242309 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.242295    2573 kubelet.go:486] "Attempting to sync node with API server"
Jun 15 05:48:40.242309 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.242304    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 15 05:48:40.242361 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.242317    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 15 05:48:40.242361 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.242327    2573 kubelet.go:398] "Adding apiserver pod source"
Jun 15 05:48:40.242361 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.242336    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 15 05:48:40.242682 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.242670    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 15 05:48:40.242739 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.242689    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 15 05:48:40.244778 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.244761    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 15 05:48:40.246436 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.246420    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 15 05:48:40.246511 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.246451    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 15 05:48:40.247022 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247009    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 15 05:48:40.247056 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247031    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 15 05:48:40.247056 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247044    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 15 05:48:40.247056 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247053    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 15 05:48:40.247156 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247065    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 15 05:48:40.247156 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247071    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 15 05:48:40.247205 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247175    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 15 05:48:40.247205 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247182    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 15 05:48:40.247205 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247188    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 15 05:48:40.247205 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247193    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 15 05:48:40.247205 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247207    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 15 05:48:40.247332 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247214    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 15 05:48:40.247956 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247946    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 15 05:48:40.247956 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.247956    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 15 05:48:40.251066 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.251052    2573 server.go:1268] "Started kubelet"
Jun 15 05:48:40.251318 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.251237    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 15 05:48:40.251318 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.251285    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 15 05:48:40.251594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.251137    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 15 05:48:40.251922 ip-10-0-141-25 systemd[1]: Started Kubernetes Kubelet.
Jun 15 05:48:40.252993 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.252974    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 15 05:48:40.254909 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.254338    2573 server.go:310] "Adding debug handlers to kubelet server"
Jun 15 05:48:40.258064 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.258020    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 15 05:48:40.258602 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.258219    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 15 05:48:40.258931 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.258908    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 15 05:48:40.259423 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.259389    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 15 05:48:40.261470 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.261454    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 15 05:48:40.261557 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.261471    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 15 05:48:40.261648 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.261630    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:40.261798 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.260796    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-25.ec2.internal.18b92b1a760680ba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-25.ec2.internal,UID:ip-10-0-141-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-25.ec2.internal,},FirstTimestamp:2026-06-15 05:48:40.251023546 +0000 UTC m=+0.385196787,LastTimestamp:2026-06-15 05:48:40.251023546 +0000 UTC m=+0.385196787,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-25.ec2.internal,}"
Jun 15 05:48:40.261935 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.261916    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rg8gd"
Jun 15 05:48:40.262175 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262142    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 15 05:48:40.262271 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262253    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 15 05:48:40.262495 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262274    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 15 05:48:40.262495 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262363    2573 reconstruct.go:97] "Volume reconstruction finished"
Jun 15 05:48:40.262495 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262371    2573 reconciler.go:29] "Reconciler: start to sync state"
Jun 15 05:48:40.262495 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262431    2573 factory.go:55] Registering systemd factory
Jun 15 05:48:40.262495 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262443    2573 factory.go:223] Registration of the systemd container factory successfully
Jun 15 05:48:40.262818 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262795    2573 factory.go:153] Registering CRI-O factory
Jun 15 05:48:40.262818 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262820    2573 factory.go:223] Registration of the crio container factory successfully
Jun 15 05:48:40.262954 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262873    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 15 05:48:40.262954 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262899    2573 factory.go:103] Registering Raw factory
Jun 15 05:48:40.262954 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.262914    2573 manager.go:1196] Started watching for new ooms in manager
Jun 15 05:48:40.263355 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.263325    2573 manager.go:349] Starting recovery of all containers
Jun 15 05:48:40.264780 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.264747    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 15 05:48:40.264780 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.264766    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 15 05:48:40.272014 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.271859    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rg8gd"
Jun 15 05:48:40.273911 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.273890    2573 manager.go:354] Recovery completed
Jun 15 05:48:40.277921 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.277907    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:40.280782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.280767    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:40.280897 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.280795    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:40.280897 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.280805    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:40.281301 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.281289    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 15 05:48:40.281301 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.281301    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 15 05:48:40.281381 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.281315    2573 state_mem.go:36] "Initialized new in-memory state store"
Jun 15 05:48:40.281381 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.281295    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:40.282023 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.282010    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:40.282098 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.282039    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:40.282098 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.282060    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:40.283144 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.283057    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-25.ec2.internal.18b92b1a77cc94df  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-25.ec2.internal,UID:ip-10-0-141-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-25.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-25.ec2.internal,},FirstTimestamp:2026-06-15 05:48:40.280782047 +0000 UTC m=+0.414955288,LastTimestamp:2026-06-15 05:48:40.280782047 +0000 UTC m=+0.414955288,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-25.ec2.internal,}"
Jun 15 05:48:40.283265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.283253    2573 policy_none.go:49] "None policy: Start"
Jun 15 05:48:40.283297 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.283270    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 15 05:48:40.283297 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.283280    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 15 05:48:40.285308 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.285298    2573 policy_none.go:47] "Start"
Jun 15 05:48:40.320705 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.320690    2573 manager.go:337] "Starting Device Plugin manager"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.320720    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.320732    2573 server.go:87] "Starting device plugin registration server"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.320962    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.320977    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.321042    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.321169    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.321179    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.321686    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.321735    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.328966    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.330158    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.330186    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.330203    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.330230    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 15 05:48:40.344863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.332697    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:48:40.422145 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.422068    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:40.423157 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.423136    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:40.423243 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.423167    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:40.423243 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.423177    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:40.423243 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.423198    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.431796 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.431765    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-25.ec2.internal"]
Jun 15 05:48:40.431854 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.431834    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:40.432559 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.432536    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:40.432631 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.432572    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:40.432631 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.432586    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:40.433904 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.433890    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.433943 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.433911    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-25.ec2.internal\": node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:40.434575 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.434564    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:40.434682 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.434671    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.434751 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.434694    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:40.435238 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.435213    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:40.435315 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.435243    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:40.435315 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.435254    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:40.435315 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.435217    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:40.435405 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.435318    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:40.435405 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.435331    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:40.437413 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.437398    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.437489 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.437422    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:40.438437 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.438425    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:40.438495 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.438449    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:40.438495 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.438464    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:40.463756 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.463732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f9d4fb5f805a82d0d8dceeb3e064d11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal\" (UID: \"4f9d4fb5f805a82d0d8dceeb3e064d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.463852 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.463770    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f9d4fb5f805a82d0d8dceeb3e064d11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal\" (UID: \"4f9d4fb5f805a82d0d8dceeb3e064d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.463852 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.463790    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-25.ec2.internal\" not found" node="ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.463852 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.463803    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d5b178b73f320befed2c5f1e6de4004-config\") pod \"kube-apiserver-proxy-ip-10-0-141-25.ec2.internal\" (UID: \"3d5b178b73f320befed2c5f1e6de4004\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.468215 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.468200    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-25.ec2.internal\" not found" node="ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.469874 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.469860    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:40.564341 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.564320    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f9d4fb5f805a82d0d8dceeb3e064d11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal\" (UID: \"4f9d4fb5f805a82d0d8dceeb3e064d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.564472 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.564346    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f9d4fb5f805a82d0d8dceeb3e064d11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal\" (UID: \"4f9d4fb5f805a82d0d8dceeb3e064d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.564472 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.564366    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d5b178b73f320befed2c5f1e6de4004-config\") pod \"kube-apiserver-proxy-ip-10-0-141-25.ec2.internal\" (UID: \"3d5b178b73f320befed2c5f1e6de4004\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.564472 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.564411    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d5b178b73f320befed2c5f1e6de4004-config\") pod \"kube-apiserver-proxy-ip-10-0-141-25.ec2.internal\" (UID: \"3d5b178b73f320befed2c5f1e6de4004\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.564472 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.564433    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f9d4fb5f805a82d0d8dceeb3e064d11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal\" (UID: \"4f9d4fb5f805a82d0d8dceeb3e064d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.564472 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.564436    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f9d4fb5f805a82d0d8dceeb3e064d11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal\" (UID: \"4f9d4fb5f805a82d0d8dceeb3e064d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.570627 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.570611    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:40.670882 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.670856    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:40.766573 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.766504    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.771492 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.771443    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:40.771526 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:40.771487    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:40.871930 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.871898    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:40.972495 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:40.972464    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:41.073068 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:41.073004    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:41.103622 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.103602    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:48:41.173316 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:41.173291    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:41.192612 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.192456    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 15 05:48:41.192612 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.192599    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 15 05:48:41.192797 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.192639    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 15 05:48:41.274406 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:41.274384    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-25.ec2.internal\" not found"
Jun 15 05:48:41.278423 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.278399    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 05:43:40 +0000 UTC" deadline="2028-04-01 12:37:19.12099359 +0000 UTC"
Jun 15 05:48:41.278423 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.278422    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15750h48m37.842574133s"
Jun 15 05:48:41.307885 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:41.307862    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5b178b73f320befed2c5f1e6de4004.slice/crio-a962c314d2fa50abc9515da3e492c0fda1ad29ec9db34c6b57f2435b82205616 WatchSource:0}: Error finding container a962c314d2fa50abc9515da3e492c0fda1ad29ec9db34c6b57f2435b82205616: Status 404 returned error can't find the container with id a962c314d2fa50abc9515da3e492c0fda1ad29ec9db34c6b57f2435b82205616
Jun 15 05:48:41.308637 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:41.308618    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9d4fb5f805a82d0d8dceeb3e064d11.slice/crio-cd6e6ba6e9ed4adcf173747c1c88dcab7e55cc8af91d634768d721f6314d5ce3 WatchSource:0}: Error finding container cd6e6ba6e9ed4adcf173747c1c88dcab7e55cc8af91d634768d721f6314d5ce3: Status 404 returned error can't find the container with id cd6e6ba6e9ed4adcf173747c1c88dcab7e55cc8af91d634768d721f6314d5ce3
Jun 15 05:48:41.314180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.314166    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 05:48:41.333963 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.333884    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-25.ec2.internal" event={"ID":"3d5b178b73f320befed2c5f1e6de4004","Type":"ContainerStarted","Data":"a962c314d2fa50abc9515da3e492c0fda1ad29ec9db34c6b57f2435b82205616"}
Jun 15 05:48:41.334793 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.334775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal" event={"ID":"4f9d4fb5f805a82d0d8dceeb3e064d11","Type":"ContainerStarted","Data":"cd6e6ba6e9ed4adcf173747c1c88dcab7e55cc8af91d634768d721f6314d5ce3"}
Jun 15 05:48:41.368714 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.368690    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:48:41.461968 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.461935    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:41.476210 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.476187    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 15 05:48:41.477183 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.477169    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-25.ec2.internal"
Jun 15 05:48:41.487627 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.487607    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 15 05:48:41.547454 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:41.547431    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:48:42.088156 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.088128    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:48:42.243094 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.243036    2573 apiserver.go:52] "Watching apiserver"
Jun 15 05:48:42.248883 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.248859    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 15 05:48:42.250036 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.250013    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-jhbs2","openshift-network-operator/iptables-alerter-htzfh","openshift-ovn-kubernetes/ovnkube-node-r4jhk","kube-system/global-pull-secret-syncer-rvr6v","kube-system/konnectivity-agent-pt4g7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq","openshift-cluster-node-tuning-operator/tuned-5fnpl","openshift-dns/node-resolver-6znm2","openshift-multus/multus-additional-cni-plugins-fzkqr","openshift-network-diagnostics/network-check-target-bcpdg","kube-system/kube-apiserver-proxy-ip-10-0-141-25.ec2.internal","openshift-image-registry/node-ca-hw222","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal","openshift-multus/multus-c2tf2"]
Jun 15 05:48:42.252528 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.252508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.254656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.254636    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6znm2"
Jun 15 05:48:42.255163 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.255139    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xnm2h\""
Jun 15 05:48:42.255726 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.255709    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:48:42.256841 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.256820    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 15 05:48:42.256994 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.256948    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.260029 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.259536    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 15 05:48:42.260029 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.259834    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c42wb\""
Jun 15 05:48:42.260029 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.259977    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 15 05:48:42.261627 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.261600    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 15 05:48:42.261723 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.261676    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 15 05:48:42.262026 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.262009    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pwps8\""
Jun 15 05:48:42.262157 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.262140    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 15 05:48:42.262235 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.262192    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 15 05:48:42.262301 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.262286    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 15 05:48:42.262355 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.262334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 15 05:48:42.262548 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.262523    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 15 05:48:42.263188 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.263168    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:42.263281 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.263247    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:48:42.265886 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.265867    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:48:42.268965 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.268163    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.268965 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.268175    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w96d2\""
Jun 15 05:48:42.268965 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.268222    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 15 05:48:42.268965 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.268258    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 15 05:48:42.270561 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.270540    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 15 05:48:42.270767 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.270745    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 15 05:48:42.270767 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.270751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.271047 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.270914    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sbs9d\""
Jun 15 05:48:42.271047 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.270915    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 15 05:48:42.271710 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-slash\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.271770 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-sysctl-d\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.271770 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271733    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-systemd\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.271770 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-run\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.271894 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271770    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9hcd\" (UniqueName: \"kubernetes.io/projected/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-kube-api-access-q9hcd\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.271894 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271787    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-etc-openvswitch\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.271894 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271855    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-run-ovn\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.271894 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271889    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272071 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-modprobe-d\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.272071 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271943    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-sysctl-conf\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.272071 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271967    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f488e8ed-c9e0-47ec-941f-5b3ae6b60398-tmp-dir\") pod \"node-resolver-6znm2\" (UID: \"f488e8ed-c9e0-47ec-941f-5b3ae6b60398\") " pod="openshift-dns/node-resolver-6znm2"
Jun 15 05:48:42.272071 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.271984    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-run-systemd\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272071 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272004    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-kubelet\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272071 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-cni-netd\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272071 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272047    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-kubernetes\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.272071 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-tuned\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272109    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-tmp\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-node-log\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272154    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a65ec4b-de31-4506-937e-2c1bfdc83280-kubelet-config\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-sysconfig\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272229    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b5c5615-031e-4df2-a241-f413a6f360a7-ovnkube-script-lib\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272255    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bn2d\" (UniqueName: \"kubernetes.io/projected/f488e8ed-c9e0-47ec-941f-5b3ae6b60398-kube-api-access-6bn2d\") pod \"node-resolver-6znm2\" (UID: \"f488e8ed-c9e0-47ec-941f-5b3ae6b60398\") " pod="openshift-dns/node-resolver-6znm2"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-systemd-units\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-log-socket\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272335    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b5c5615-031e-4df2-a241-f413a6f360a7-ovnkube-config\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272354    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-sys\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-host\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f488e8ed-c9e0-47ec-941f-5b3ae6b60398-hosts-file\") pod \"node-resolver-6znm2\" (UID: \"f488e8ed-c9e0-47ec-941f-5b3ae6b60398\") " pod="openshift-dns/node-resolver-6znm2"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b5c5615-031e-4df2-a241-f413a6f360a7-env-overrides\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272460    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b5c5615-031e-4df2-a241-f413a6f360a7-ovn-node-metrics-cert\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.272475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272479    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:42.273306 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-lib-modules\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.273306 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-run-netns\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.273306 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-var-lib-openvswitch\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.273306 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-run-openvswitch\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.273306 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-cni-bin\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.273306 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272633    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8mmg\" (UniqueName: \"kubernetes.io/projected/0b5c5615-031e-4df2-a241-f413a6f360a7-kube-api-access-s8mmg\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.273306 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a65ec4b-de31-4506-937e-2c1bfdc83280-dbus\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:42.273306 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272682    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-var-lib-kubelet\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.273306 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.272784    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:42.273306 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.272842    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:48:42.273810 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.273783    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 15 05:48:42.273943 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.273925    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wm998\""
Jun 15 05:48:42.274010 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.273995    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 15 05:48:42.274571 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.274545    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 15 05:48:42.274876 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.274858    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 15 05:48:42.275251 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.275236    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-htzfh"
Jun 15 05:48:42.277221 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.277200    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 15 05:48:42.277477 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.277458    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:48:42.277741 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.277715    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 15 05:48:42.277945 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.277847    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 15 05:48:42.278052 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.277927    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l4srl\""
Jun 15 05:48:42.278297 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.278284    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:42.278369 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.278325    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:48:42.280673 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.280658    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.282783 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.282765    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 15 05:48:42.282863 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.282826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hw222"
Jun 15 05:48:42.283016 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.282985    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fqz8g\""
Jun 15 05:48:42.286698 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.286679    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v64lc\""
Jun 15 05:48:42.287499 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.287478    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 15 05:48:42.287499 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.287494    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 15 05:48:42.287648 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.287498    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 15 05:48:42.288166 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.288148    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 15 05:48:42.310572 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.310556    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ll6j6"
Jun 15 05:48:42.318720 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.318700    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ll6j6"
Jun 15 05:48:42.363136 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.363061    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 15 05:48:42.373862 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.373834    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-var-lib-cni-bin\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.373862 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.373861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz4nz\" (UniqueName: \"kubernetes.io/projected/cb97eab8-ac13-4505-aa16-81d0c65b15d4-kube-api-access-mz4nz\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.374007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.373885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52653dba-0e0e-4625-a6ab-c4cd62794b05-host\") pod \"node-ca-hw222\" (UID: \"52653dba-0e0e-4625-a6ab-c4cd62794b05\") " pod="openshift-image-registry/node-ca-hw222"
Jun 15 05:48:42.374007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.373946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-run-ovn\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.373985    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374154 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-sysctl-conf\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.374154 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4wsg\" (UniqueName: \"kubernetes.io/projected/20a6ebad-3d70-4308-a712-b575b7e589b9-kube-api-access-f4wsg\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:42.374154 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374066    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-run-systemd\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374154 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374067    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374154 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374118    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-run-ovn\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374154 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374127    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-registration-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.374154 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374139    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-run-systemd\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374161    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374170    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-sysctl-conf\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f0d67bc6-7933-45b9-85fd-e4428633f6b9-konnectivity-ca\") pod \"konnectivity-agent-pt4g7\" (UID: \"f0d67bc6-7933-45b9-85fd-e4428633f6b9\") " pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374202    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-kubelet\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-cni-netd\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-kubernetes\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374268    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-tmp\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374277    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-cni-netd\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374266    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-kubelet\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374309    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw25z\" (UniqueName: \"kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z\") pod \"network-check-target-bcpdg\" (UID: \"e7f3df42-7203-4da4-b346-c0bea9490657\") " pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374319    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-kubernetes\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374330    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-cnibin\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374360    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb97eab8-ac13-4505-aa16-81d0c65b15d4-cni-binary-copy\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-node-log\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374404    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-node-log\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.374435 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a65ec4b-de31-4506-937e-2c1bfdc83280-kubelet-config\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-sysconfig\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374464    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-sys-fs\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374474    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a65ec4b-de31-4506-937e-2c1bfdc83280-kubelet-config\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374489    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-os-release\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374534    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-sysconfig\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374541    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bn2d\" (UniqueName: \"kubernetes.io/projected/f488e8ed-c9e0-47ec-941f-5b3ae6b60398-kube-api-access-6bn2d\") pod \"node-resolver-6znm2\" (UID: \"f488e8ed-c9e0-47ec-941f-5b3ae6b60398\") " pod="openshift-dns/node-resolver-6znm2"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-systemd-units\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374613    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-systemd-units\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374636    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-sys\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374648    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374654    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-cnibin\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374585    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-var-lib-cni-multus\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-var-lib-kubelet\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.375180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374733    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52653dba-0e0e-4625-a6ab-c4cd62794b05-serviceca\") pod \"node-ca-hw222\" (UID: \"52653dba-0e0e-4625-a6ab-c4cd62794b05\") " pod="openshift-image-registry/node-ca-hw222"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f0d67bc6-7933-45b9-85fd-e4428633f6b9-agent-certs\") pod \"konnectivity-agent-pt4g7\" (UID: \"f0d67bc6-7933-45b9-85fd-e4428633f6b9\") " pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-cni-bin\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374784    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-sys\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-var-lib-kubelet\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-cni-dir\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kgwl\" (UniqueName: \"kubernetes.io/projected/52653dba-0e0e-4625-a6ab-c4cd62794b05-kube-api-access-5kgwl\") pod \"node-ca-hw222\" (UID: \"52653dba-0e0e-4625-a6ab-c4cd62794b05\") " pod="openshift-image-registry/node-ca-hw222"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.374868    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.374937    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret podName:6a65ec4b-de31-4506-937e-2c1bfdc83280 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:42.874913785 +0000 UTC m=+3.009087042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret") pod "global-pull-secret-syncer-rvr6v" (UID: "6a65ec4b-de31-4506-937e-2c1bfdc83280") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374870    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-sysctl-d\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374961    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-sysctl-d\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.374974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9hcd\" (UniqueName: \"kubernetes.io/projected/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-kube-api-access-q9hcd\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375024    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-run-multus-certs\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-etc-kubernetes\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.375782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-etc-openvswitch\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-modprobe-d\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375147    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mqf5\" (UniqueName: \"kubernetes.io/projected/e73934b8-ced9-433a-89e1-68d284ac07c8-kube-api-access-4mqf5\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375167    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-system-cni-dir\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f488e8ed-c9e0-47ec-941f-5b3ae6b60398-tmp-dir\") pod \"node-resolver-6znm2\" (UID: \"f488e8ed-c9e0-47ec-941f-5b3ae6b60398\") " pod="openshift-dns/node-resolver-6znm2"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375256    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzmzj\" (UniqueName: \"kubernetes.io/projected/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-kube-api-access-kzmzj\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375296    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsbxz\" (UniqueName: \"kubernetes.io/projected/a11c9e92-7dee-442d-87ac-03bd54cd910c-kube-api-access-gsbxz\") pod \"iptables-alerter-htzfh\" (UID: \"a11c9e92-7dee-442d-87ac-03bd54cd910c\") " pod="openshift-network-operator/iptables-alerter-htzfh"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375003    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-cni-bin\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-daemon-config\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-tuned\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375349    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-var-lib-kubelet\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a11c9e92-7dee-442d-87ac-03bd54cd910c-host-slash\") pod \"iptables-alerter-htzfh\" (UID: \"a11c9e92-7dee-442d-87ac-03bd54cd910c\") " pod="openshift-network-operator/iptables-alerter-htzfh"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375716    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-modprobe-d\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375716    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-etc-openvswitch\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375753    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-hostroot\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.376594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375771    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f488e8ed-c9e0-47ec-941f-5b3ae6b60398-tmp-dir\") pod \"node-resolver-6znm2\" (UID: \"f488e8ed-c9e0-47ec-941f-5b3ae6b60398\") " pod="openshift-dns/node-resolver-6znm2"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-conf-dir\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375818    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-run-k8s-cni-cncf-io\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b5c5615-031e-4df2-a241-f413a6f360a7-ovnkube-script-lib\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375872    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-log-socket\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375899    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b5c5615-031e-4df2-a241-f413a6f360a7-ovnkube-config\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375921    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-host\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375927    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-log-socket\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f488e8ed-c9e0-47ec-941f-5b3ae6b60398-hosts-file\") pod \"node-resolver-6znm2\" (UID: \"f488e8ed-c9e0-47ec-941f-5b3ae6b60398\") " pod="openshift-dns/node-resolver-6znm2"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375970    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b5c5615-031e-4df2-a241-f413a6f360a7-env-overrides\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.375994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b5c5615-031e-4df2-a241-f413a6f360a7-ovn-node-metrics-cert\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-lib-modules\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376058    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-device-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376071    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-os-release\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376078    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f488e8ed-c9e0-47ec-941f-5b3ae6b60398-hosts-file\") pod \"node-resolver-6znm2\" (UID: \"f488e8ed-c9e0-47ec-941f-5b3ae6b60398\") " pod="openshift-dns/node-resolver-6znm2"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-run-netns\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-var-lib-openvswitch\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.377543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376145    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-run-openvswitch\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8mmg\" (UniqueName: \"kubernetes.io/projected/0b5c5615-031e-4df2-a241-f413a6f360a7-kube-api-access-s8mmg\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376159    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-host\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a65ec4b-de31-4506-937e-2c1bfdc83280-dbus\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376235    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-lib-modules\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-socket-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-system-cni-dir\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376313    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a11c9e92-7dee-442d-87ac-03bd54cd910c-iptables-alerter-script\") pod \"iptables-alerter-htzfh\" (UID: \"a11c9e92-7dee-442d-87ac-03bd54cd910c\") " pod="openshift-network-operator/iptables-alerter-htzfh"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376340    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a65ec4b-de31-4506-937e-2c1bfdc83280-dbus\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-slash\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376390    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-run-netns\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376427    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-run-openvswitch\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376427    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-var-lib-openvswitch\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376459    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-systemd\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376463    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b5c5615-031e-4df2-a241-f413a6f360a7-ovnkube-script-lib\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376490    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-run\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376516    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-socket-dir-parent\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.378359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-run-netns\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.379007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376545    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b5c5615-031e-4df2-a241-f413a6f360a7-host-slash\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.379007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376552    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-systemd\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.379007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.376645    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-run\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.379007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.377032    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b5c5615-031e-4df2-a241-f413a6f360a7-env-overrides\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.379007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.377215    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b5c5615-031e-4df2-a241-f413a6f360a7-ovnkube-config\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.379007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.378141    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-etc-tuned\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.379007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.378189    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-tmp\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.379007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.378882    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b5c5615-031e-4df2-a241-f413a6f360a7-ovn-node-metrics-cert\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.391033 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.390902    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bn2d\" (UniqueName: \"kubernetes.io/projected/f488e8ed-c9e0-47ec-941f-5b3ae6b60398-kube-api-access-6bn2d\") pod \"node-resolver-6znm2\" (UID: \"f488e8ed-c9e0-47ec-941f-5b3ae6b60398\") " pod="openshift-dns/node-resolver-6znm2"
Jun 15 05:48:42.393207 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.393186    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8mmg\" (UniqueName: \"kubernetes.io/projected/0b5c5615-031e-4df2-a241-f413a6f360a7-kube-api-access-s8mmg\") pod \"ovnkube-node-r4jhk\" (UID: \"0b5c5615-031e-4df2-a241-f413a6f360a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.393307 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.393282    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9hcd\" (UniqueName: \"kubernetes.io/projected/5172f1d7-91d4-4b5e-bb02-d64c60d28a49-kube-api-access-q9hcd\") pod \"tuned-5fnpl\" (UID: \"5172f1d7-91d4-4b5e-bb02-d64c60d28a49\") " pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.477172 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-cnibin\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.477172 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-var-lib-cni-multus\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.477353 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477193    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-var-lib-kubelet\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.477353 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477227    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52653dba-0e0e-4625-a6ab-c4cd62794b05-serviceca\") pod \"node-ca-hw222\" (UID: \"52653dba-0e0e-4625-a6ab-c4cd62794b05\") " pod="openshift-image-registry/node-ca-hw222"
Jun 15 05:48:42.477353 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477244    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-cnibin\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.477353 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477290    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-var-lib-cni-multus\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.477353 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477335    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-var-lib-kubelet\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.477576 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f0d67bc6-7933-45b9-85fd-e4428633f6b9-agent-certs\") pod \"konnectivity-agent-pt4g7\" (UID: \"f0d67bc6-7933-45b9-85fd-e4428633f6b9\") " pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:48:42.477638 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477619    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.477688 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-cni-dir\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.477688 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kgwl\" (UniqueName: \"kubernetes.io/projected/52653dba-0e0e-4625-a6ab-c4cd62794b05-kube-api-access-5kgwl\") pod \"node-ca-hw222\" (UID: \"52653dba-0e0e-4625-a6ab-c4cd62794b05\") " pod="openshift-image-registry/node-ca-hw222"
Jun 15 05:48:42.477770 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477704    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.477770 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477727    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-run-multus-certs\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.477770 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477744    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52653dba-0e0e-4625-a6ab-c4cd62794b05-serviceca\") pod \"node-ca-hw222\" (UID: \"52653dba-0e0e-4625-a6ab-c4cd62794b05\") " pod="openshift-image-registry/node-ca-hw222"
Jun 15 05:48:42.477770 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477759    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.477923 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477778    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-cni-dir\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.477923 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-etc-kubernetes\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.477923 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477788    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-etc-kubernetes\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.477923 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477830    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-run-multus-certs\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.477923 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477835    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mqf5\" (UniqueName: \"kubernetes.io/projected/e73934b8-ced9-433a-89e1-68d284ac07c8-kube-api-access-4mqf5\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.477923 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:42.477923 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-system-cni-dir\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzmzj\" (UniqueName: \"kubernetes.io/projected/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-kube-api-access-kzmzj\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.477996    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsbxz\" (UniqueName: \"kubernetes.io/projected/a11c9e92-7dee-442d-87ac-03bd54cd910c-kube-api-access-gsbxz\") pod \"iptables-alerter-htzfh\" (UID: \"a11c9e92-7dee-442d-87ac-03bd54cd910c\") " pod="openshift-network-operator/iptables-alerter-htzfh"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-daemon-config\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a11c9e92-7dee-442d-87ac-03bd54cd910c-host-slash\") pod \"iptables-alerter-htzfh\" (UID: \"a11c9e92-7dee-442d-87ac-03bd54cd910c\") " pod="openshift-network-operator/iptables-alerter-htzfh"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.478056    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-hostroot\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478113    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-conf-dir\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.478125    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs podName:20a6ebad-3d70-4308-a712-b575b7e589b9 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:42.978111313 +0000 UTC m=+3.112284554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs") pod "network-metrics-daemon-jhbs2" (UID: "20a6ebad-3d70-4308-a712-b575b7e589b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478146    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-run-k8s-cni-cncf-io\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478156    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-conf-dir\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-device-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478202    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-os-release\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478230    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-socket-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-system-cni-dir\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478261    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a11c9e92-7dee-442d-87ac-03bd54cd910c-iptables-alerter-script\") pod \"iptables-alerter-htzfh\" (UID: \"a11c9e92-7dee-442d-87ac-03bd54cd910c\") " pod="openshift-network-operator/iptables-alerter-htzfh"
Jun 15 05:48:42.478265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-socket-dir-parent\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478308    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478314    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-run-netns\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478345    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-var-lib-cni-bin\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478349    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-os-release\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478357    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-run-netns\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz4nz\" (UniqueName: \"kubernetes.io/projected/cb97eab8-ac13-4505-aa16-81d0c65b15d4-kube-api-access-mz4nz\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478396    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52653dba-0e0e-4625-a6ab-c4cd62794b05-host\") pod \"node-ca-hw222\" (UID: \"52653dba-0e0e-4625-a6ab-c4cd62794b05\") " pod="openshift-image-registry/node-ca-hw222"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478399    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-run-k8s-cni-cncf-io\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4wsg\" (UniqueName: \"kubernetes.io/projected/20a6ebad-3d70-4308-a712-b575b7e589b9-kube-api-access-f4wsg\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478440    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478453    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-device-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478452    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-registration-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478466    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-socket-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478502    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-registration-dir\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478517    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-system-cni-dir\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.479119 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f0d67bc6-7933-45b9-85fd-e4428633f6b9-konnectivity-ca\") pod \"konnectivity-agent-pt4g7\" (UID: \"f0d67bc6-7933-45b9-85fd-e4428633f6b9\") " pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478545    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-hostroot\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478556    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478584    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw25z\" (UniqueName: \"kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z\") pod \"network-check-target-bcpdg\" (UID: \"e7f3df42-7203-4da4-b346-c0bea9490657\") " pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478598    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-socket-dir-parent\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478603    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52653dba-0e0e-4625-a6ab-c4cd62794b05-host\") pod \"node-ca-hw222\" (UID: \"52653dba-0e0e-4625-a6ab-c4cd62794b05\") " pod="openshift-image-registry/node-ca-hw222"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-cnibin\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb97eab8-ac13-4505-aa16-81d0c65b15d4-cni-binary-copy\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478661    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-sys-fs\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478708    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-sys-fs\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a11c9e92-7dee-442d-87ac-03bd54cd910c-host-slash\") pod \"iptables-alerter-htzfh\" (UID: \"a11c9e92-7dee-442d-87ac-03bd54cd910c\") " pod="openshift-network-operator/iptables-alerter-htzfh"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478815    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-system-cni-dir\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-os-release\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.479052    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a11c9e92-7dee-442d-87ac-03bd54cd910c-iptables-alerter-script\") pod \"iptables-alerter-htzfh\" (UID: \"a11c9e92-7dee-442d-87ac-03bd54cd910c\") " pod="openshift-network-operator/iptables-alerter-htzfh"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.479176    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-os-release\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.479312    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.479918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.479382    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-cnibin\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.480627 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.479380    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.480627 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.478634    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb97eab8-ac13-4505-aa16-81d0c65b15d4-host-var-lib-cni-bin\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.480627 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.479424    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb97eab8-ac13-4505-aa16-81d0c65b15d4-multus-daemon-config\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.480627 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.479495    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e73934b8-ced9-433a-89e1-68d284ac07c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.480627 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.479687    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f0d67bc6-7933-45b9-85fd-e4428633f6b9-konnectivity-ca\") pod \"konnectivity-agent-pt4g7\" (UID: \"f0d67bc6-7933-45b9-85fd-e4428633f6b9\") " pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:48:42.480627 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.479802    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb97eab8-ac13-4505-aa16-81d0c65b15d4-cni-binary-copy\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.480795 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.480631    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f0d67bc6-7933-45b9-85fd-e4428633f6b9-agent-certs\") pod \"konnectivity-agent-pt4g7\" (UID: \"f0d67bc6-7933-45b9-85fd-e4428633f6b9\") " pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:48:42.485228 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.485209    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:42.485344 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.485231    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:42.485344 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.485246    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tw25z for pod openshift-network-diagnostics/network-check-target-bcpdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:42.485344 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.485327    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z podName:e7f3df42-7203-4da4-b346-c0bea9490657 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:42.985311532 +0000 UTC m=+3.119484785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tw25z" (UniqueName: "kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z") pod "network-check-target-bcpdg" (UID: "e7f3df42-7203-4da4-b346-c0bea9490657") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:42.487934 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.487890    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsbxz\" (UniqueName: \"kubernetes.io/projected/a11c9e92-7dee-442d-87ac-03bd54cd910c-kube-api-access-gsbxz\") pod \"iptables-alerter-htzfh\" (UID: \"a11c9e92-7dee-442d-87ac-03bd54cd910c\") " pod="openshift-network-operator/iptables-alerter-htzfh"
Jun 15 05:48:42.488444 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.488415    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kgwl\" (UniqueName: \"kubernetes.io/projected/52653dba-0e0e-4625-a6ab-c4cd62794b05-kube-api-access-5kgwl\") pod \"node-ca-hw222\" (UID: \"52653dba-0e0e-4625-a6ab-c4cd62794b05\") " pod="openshift-image-registry/node-ca-hw222"
Jun 15 05:48:42.488885 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.488857    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4wsg\" (UniqueName: \"kubernetes.io/projected/20a6ebad-3d70-4308-a712-b575b7e589b9-kube-api-access-f4wsg\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:42.488987 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.488967    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mqf5\" (UniqueName: \"kubernetes.io/projected/e73934b8-ced9-433a-89e1-68d284ac07c8-kube-api-access-4mqf5\") pod \"aws-ebs-csi-driver-node-z9pcq\" (UID: \"e73934b8-ced9-433a-89e1-68d284ac07c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.489173 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.489152    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz4nz\" (UniqueName: \"kubernetes.io/projected/cb97eab8-ac13-4505-aa16-81d0c65b15d4-kube-api-access-mz4nz\") pod \"multus-c2tf2\" (UID: \"cb97eab8-ac13-4505-aa16-81d0c65b15d4\") " pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.490039 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.490014    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzmzj\" (UniqueName: \"kubernetes.io/projected/e1bbf341-e51b-4a3b-aeeb-e2f3238296f9-kube-api-access-kzmzj\") pod \"multus-additional-cni-plugins-fzkqr\" (UID: \"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9\") " pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.567311 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.567283    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5fnpl"
Jun 15 05:48:42.576464 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.576442    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:48:42.584216 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.584199    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6znm2"
Jun 15 05:48:42.589868 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.589849    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:48:42.596768 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.596742    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq"
Jun 15 05:48:42.602395 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.602375    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fzkqr"
Jun 15 05:48:42.609215 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.609197    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-htzfh"
Jun 15 05:48:42.616048 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.616002    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c2tf2"
Jun 15 05:48:42.619527 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.619505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hw222"
Jun 15 05:48:42.882601 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.882519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:42.882773 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.882629    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:42.882773 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.882692    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret podName:6a65ec4b-de31-4506-937e-2c1bfdc83280 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:43.882674879 +0000 UTC m=+4.016848127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret") pod "global-pull-secret-syncer-rvr6v" (UID: "6a65ec4b-de31-4506-937e-2c1bfdc83280") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:42.983544 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:42.983511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:42.983705 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.983639    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:42.983705 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:42.983693    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs podName:20a6ebad-3d70-4308-a712-b575b7e589b9 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:43.983680664 +0000 UTC m=+4.117853891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs") pod "network-metrics-daemon-jhbs2" (UID: "20a6ebad-3d70-4308-a712-b575b7e589b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:43.083834 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.083800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw25z\" (UniqueName: \"kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z\") pod \"network-check-target-bcpdg\" (UID: \"e7f3df42-7203-4da4-b346-c0bea9490657\") " pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:43.083980 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:43.083917    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:43.083980 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:43.083930    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:43.083980 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:43.083938    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tw25z for pod openshift-network-diagnostics/network-check-target-bcpdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:43.084106 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:43.083986    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z podName:e7f3df42-7203-4da4-b346-c0bea9490657 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:44.083973478 +0000 UTC m=+4.218146719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw25z" (UniqueName: "kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z") pod "network-check-target-bcpdg" (UID: "e7f3df42-7203-4da4-b346-c0bea9490657") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:43.156623 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:43.156587    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52653dba_0e0e_4625_a6ab_c4cd62794b05.slice/crio-5a1d7573b307585af3563cdb81f77c24f6e5df7df5fc3b6a9c51e26e4ec85db0 WatchSource:0}: Error finding container 5a1d7573b307585af3563cdb81f77c24f6e5df7df5fc3b6a9c51e26e4ec85db0: Status 404 returned error can't find the container with id 5a1d7573b307585af3563cdb81f77c24f6e5df7df5fc3b6a9c51e26e4ec85db0
Jun 15 05:48:43.157893 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:43.157863    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5c5615_031e_4df2_a241_f413a6f360a7.slice/crio-861e6c172e8b9f611be894767d3518eedda030ca372d336863fbfe17eaedcd45 WatchSource:0}: Error finding container 861e6c172e8b9f611be894767d3518eedda030ca372d336863fbfe17eaedcd45: Status 404 returned error can't find the container with id 861e6c172e8b9f611be894767d3518eedda030ca372d336863fbfe17eaedcd45
Jun 15 05:48:43.159543 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:43.159522    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73934b8_ced9_433a_89e1_68d284ac07c8.slice/crio-a03f30e5e37e034da854e23d6854abf2202e9fcc575bff4823f6a4cc4ad95ac9 WatchSource:0}: Error finding container a03f30e5e37e034da854e23d6854abf2202e9fcc575bff4823f6a4cc4ad95ac9: Status 404 returned error can't find the container with id a03f30e5e37e034da854e23d6854abf2202e9fcc575bff4823f6a4cc4ad95ac9
Jun 15 05:48:43.162724 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:43.162700    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf488e8ed_c9e0_47ec_941f_5b3ae6b60398.slice/crio-1fadff5dce2c489785bebe829fc1c1759c8432ec1107f940147703bac33d6825 WatchSource:0}: Error finding container 1fadff5dce2c489785bebe829fc1c1759c8432ec1107f940147703bac33d6825: Status 404 returned error can't find the container with id 1fadff5dce2c489785bebe829fc1c1759c8432ec1107f940147703bac33d6825
Jun 15 05:48:43.165125 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:43.165097    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d67bc6_7933_45b9_85fd_e4428633f6b9.slice/crio-5e230d47b89ff0d5945fed7ab4761767c4432d4f56357a0be3625e8edb794cd6 WatchSource:0}: Error finding container 5e230d47b89ff0d5945fed7ab4761767c4432d4f56357a0be3625e8edb794cd6: Status 404 returned error can't find the container with id 5e230d47b89ff0d5945fed7ab4761767c4432d4f56357a0be3625e8edb794cd6
Jun 15 05:48:43.166042 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:43.166017    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1bbf341_e51b_4a3b_aeeb_e2f3238296f9.slice/crio-786ed2aeae5186e362b036f13cf8a75dfad598838aa37976309bd849ed16fb0a WatchSource:0}: Error finding container 786ed2aeae5186e362b036f13cf8a75dfad598838aa37976309bd849ed16fb0a: Status 404 returned error can't find the container with id 786ed2aeae5186e362b036f13cf8a75dfad598838aa37976309bd849ed16fb0a
Jun 15 05:48:43.169127 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:48:43.167978    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb97eab8_ac13_4505_aa16_81d0c65b15d4.slice/crio-4731d93de6c404a44d126eab402e376efb1f527ec3c6a96cf3c1500ed6c07928 WatchSource:0}: Error finding container 4731d93de6c404a44d126eab402e376efb1f527ec3c6a96cf3c1500ed6c07928: Status 404 returned error can't find the container with id 4731d93de6c404a44d126eab402e376efb1f527ec3c6a96cf3c1500ed6c07928
Jun 15 05:48:43.322067 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.321912    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 05:43:42 +0000 UTC" deadline="2028-01-15 00:31:43.910852115 +0000 UTC"
Jun 15 05:48:43.322067 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.322062    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13890h43m0.588793341s"
Jun 15 05:48:43.339553 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.339523    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-25.ec2.internal" event={"ID":"3d5b178b73f320befed2c5f1e6de4004","Type":"ContainerStarted","Data":"5fbac899c524b84739e35977e4ef0f26910641b0b140803df5d8f66199588c08"}
Jun 15 05:48:43.341625 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.341600    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c2tf2" event={"ID":"cb97eab8-ac13-4505-aa16-81d0c65b15d4","Type":"ContainerStarted","Data":"4731d93de6c404a44d126eab402e376efb1f527ec3c6a96cf3c1500ed6c07928"}
Jun 15 05:48:43.343628 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.343610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-htzfh" event={"ID":"a11c9e92-7dee-442d-87ac-03bd54cd910c","Type":"ContainerStarted","Data":"b567cfa5e6874e7e0cfa1d0737d887114962be0f93b91d80b9131634fb460586"}
Jun 15 05:48:43.344772 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.344749    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzkqr" event={"ID":"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9","Type":"ContainerStarted","Data":"786ed2aeae5186e362b036f13cf8a75dfad598838aa37976309bd849ed16fb0a"}
Jun 15 05:48:43.345899 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.345868    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5fnpl" event={"ID":"5172f1d7-91d4-4b5e-bb02-d64c60d28a49","Type":"ContainerStarted","Data":"f2221c2ba4f96cdf4ca504437d920e96d87adcb7a3863ba7ab6c5ae2b4f1c5fc"}
Jun 15 05:48:43.347048 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.347026    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq" event={"ID":"e73934b8-ced9-433a-89e1-68d284ac07c8","Type":"ContainerStarted","Data":"a03f30e5e37e034da854e23d6854abf2202e9fcc575bff4823f6a4cc4ad95ac9"}
Jun 15 05:48:43.348042 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.348019    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hw222" event={"ID":"52653dba-0e0e-4625-a6ab-c4cd62794b05","Type":"ContainerStarted","Data":"5a1d7573b307585af3563cdb81f77c24f6e5df7df5fc3b6a9c51e26e4ec85db0"}
Jun 15 05:48:43.348993 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.348961    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pt4g7" event={"ID":"f0d67bc6-7933-45b9-85fd-e4428633f6b9","Type":"ContainerStarted","Data":"5e230d47b89ff0d5945fed7ab4761767c4432d4f56357a0be3625e8edb794cd6"}
Jun 15 05:48:43.350290 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.350267    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6znm2" event={"ID":"f488e8ed-c9e0-47ec-941f-5b3ae6b60398","Type":"ContainerStarted","Data":"1fadff5dce2c489785bebe829fc1c1759c8432ec1107f940147703bac33d6825"}
Jun 15 05:48:43.351619 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.351600    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk" event={"ID":"0b5c5615-031e-4df2-a241-f413a6f360a7","Type":"ContainerStarted","Data":"861e6c172e8b9f611be894767d3518eedda030ca372d336863fbfe17eaedcd45"}
Jun 15 05:48:43.356381 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.356344    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-25.ec2.internal" podStartSLOduration=2.356334281 podStartE2EDuration="2.356334281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:43.356174869 +0000 UTC m=+3.490348119" watchObservedRunningTime="2026-06-15 05:48:43.356334281 +0000 UTC m=+3.490507531"
Jun 15 05:48:43.891003 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.890923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:43.891221 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:43.891112    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:43.891221 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:43.891181    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret podName:6a65ec4b-de31-4506-937e-2c1bfdc83280 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:45.891162454 +0000 UTC m=+6.025335705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret") pod "global-pull-secret-syncer-rvr6v" (UID: "6a65ec4b-de31-4506-937e-2c1bfdc83280") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:43.991841 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:43.991792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:43.992024 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:43.991969    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:43.992112 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:43.992028    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs podName:20a6ebad-3d70-4308-a712-b575b7e589b9 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:45.992010219 +0000 UTC m=+6.126183451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs") pod "network-metrics-daemon-jhbs2" (UID: "20a6ebad-3d70-4308-a712-b575b7e589b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:44.092235 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:44.092196    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw25z\" (UniqueName: \"kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z\") pod \"network-check-target-bcpdg\" (UID: \"e7f3df42-7203-4da4-b346-c0bea9490657\") " pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:44.092403 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:44.092356    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:44.092403 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:44.092378    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:44.092403 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:44.092390    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tw25z for pod openshift-network-diagnostics/network-check-target-bcpdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:44.092578 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:44.092446    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z podName:e7f3df42-7203-4da4-b346-c0bea9490657 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:46.092429021 +0000 UTC m=+6.226602266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw25z" (UniqueName: "kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z") pod "network-check-target-bcpdg" (UID: "e7f3df42-7203-4da4-b346-c0bea9490657") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:44.197475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:44.197398    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:48:44.323178 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:44.323136    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 05:43:42 +0000 UTC" deadline="2028-01-13 23:26:58.180415422 +0000 UTC"
Jun 15 05:48:44.323178 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:44.323175    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13865h38m13.857245489s"
Jun 15 05:48:44.332789 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:44.332756    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:44.332928 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:44.332886    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:48:44.333557 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:44.333289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:44.333557 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:44.333396    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:48:44.333557 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:44.333451    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:44.333557 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:44.333508    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:48:44.363750 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:44.363716    2573 generic.go:356] "Generic (PLEG): container finished" podID="4f9d4fb5f805a82d0d8dceeb3e064d11" containerID="99df2af9624b301aa9b9ed1f628c83fb6a8c04edbf9d2681f43a37c4cd1cdb7f" exitCode=0
Jun 15 05:48:44.364656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:44.364630    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal" event={"ID":"4f9d4fb5f805a82d0d8dceeb3e064d11","Type":"ContainerDied","Data":"99df2af9624b301aa9b9ed1f628c83fb6a8c04edbf9d2681f43a37c4cd1cdb7f"}
Jun 15 05:48:45.374719 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:45.374680    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal" event={"ID":"4f9d4fb5f805a82d0d8dceeb3e064d11","Type":"ContainerStarted","Data":"dc4482ad8fa6f24c0935105e4535ca66251b14bad9e9701a6bf8bd99513d1866"}
Jun 15 05:48:45.906265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:45.906228    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:45.906449 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:45.906392    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:45.906510 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:45.906458    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret podName:6a65ec4b-de31-4506-937e-2c1bfdc83280 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:49.906440749 +0000 UTC m=+10.040613992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret") pod "global-pull-secret-syncer-rvr6v" (UID: "6a65ec4b-de31-4506-937e-2c1bfdc83280") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:46.006996 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:46.006956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:46.007182 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:46.007146    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:46.007250 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:46.007216    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs podName:20a6ebad-3d70-4308-a712-b575b7e589b9 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:50.007195678 +0000 UTC m=+10.141368908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs") pod "network-metrics-daemon-jhbs2" (UID: "20a6ebad-3d70-4308-a712-b575b7e589b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:46.107526 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:46.107489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw25z\" (UniqueName: \"kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z\") pod \"network-check-target-bcpdg\" (UID: \"e7f3df42-7203-4da4-b346-c0bea9490657\") " pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:46.107717 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:46.107695    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:46.107717 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:46.107716    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:46.107867 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:46.107729    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tw25z for pod openshift-network-diagnostics/network-check-target-bcpdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:46.107867 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:46.107787    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z podName:e7f3df42-7203-4da4-b346-c0bea9490657 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:50.107768239 +0000 UTC m=+10.241941471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw25z" (UniqueName: "kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z") pod "network-check-target-bcpdg" (UID: "e7f3df42-7203-4da4-b346-c0bea9490657") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:46.331818 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:46.331123    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:46.331818 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:46.331247    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:48:46.331818 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:46.331632    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:46.331818 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:46.331724    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:48:46.332389 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:46.332231    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:46.332389 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:46.332326    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:48:48.331058 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:48.330848    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:48.331058 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:48.330860    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:48.331058 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:48.331014    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:48:48.331686 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:48.331068    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:48:48.331686 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:48.331155    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:48.331686 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:48.331269    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:48:49.939570 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:49.939533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:49.940047 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:49.939708    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:49.940047 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:49.939790    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret podName:6a65ec4b-de31-4506-937e-2c1bfdc83280 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:57.939769146 +0000 UTC m=+18.073942393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret") pod "global-pull-secret-syncer-rvr6v" (UID: "6a65ec4b-de31-4506-937e-2c1bfdc83280") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:50.040344 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:50.040311    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:50.040528 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:50.040443    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:50.040528 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:50.040512    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs podName:20a6ebad-3d70-4308-a712-b575b7e589b9 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:58.040493086 +0000 UTC m=+18.174666318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs") pod "network-metrics-daemon-jhbs2" (UID: "20a6ebad-3d70-4308-a712-b575b7e589b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:50.141267 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:50.141233    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw25z\" (UniqueName: \"kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z\") pod \"network-check-target-bcpdg\" (UID: \"e7f3df42-7203-4da4-b346-c0bea9490657\") " pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:50.141421 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:50.141383    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:50.141421 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:50.141401    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:50.141421 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:50.141413    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tw25z for pod openshift-network-diagnostics/network-check-target-bcpdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:50.141580 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:50.141465    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z podName:e7f3df42-7203-4da4-b346-c0bea9490657 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:58.141447588 +0000 UTC m=+18.275620834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw25z" (UniqueName: "kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z") pod "network-check-target-bcpdg" (UID: "e7f3df42-7203-4da4-b346-c0bea9490657") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:50.333837 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:50.333765    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:50.333977 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:50.333870    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:48:50.333977 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:50.333892    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:50.333977 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:50.333913    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:50.334147 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:50.334008    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:48:50.334147 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:50.334121    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:48:52.331481 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:52.331067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:52.331481 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:52.331067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:52.331481 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:52.331210    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:48:52.331481 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:52.331258    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:52.331481 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:52.331339    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:48:52.331481 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:52.331400    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:48:54.330757 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:54.330723    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:54.331163 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:54.330722    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:54.331163 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:54.330882    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:54.331163 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:54.330844    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:48:54.331163 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:54.330960    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:48:54.331163 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:54.331055    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:48:56.332314 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:56.332284    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:56.332737 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:56.332407    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:48:56.332823 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:56.332754    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:56.332869 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:56.332831    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:48:56.332922 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:56.332903    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:56.333033 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:56.333013    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:48:57.996470 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:57.996375    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:57.996918 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:57.996556    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:57.996918 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:57.996634    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret podName:6a65ec4b-de31-4506-937e-2c1bfdc83280 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:13.996615202 +0000 UTC m=+34.130788444 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret") pod "global-pull-secret-syncer-rvr6v" (UID: "6a65ec4b-de31-4506-937e-2c1bfdc83280") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:58.096928 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:58.096898    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:58.097107 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:58.097059    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:58.097154 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:58.097136    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs podName:20a6ebad-3d70-4308-a712-b575b7e589b9 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:14.097117565 +0000 UTC m=+34.231290802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs") pod "network-metrics-daemon-jhbs2" (UID: "20a6ebad-3d70-4308-a712-b575b7e589b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:58.197773 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:58.197743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw25z\" (UniqueName: \"kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z\") pod \"network-check-target-bcpdg\" (UID: \"e7f3df42-7203-4da4-b346-c0bea9490657\") " pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:58.197944 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:58.197917    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:58.197944 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:58.197938    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:58.198065 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:58.197949    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tw25z for pod openshift-network-diagnostics/network-check-target-bcpdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:58.198065 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:58.198001    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z podName:e7f3df42-7203-4da4-b346-c0bea9490657 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:14.197986105 +0000 UTC m=+34.332159336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw25z" (UniqueName: "kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z") pod "network-check-target-bcpdg" (UID: "e7f3df42-7203-4da4-b346-c0bea9490657") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:58.330546 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:58.330457    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:48:58.330546 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:58.330499    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:48:58.330733 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:48:58.330465    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:48:58.330733 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:58.330592    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:48:58.330733 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:58.330676    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:48:58.330878 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:48:58.330745    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:49:00.332056 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:00.332015    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:00.332535 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:00.332123    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:00.332535 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:00.332136    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:49:00.332535 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:00.332151    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:00.332535 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:00.332236    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:49:00.332535 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:00.332325    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:49:02.331319 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:02.331169    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:02.331749 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:02.331400    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:49:02.331749 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:02.331488    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:02.331749 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:02.331576    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:49:02.331749 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:02.331663    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:02.331749 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:02.331714    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:49:02.408801 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:02.407219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq" event={"ID":"e73934b8-ced9-433a-89e1-68d284ac07c8","Type":"ContainerStarted","Data":"4af019b594cfcb34bf00b28febae4800e6610928d949f19c92f71e55d61c4828"}
Jun 15 05:49:02.408918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:02.408803    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hw222" event={"ID":"52653dba-0e0e-4625-a6ab-c4cd62794b05","Type":"ContainerStarted","Data":"d27e95305ba5282c42f94e8cdd7f3ede85b89c44905218e0379d4d33eb44067f"}
Jun 15 05:49:02.410171 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:02.410148    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pt4g7" event={"ID":"f0d67bc6-7933-45b9-85fd-e4428633f6b9","Type":"ContainerStarted","Data":"971d34ccfe2070b94778c1e8298eff960eabd99ddfcc77c356255587e5f47957"}
Jun 15 05:49:02.411267 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:02.411248    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6znm2" event={"ID":"f488e8ed-c9e0-47ec-941f-5b3ae6b60398","Type":"ContainerStarted","Data":"1809070a29c89c43bf893ec8265e32fbaa27f52a0632f94644d9751189d30e91"}
Jun 15 05:49:02.426639 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:02.426591    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hw222" podStartSLOduration=3.4953711370000002 podStartE2EDuration="22.426577368s" totalImagesPullingTime="18.931206231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:02.42591825 +0000 UTC m=+22.560091500" watchObservedRunningTime="2026-06-15 05:49:02.426577368 +0000 UTC m=+22.560750615"
Jun 15 05:49:02.426762 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:02.426683    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-25.ec2.internal" podStartSLOduration=21.426676664 podStartE2EDuration="21.426676664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:45.39327959 +0000 UTC m=+5.527452842" watchObservedRunningTime="2026-06-15 05:49:02.426676664 +0000 UTC m=+22.560849914"
Jun 15 05:49:02.441563 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:02.441513    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6znm2" podStartSLOduration=3.482382313 podStartE2EDuration="22.441495628s" totalImagesPullingTime="18.959113315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:02.44101935 +0000 UTC m=+22.575192610" watchObservedRunningTime="2026-06-15 05:49:02.441495628 +0000 UTC m=+22.575668879"
Jun 15 05:49:02.462918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:02.462865    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pt4g7" podStartSLOduration=3.540008202 podStartE2EDuration="22.462847364s" totalImagesPullingTime="18.922839162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:02.462359562 +0000 UTC m=+22.596532816" watchObservedRunningTime="2026-06-15 05:49:02.462847364 +0000 UTC m=+22.597020613"
Jun 15 05:49:03.416703 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.416538    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk" event={"ID":"0b5c5615-031e-4df2-a241-f413a6f360a7","Type":"ContainerStarted","Data":"140c8efbbac1257d3aa20b907b64588637f184ff6851890e27c48a700e924386"}
Jun 15 05:49:03.417383 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.416763    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk" event={"ID":"0b5c5615-031e-4df2-a241-f413a6f360a7","Type":"ContainerStarted","Data":"238d5a5fd3415259242cf41524baef49a04db31cdd09e77c0069b4200113f671"}
Jun 15 05:49:03.417383 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.416812    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk" event={"ID":"0b5c5615-031e-4df2-a241-f413a6f360a7","Type":"ContainerStarted","Data":"2c890751094496a8cc09230d79371912c17567832ff7673507aae7cdf87f275b"}
Jun 15 05:49:03.417383 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.416841    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk" event={"ID":"0b5c5615-031e-4df2-a241-f413a6f360a7","Type":"ContainerStarted","Data":"d004d08d853254d4c3e2178152a671ce3d8f5b455c39fe4b8214538480aab3a5"}
Jun 15 05:49:03.418048 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.418025    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c2tf2" event={"ID":"cb97eab8-ac13-4505-aa16-81d0c65b15d4","Type":"ContainerStarted","Data":"0e8847a3f038f45d500a8b7806520d065f49ec62f3a58dfb744c769bc0bb4114"}
Jun 15 05:49:03.420672 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.420653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-htzfh" event={"ID":"a11c9e92-7dee-442d-87ac-03bd54cd910c","Type":"ContainerStarted","Data":"4e622f6f923783951a44513bc5e5ce92995ef8161cb5975cd63eb04e3457b734"}
Jun 15 05:49:03.422277 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.422251    2573 generic.go:356] "Generic (PLEG): container finished" podID="e1bbf341-e51b-4a3b-aeeb-e2f3238296f9" containerID="2ad0b2dff9e6b5eb11ec82fe98dd654cae0a57076f911c197eb4271432895ec6" exitCode=0
Jun 15 05:49:03.422376 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.422331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzkqr" event={"ID":"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9","Type":"ContainerDied","Data":"2ad0b2dff9e6b5eb11ec82fe98dd654cae0a57076f911c197eb4271432895ec6"}
Jun 15 05:49:03.423767 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.423747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5fnpl" event={"ID":"5172f1d7-91d4-4b5e-bb02-d64c60d28a49","Type":"ContainerStarted","Data":"a4ffa8cd518e0a037cd81e87964ed5061664bdf2eb782f8b4b288cb266e1872d"}
Jun 15 05:49:03.436290 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.436244    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c2tf2" podStartSLOduration=4.443908858 podStartE2EDuration="23.436233122s" totalImagesPullingTime="18.992324264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:03.43614854 +0000 UTC m=+23.570321792" watchObservedRunningTime="2026-06-15 05:49:03.436233122 +0000 UTC m=+23.570406371"
Jun 15 05:49:03.474611 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.474555    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5fnpl" podStartSLOduration=4.512535064 podStartE2EDuration="23.474540958s" totalImagesPullingTime="18.962005894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:03.474185258 +0000 UTC m=+23.608358507" watchObservedRunningTime="2026-06-15 05:49:03.474540958 +0000 UTC m=+23.608714207"
Jun 15 05:49:03.659061 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:03.659028    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 15 05:49:04.333374 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:04.333335    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:04.333721 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:04.333451    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:49:04.333831 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:04.333807    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:04.333971 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:04.333912    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:49:04.333971 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:04.333968    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:04.334113 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:04.334025    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:49:04.334210 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:04.334134    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T05:49:03.659052202Z","UUID":"fc9f84d4-9c16-4ffa-afc5-3d3e22eac4cd","Handler":null,"Name":"","Endpoint":""}
Jun 15 05:49:04.336208 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:04.336190    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 15 05:49:04.336313 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:04.336233    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 15 05:49:04.428460 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:04.428358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq" event={"ID":"e73934b8-ced9-433a-89e1-68d284ac07c8","Type":"ContainerStarted","Data":"c0d8218a26e8c3a8bb17b27f100403217a6b127ade01a0c39e000723ef6d86c8"}
Jun 15 05:49:04.433175 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:04.433141    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk" event={"ID":"0b5c5615-031e-4df2-a241-f413a6f360a7","Type":"ContainerStarted","Data":"04e4efb88a6a90aa44f2a51269f2bdda8cda3b59387d9351e3aec24352af5ac1"}
Jun 15 05:49:04.433315 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:04.433229    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk" event={"ID":"0b5c5615-031e-4df2-a241-f413a6f360a7","Type":"ContainerStarted","Data":"71b0881d1ac10594681e26d0c57c438e53429f91e89a641e754247abd69f90ab"}
Jun 15 05:49:04.457170 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:04.457113    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-htzfh" podStartSLOduration=5.502699994 podStartE2EDuration="24.457070898s" totalImagesPullingTime="18.954370904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:04.456302983 +0000 UTC m=+24.590476233" watchObservedRunningTime="2026-06-15 05:49:04.457070898 +0000 UTC m=+24.591244151"
Jun 15 05:49:05.437428 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:05.437391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq" event={"ID":"e73934b8-ced9-433a-89e1-68d284ac07c8","Type":"ContainerStarted","Data":"4711bc28814dd7cbd8fcb4528e2903995b9cbb100e5a67c7b80ff82462a5ae06"}
Jun 15 05:49:05.457618 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:05.457560    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z9pcq" podStartSLOduration=8.517848833 podStartE2EDuration="25.457542654s" totalImagesPullingTime="16.939693821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:05.457388412 +0000 UTC m=+25.591561661" watchObservedRunningTime="2026-06-15 05:49:05.457542654 +0000 UTC m=+25.591715905"
Jun 15 05:49:06.330887 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:06.330672    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:06.331061 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:06.330997    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:49:06.331448 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:06.331422    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:06.331567 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:06.331521    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:49:06.331631 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:06.331581    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:06.331685 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:06.331645    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:49:06.368101 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:06.368059    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:49:06.940650 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:06.940618    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:49:06.941268 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:06.941249    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:49:07.441450 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:07.441425    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pt4g7"
Jun 15 05:49:08.331013 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:08.330991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:08.331807 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:08.331104    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:08.331807 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:08.331107    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:49:08.331807 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:08.331228    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:49:08.331807 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:08.331241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:08.331807 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:08.331346    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:49:08.444691 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:08.444667    2573 generic.go:356] "Generic (PLEG): container finished" podID="e1bbf341-e51b-4a3b-aeeb-e2f3238296f9" containerID="922ff68a86d6253f18b31b8be6291b360c7d6ff59c9740ba2e328ea875879147" exitCode=0
Jun 15 05:49:08.444821 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:08.444751    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzkqr" event={"ID":"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9","Type":"ContainerDied","Data":"922ff68a86d6253f18b31b8be6291b360c7d6ff59c9740ba2e328ea875879147"}
Jun 15 05:49:08.448237 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:08.448219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk" event={"ID":"0b5c5615-031e-4df2-a241-f413a6f360a7","Type":"ContainerStarted","Data":"ff3d7fd1d5f9b28a7b732de11082466b74257cb3f6fb83fd50aeef8276575f10"}
Jun 15 05:49:10.331401 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:10.331177    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:10.331860 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:10.331234    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:10.331860 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:10.331489    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:49:10.331860 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:10.331261    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:10.331860 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:10.331599    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:49:10.331860 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:10.331719    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:49:10.455670 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:10.455641    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk" event={"ID":"0b5c5615-031e-4df2-a241-f413a6f360a7","Type":"ContainerStarted","Data":"764b19792eff74b18c16008c23dd1508c72872b8a5d8c5fa9ca315afda5bd600"}
Jun 15 05:49:10.455888 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:10.455868    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:49:10.457901 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:10.457878    2573 generic.go:356] "Generic (PLEG): container finished" podID="e1bbf341-e51b-4a3b-aeeb-e2f3238296f9" containerID="3940f4f4d615d238726de720d2342e4cf4f3d2c73004c375f74a464c8a6430b4" exitCode=0
Jun 15 05:49:10.457980 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:10.457925    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzkqr" event={"ID":"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9","Type":"ContainerDied","Data":"3940f4f4d615d238726de720d2342e4cf4f3d2c73004c375f74a464c8a6430b4"}
Jun 15 05:49:10.472296 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:10.472279    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:49:10.501739 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:10.501706    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk" podStartSLOduration=10.814932951 podStartE2EDuration="30.501692981s" totalImagesPullingTime="19.68676003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:10.501053617 +0000 UTC m=+30.635226877" watchObservedRunningTime="2026-06-15 05:49:10.501692981 +0000 UTC m=+30.635866225"
Jun 15 05:49:11.462506 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:11.462393    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzkqr" event={"ID":"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9","Type":"ContainerStarted","Data":"7aa1a2fcffab78bab61f7184ec6f17212311f83965997b81edfbe7108266b3ee"}
Jun 15 05:49:11.463074 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:11.462923    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:49:11.463074 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:11.463024    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:49:11.477835 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:11.477819    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:49:11.588793 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:11.588767    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rvr6v"]
Jun 15 05:49:11.588920 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:11.588895    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:11.589028 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:11.589004    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:49:11.592350 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:11.592316    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bcpdg"]
Jun 15 05:49:11.592513 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:11.592421    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:11.592597 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:11.592519    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:49:11.593208 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:11.593183    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jhbs2"]
Jun 15 05:49:11.593315 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:11.593283    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:11.593396 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:11.593375    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:49:12.467032 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:12.467000    2573 generic.go:356] "Generic (PLEG): container finished" podID="e1bbf341-e51b-4a3b-aeeb-e2f3238296f9" containerID="7aa1a2fcffab78bab61f7184ec6f17212311f83965997b81edfbe7108266b3ee" exitCode=0
Jun 15 05:49:12.467606 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:12.467103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzkqr" event={"ID":"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9","Type":"ContainerDied","Data":"7aa1a2fcffab78bab61f7184ec6f17212311f83965997b81edfbe7108266b3ee"}
Jun 15 05:49:13.330883 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:13.330849    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:13.331160 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:13.330957    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:49:13.331160 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:13.330857    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:13.331160 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:13.330993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:13.331160 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:13.331113    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:49:13.331417 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:13.331202    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:49:14.016932 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:14.016901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:14.017348 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:14.017045    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:49:14.017348 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:14.017122    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret podName:6a65ec4b-de31-4506-937e-2c1bfdc83280 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:46.01710436 +0000 UTC m=+66.151277593 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret") pod "global-pull-secret-syncer-rvr6v" (UID: "6a65ec4b-de31-4506-937e-2c1bfdc83280") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:49:14.118094 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:14.118008    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:14.118240 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:14.118155    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:49:14.118240 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:14.118204    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs podName:20a6ebad-3d70-4308-a712-b575b7e589b9 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:46.118193241 +0000 UTC m=+66.252366469 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs") pod "network-metrics-daemon-jhbs2" (UID: "20a6ebad-3d70-4308-a712-b575b7e589b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:49:14.218561 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:14.218531    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw25z\" (UniqueName: \"kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z\") pod \"network-check-target-bcpdg\" (UID: \"e7f3df42-7203-4da4-b346-c0bea9490657\") " pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:14.218741 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:14.218648    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:49:14.218741 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:14.218666    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:49:14.218741 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:14.218675    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tw25z for pod openshift-network-diagnostics/network-check-target-bcpdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:49:14.218741 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:14.218726    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z podName:e7f3df42-7203-4da4-b346-c0bea9490657 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:46.218713953 +0000 UTC m=+66.352887200 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw25z" (UniqueName: "kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z") pod "network-check-target-bcpdg" (UID: "e7f3df42-7203-4da4-b346-c0bea9490657") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:49:15.330585 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:15.330557    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:15.330585 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:15.330570    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:15.331106 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:15.330597    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:15.331106 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:15.330678    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhbs2" podUID="20a6ebad-3d70-4308-a712-b575b7e589b9"
Jun 15 05:49:15.331106 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:15.330750    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcpdg" podUID="e7f3df42-7203-4da4-b346-c0bea9490657"
Jun 15 05:49:15.331106 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:15.330836    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvr6v" podUID="6a65ec4b-de31-4506-937e-2c1bfdc83280"
Jun 15 05:49:16.230965 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.230939    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-25.ec2.internal" event="NodeReady"
Jun 15 05:49:16.231167 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.231097    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 15 05:49:16.283371 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.283328    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tcnn8"]
Jun 15 05:49:16.285999 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.285970    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6494b9fc86-5gjpq"]
Jun 15 05:49:16.286138 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.286062    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.287667 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.287647    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8d8zh"]
Jun 15 05:49:16.287817 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.287794    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.288456 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.288420    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 15 05:49:16.288456 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.288460    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 15 05:49:16.288712 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.288690    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bq244\""
Jun 15 05:49:16.289307 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.289288    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8d8zh"
Jun 15 05:49:16.289820 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.289802    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 15 05:49:16.290162 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.290143    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 15 05:49:16.290275 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.290255    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qnxfb\""
Jun 15 05:49:16.290338 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.290273    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 15 05:49:16.291236 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.291220    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 15 05:49:16.291884 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.291702    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 15 05:49:16.291884 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.291723    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 15 05:49:16.291884 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.291864    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f5wbk\""
Jun 15 05:49:16.293937 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.293892    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8d8zh"]
Jun 15 05:49:16.296495 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.296468    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 15 05:49:16.296601 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.296517    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tcnn8"]
Jun 15 05:49:16.299640 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.299618    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6494b9fc86-5gjpq"]
Jun 15 05:49:16.431244 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.431244 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431253    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-certificates\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431281    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-installation-pull-secrets\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431305    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d73a3f0e-77b7-4628-95e7-0914dc752f8e-ca-trust-extracted\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431408    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf41c355-b017-42b9-861a-0315d6a804ef-config-volume\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea-cert\") pod \"ingress-canary-8d8zh\" (UID: \"0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea\") " pod="openshift-ingress-canary/ingress-canary-8d8zh"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-trusted-ca\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431491    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wlq5\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-kube-api-access-6wlq5\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5p5b\" (UniqueName: \"kubernetes.io/projected/cf41c355-b017-42b9-861a-0315d6a804ef-kube-api-access-n5p5b\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv9hl\" (UniqueName: \"kubernetes.io/projected/0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea-kube-api-access-vv9hl\") pod \"ingress-canary-8d8zh\" (UID: \"0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea\") " pod="openshift-ingress-canary/ingress-canary-8d8zh"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-image-registry-private-configuration\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431691    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf41c355-b017-42b9-861a-0315d6a804ef-tmp-dir\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.431809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.431722    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-bound-sa-token\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.532845 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.532777    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea-cert\") pod \"ingress-canary-8d8zh\" (UID: \"0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea\") " pod="openshift-ingress-canary/ingress-canary-8d8zh"
Jun 15 05:49:16.532845 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.532810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-trusted-ca\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.532845 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.532826    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wlq5\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-kube-api-access-6wlq5\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.532845 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.532845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5p5b\" (UniqueName: \"kubernetes.io/projected/cf41c355-b017-42b9-861a-0315d6a804ef-kube-api-access-n5p5b\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.533124 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv9hl\" (UniqueName: \"kubernetes.io/projected/0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea-kube-api-access-vv9hl\") pod \"ingress-canary-8d8zh\" (UID: \"0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea\") " pod="openshift-ingress-canary/ingress-canary-8d8zh"
Jun 15 05:49:16.533124 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.533124 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-image-registry-private-configuration\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.533372 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533146    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf41c355-b017-42b9-861a-0315d6a804ef-tmp-dir\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.533372 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-bound-sa-token\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.533372 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:16.533194    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:16.533372 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:16.533220    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6494b9fc86-5gjpq: secret "image-registry-tls" not found
Jun 15 05:49:16.533372 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.533372 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-certificates\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.533372 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-installation-pull-secrets\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.533372 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:16.533287    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls podName:d73a3f0e-77b7-4628-95e7-0914dc752f8e nodeName:}" failed. No retries permitted until 2026-06-15 05:49:17.033269365 +0000 UTC m=+37.167442606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls") pod "image-registry-6494b9fc86-5gjpq" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e") : secret "image-registry-tls" not found
Jun 15 05:49:16.533768 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:16.533410    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:16.533768 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533455    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf41c355-b017-42b9-861a-0315d6a804ef-tmp-dir\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.533768 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:16.533478    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls podName:cf41c355-b017-42b9-861a-0315d6a804ef nodeName:}" failed. No retries permitted until 2026-06-15 05:49:17.033459105 +0000 UTC m=+37.167632362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls") pod "dns-default-tcnn8" (UID: "cf41c355-b017-42b9-861a-0315d6a804ef") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:16.533768 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533525    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d73a3f0e-77b7-4628-95e7-0914dc752f8e-ca-trust-extracted\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.533768 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf41c355-b017-42b9-861a-0315d6a804ef-config-volume\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.533932 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533850    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-trusted-ca\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.533932 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533890    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d73a3f0e-77b7-4628-95e7-0914dc752f8e-ca-trust-extracted\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.533932 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.533904    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-certificates\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.534232 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.534200    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf41c355-b017-42b9-861a-0315d6a804ef-config-volume\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.537129 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.537102    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea-cert\") pod \"ingress-canary-8d8zh\" (UID: \"0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea\") " pod="openshift-ingress-canary/ingress-canary-8d8zh"
Jun 15 05:49:16.537231 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.537127    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-installation-pull-secrets\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.537231 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.537156    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-image-registry-private-configuration\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.543539 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.543515    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv9hl\" (UniqueName: \"kubernetes.io/projected/0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea-kube-api-access-vv9hl\") pod \"ingress-canary-8d8zh\" (UID: \"0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea\") " pod="openshift-ingress-canary/ingress-canary-8d8zh"
Jun 15 05:49:16.543640 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.543581    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-bound-sa-token\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.544354 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.544333    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wlq5\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-kube-api-access-6wlq5\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:16.545323 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.545304    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5p5b\" (UniqueName: \"kubernetes.io/projected/cf41c355-b017-42b9-861a-0315d6a804ef-kube-api-access-n5p5b\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:16.613575 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.613551    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8d8zh"
Jun 15 05:49:16.799231 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:16.798912    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8d8zh"]
Jun 15 05:49:16.825877 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:49:16.825845    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dfb688b_9b54_4fd2_a1be_4ba6627ec2ea.slice/crio-ff4c2507b9c974ff6478edb5e4b7c7f52f36e050bf2b5bbd8420e7d3eb27ed48 WatchSource:0}: Error finding container ff4c2507b9c974ff6478edb5e4b7c7f52f36e050bf2b5bbd8420e7d3eb27ed48: Status 404 returned error can't find the container with id ff4c2507b9c974ff6478edb5e4b7c7f52f36e050bf2b5bbd8420e7d3eb27ed48
Jun 15 05:49:17.036977 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.036942    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:17.037144 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.036998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:17.037144 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:17.037116    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:17.037144 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:17.037133    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6494b9fc86-5gjpq: secret "image-registry-tls" not found
Jun 15 05:49:17.037283 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:17.037151    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:17.037283 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:17.037188    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls podName:d73a3f0e-77b7-4628-95e7-0914dc752f8e nodeName:}" failed. No retries permitted until 2026-06-15 05:49:18.037171449 +0000 UTC m=+38.171344678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls") pod "image-registry-6494b9fc86-5gjpq" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e") : secret "image-registry-tls" not found
Jun 15 05:49:17.037283 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:17.037201    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls podName:cf41c355-b017-42b9-861a-0315d6a804ef nodeName:}" failed. No retries permitted until 2026-06-15 05:49:18.037195623 +0000 UTC m=+38.171368851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls") pod "dns-default-tcnn8" (UID: "cf41c355-b017-42b9-861a-0315d6a804ef") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:17.330938 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.330907    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:17.331100 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.331003    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:17.331100 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.331031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:17.333622 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.333604    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 15 05:49:17.333739 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.333660    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 15 05:49:17.333739 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.333642    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 15 05:49:17.333856 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.333783    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 15 05:49:17.333856 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.333812    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kxrkb\""
Jun 15 05:49:17.334466 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.334448    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqf9b\""
Jun 15 05:49:17.480528 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.480494    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8d8zh" event={"ID":"0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea","Type":"ContainerStarted","Data":"ff4c2507b9c974ff6478edb5e4b7c7f52f36e050bf2b5bbd8420e7d3eb27ed48"}
Jun 15 05:49:17.483503 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.483480    2573 generic.go:356] "Generic (PLEG): container finished" podID="e1bbf341-e51b-4a3b-aeeb-e2f3238296f9" containerID="3afeabb42ce5e20b4804a06abfea890a809d7d86da166bc2dbb344f8be0827fc" exitCode=0
Jun 15 05:49:17.483630 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:17.483514    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzkqr" event={"ID":"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9","Type":"ContainerDied","Data":"3afeabb42ce5e20b4804a06abfea890a809d7d86da166bc2dbb344f8be0827fc"}
Jun 15 05:49:18.044183 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:18.044152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:18.044382 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:18.044258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:18.044382 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:18.044313    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:18.044382 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:18.044377    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls podName:cf41c355-b017-42b9-861a-0315d6a804ef nodeName:}" failed. No retries permitted until 2026-06-15 05:49:20.044362607 +0000 UTC m=+40.178535874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls") pod "dns-default-tcnn8" (UID: "cf41c355-b017-42b9-861a-0315d6a804ef") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:18.044567 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:18.044394    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:18.044567 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:18.044407    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6494b9fc86-5gjpq: secret "image-registry-tls" not found
Jun 15 05:49:18.044567 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:18.044474    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls podName:d73a3f0e-77b7-4628-95e7-0914dc752f8e nodeName:}" failed. No retries permitted until 2026-06-15 05:49:20.044457211 +0000 UTC m=+40.178630457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls") pod "image-registry-6494b9fc86-5gjpq" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e") : secret "image-registry-tls" not found
Jun 15 05:49:18.491185 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:18.491147    2573 generic.go:356] "Generic (PLEG): container finished" podID="e1bbf341-e51b-4a3b-aeeb-e2f3238296f9" containerID="bef4ef96dcacd99a0c4f7fed3a309bcf522a9fe9b7aff02c5c212fac0a69ecba" exitCode=0
Jun 15 05:49:18.491543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:18.491217    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzkqr" event={"ID":"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9","Type":"ContainerDied","Data":"bef4ef96dcacd99a0c4f7fed3a309bcf522a9fe9b7aff02c5c212fac0a69ecba"}
Jun 15 05:49:19.496690 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:19.496503    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzkqr" event={"ID":"e1bbf341-e51b-4a3b-aeeb-e2f3238296f9","Type":"ContainerStarted","Data":"5ce0f5bc8d0368782ec185c1d949dd6067fb08be98309c081b20744e72d65a52"}
Jun 15 05:49:19.497941 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:19.497917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8d8zh" event={"ID":"0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea","Type":"ContainerStarted","Data":"2cccc73b7c32e6edd036323d20bce944a8bcde178855dca61b1d64130cdd4061"}
Jun 15 05:49:19.518466 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:19.518418    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fzkqr" podStartSLOduration=10.436520301 podStartE2EDuration="39.518399801s" totalImagesPullingTime="29.0818795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:19.517370918 +0000 UTC m=+39.651544167" watchObservedRunningTime="2026-06-15 05:49:19.518399801 +0000 UTC m=+39.652573052"
Jun 15 05:49:19.532496 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:19.532457    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8d8zh" podStartSLOduration=1.8233485219999999 podStartE2EDuration="3.532443808s" totalImagesPullingTime="1.709095286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:19.532144041 +0000 UTC m=+39.666317291" watchObservedRunningTime="2026-06-15 05:49:19.532443808 +0000 UTC m=+39.666617049"
Jun 15 05:49:20.060369 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:20.060335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:20.060524 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:20.060387    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:20.060524 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:20.060477    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:20.060524 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:20.060493    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6494b9fc86-5gjpq: secret "image-registry-tls" not found
Jun 15 05:49:20.060524 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:20.060494    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:20.060690 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:20.060542    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls podName:d73a3f0e-77b7-4628-95e7-0914dc752f8e nodeName:}" failed. No retries permitted until 2026-06-15 05:49:24.060529412 +0000 UTC m=+44.194702640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls") pod "image-registry-6494b9fc86-5gjpq" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e") : secret "image-registry-tls" not found
Jun 15 05:49:20.060690 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:20.060554    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls podName:cf41c355-b017-42b9-861a-0315d6a804ef nodeName:}" failed. No retries permitted until 2026-06-15 05:49:24.060548696 +0000 UTC m=+44.194721923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls") pod "dns-default-tcnn8" (UID: "cf41c355-b017-42b9-861a-0315d6a804ef") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:22.730890 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.730856    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mrjn4"]
Jun 15 05:49:22.763938 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.763905    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mrjn4"]
Jun 15 05:49:22.764107 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.764020    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.766353 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.766331    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 15 05:49:22.766474 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.766367    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 15 05:49:22.767034 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.767010    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 15 05:49:22.767034 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.767016    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lbvfg\""
Jun 15 05:49:22.767145 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.767034    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 15 05:49:22.880272 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.880246    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.880380 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.880274    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzwr\" (UniqueName: \"kubernetes.io/projected/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-api-access-4kzwr\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.880380 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.880350    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3acebfb-e473-48bb-b1d9-3c6d02e69269-crio-socket\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.880514 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.880390    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.880514 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.880437    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3acebfb-e473-48bb-b1d9-3c6d02e69269-data-volume\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.980793 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.980760    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3acebfb-e473-48bb-b1d9-3c6d02e69269-crio-socket\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.980793 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.980791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.981024 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.980810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3acebfb-e473-48bb-b1d9-3c6d02e69269-data-volume\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.981024 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.980851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.981024 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.980868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzwr\" (UniqueName: \"kubernetes.io/projected/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-api-access-4kzwr\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.981024 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:22.980932    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:22.981024 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:22.980951    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:49:22.981024 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:22.980999    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls podName:e3acebfb-e473-48bb-b1d9-3c6d02e69269 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:23.480984494 +0000 UTC m=+43.615157721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mrjn4" (UID: "e3acebfb-e473-48bb-b1d9-3c6d02e69269") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:22.981024 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.981001    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3acebfb-e473-48bb-b1d9-3c6d02e69269-crio-socket\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.981024 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:22.981023    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm podName:e3acebfb-e473-48bb-b1d9-3c6d02e69269 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:23.481005305 +0000 UTC m=+43.615178550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mrjn4" (UID: "e3acebfb-e473-48bb-b1d9-3c6d02e69269") : configmap "kube-rbac-proxy" not found
Jun 15 05:49:22.981309 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.981161    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3acebfb-e473-48bb-b1d9-3c6d02e69269-data-volume\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:22.991387 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:22.991362    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzwr\" (UniqueName: \"kubernetes.io/projected/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-api-access-4kzwr\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:23.485522 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:23.485485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:23.485656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:23.485543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:23.485656 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:23.485626    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:49:23.485656 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:23.485645    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:23.485755 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:23.485678    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm podName:e3acebfb-e473-48bb-b1d9-3c6d02e69269 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:24.485664703 +0000 UTC m=+44.619837932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mrjn4" (UID: "e3acebfb-e473-48bb-b1d9-3c6d02e69269") : configmap "kube-rbac-proxy" not found
Jun 15 05:49:23.485755 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:23.485706    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls podName:e3acebfb-e473-48bb-b1d9-3c6d02e69269 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:24.485692879 +0000 UTC m=+44.619866127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mrjn4" (UID: "e3acebfb-e473-48bb-b1d9-3c6d02e69269") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:24.089761 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:24.089725    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:24.090185 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:24.089788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:24.090185 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:24.089869    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:24.090185 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:24.089887    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6494b9fc86-5gjpq: secret "image-registry-tls" not found
Jun 15 05:49:24.090185 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:24.089901    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:24.090185 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:24.089935    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls podName:d73a3f0e-77b7-4628-95e7-0914dc752f8e nodeName:}" failed. No retries permitted until 2026-06-15 05:49:32.089921424 +0000 UTC m=+52.224094652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls") pod "image-registry-6494b9fc86-5gjpq" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e") : secret "image-registry-tls" not found
Jun 15 05:49:24.090185 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:24.089960    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls podName:cf41c355-b017-42b9-861a-0315d6a804ef nodeName:}" failed. No retries permitted until 2026-06-15 05:49:32.089945856 +0000 UTC m=+52.224119087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls") pod "dns-default-tcnn8" (UID: "cf41c355-b017-42b9-861a-0315d6a804ef") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:24.492726 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:24.492691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:24.492913 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:24.492792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:24.492913 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:24.492810    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:49:24.492913 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:24.492870    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm podName:e3acebfb-e473-48bb-b1d9-3c6d02e69269 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:26.492856561 +0000 UTC m=+46.627029848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mrjn4" (UID: "e3acebfb-e473-48bb-b1d9-3c6d02e69269") : configmap "kube-rbac-proxy" not found
Jun 15 05:49:24.493058 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:24.492915    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:24.493058 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:24.492974    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls podName:e3acebfb-e473-48bb-b1d9-3c6d02e69269 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:26.492958053 +0000 UTC m=+46.627131296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mrjn4" (UID: "e3acebfb-e473-48bb-b1d9-3c6d02e69269") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:25.313856 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:25.313826    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6znm2_f488e8ed-c9e0-47ec-941f-5b3ae6b60398/dns-node-resolver/0.log"
Jun 15 05:49:26.510497 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:26.510465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:26.510856 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:26.510518    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:26.510856 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:26.510583    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:49:26.510856 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:26.510628    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm podName:e3acebfb-e473-48bb-b1d9-3c6d02e69269 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:30.510613777 +0000 UTC m=+50.644787004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mrjn4" (UID: "e3acebfb-e473-48bb-b1d9-3c6d02e69269") : configmap "kube-rbac-proxy" not found
Jun 15 05:49:26.510856 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:26.510670    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:26.510856 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:26.510748    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls podName:e3acebfb-e473-48bb-b1d9-3c6d02e69269 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:30.510735848 +0000 UTC m=+50.644909075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mrjn4" (UID: "e3acebfb-e473-48bb-b1d9-3c6d02e69269") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:26.704616 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:26.704594    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hw222_52653dba-0e0e-4625-a6ab-c4cd62794b05/node-ca/0.log"
Jun 15 05:49:27.105209 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:27.105182    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8d8zh_0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea/serve-healthcheck-canary/0.log"
Jun 15 05:49:30.540573 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:30.540545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:30.540999 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:30.540595    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:30.540999 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:30.540729    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:30.540999 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:30.540802    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls podName:e3acebfb-e473-48bb-b1d9-3c6d02e69269 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:38.540783858 +0000 UTC m=+58.674957088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mrjn4" (UID: "e3acebfb-e473-48bb-b1d9-3c6d02e69269") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:30.541135 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:30.541065    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3acebfb-e473-48bb-b1d9-3c6d02e69269-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:32.153191 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:32.153156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:32.153531 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:32.153234    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:32.153531 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:32.153306    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:32.153531 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:32.153334    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:32.153531 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:32.153345    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6494b9fc86-5gjpq: secret "image-registry-tls" not found
Jun 15 05:49:32.153531 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:32.153380    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls podName:cf41c355-b017-42b9-861a-0315d6a804ef nodeName:}" failed. No retries permitted until 2026-06-15 05:49:48.153365607 +0000 UTC m=+68.287538849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls") pod "dns-default-tcnn8" (UID: "cf41c355-b017-42b9-861a-0315d6a804ef") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:32.153531 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:49:32.153395    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls podName:d73a3f0e-77b7-4628-95e7-0914dc752f8e nodeName:}" failed. No retries permitted until 2026-06-15 05:49:48.153388341 +0000 UTC m=+68.287561569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls") pod "image-registry-6494b9fc86-5gjpq" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e") : secret "image-registry-tls" not found
Jun 15 05:49:38.604028 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:38.603991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:38.606456 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:38.606431    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3acebfb-e473-48bb-b1d9-3c6d02e69269-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjn4\" (UID: \"e3acebfb-e473-48bb-b1d9-3c6d02e69269\") " pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:38.672873 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:38.672843    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mrjn4"
Jun 15 05:49:38.796856 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:38.796768    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mrjn4"]
Jun 15 05:49:38.799450 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:49:38.799428    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3acebfb_e473_48bb_b1d9_3c6d02e69269.slice/crio-440333c87d20ffabb3828a9cb2da5339b5d8aef024ba6dc68bf9db5cb7c32114 WatchSource:0}: Error finding container 440333c87d20ffabb3828a9cb2da5339b5d8aef024ba6dc68bf9db5cb7c32114: Status 404 returned error can't find the container with id 440333c87d20ffabb3828a9cb2da5339b5d8aef024ba6dc68bf9db5cb7c32114
Jun 15 05:49:39.544138 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:39.544102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrjn4" event={"ID":"e3acebfb-e473-48bb-b1d9-3c6d02e69269","Type":"ContainerStarted","Data":"440333c87d20ffabb3828a9cb2da5339b5d8aef024ba6dc68bf9db5cb7c32114"}
Jun 15 05:49:42.552066 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:42.552033    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrjn4" event={"ID":"e3acebfb-e473-48bb-b1d9-3c6d02e69269","Type":"ContainerStarted","Data":"ccd03dde08a3f0597a3b88c1aa0b50f8e8054d61df70384911db9a6716fa3d65"}
Jun 15 05:49:43.481176 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:43.481146    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4jhk"
Jun 15 05:49:43.555640 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:43.555611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrjn4" event={"ID":"e3acebfb-e473-48bb-b1d9-3c6d02e69269","Type":"ContainerStarted","Data":"df98c78c4b8d392e75e5805b1880e17b649de0b8f3a7b9cacbb442a778da79be"}
Jun 15 05:49:45.562389 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:45.562354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrjn4" event={"ID":"e3acebfb-e473-48bb-b1d9-3c6d02e69269","Type":"ContainerStarted","Data":"d065fabc77ada809d969378143076e6f8a2e276a809758ec0672030beb8fe273"}
Jun 15 05:49:45.580855 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:45.580813    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mrjn4" podStartSLOduration=17.834869664 podStartE2EDuration="23.580799519s" totalImagesPullingTime="5.745929855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:49:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:45.580362431 +0000 UTC m=+65.714535680" watchObservedRunningTime="2026-06-15 05:49:45.580799519 +0000 UTC m=+65.714972770"
Jun 15 05:49:46.059330 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.059284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:46.061779 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.061758    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 15 05:49:46.072266 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.072239    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a65ec4b-de31-4506-937e-2c1bfdc83280-original-pull-secret\") pod \"global-pull-secret-syncer-rvr6v\" (UID: \"6a65ec4b-de31-4506-937e-2c1bfdc83280\") " pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:46.142285 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.142259    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvr6v"
Jun 15 05:49:46.160352 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.160328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:46.163039 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.163022    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 15 05:49:46.173126 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.173103    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a6ebad-3d70-4308-a712-b575b7e589b9-metrics-certs\") pod \"network-metrics-daemon-jhbs2\" (UID: \"20a6ebad-3d70-4308-a712-b575b7e589b9\") " pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:46.260686 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.260659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw25z\" (UniqueName: \"kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z\") pod \"network-check-target-bcpdg\" (UID: \"e7f3df42-7203-4da4-b346-c0bea9490657\") " pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:46.262155 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.262133    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rvr6v"]
Jun 15 05:49:46.263322 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.263308    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 15 05:49:46.265210 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:49:46.265188    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a65ec4b_de31_4506_937e_2c1bfdc83280.slice/crio-e19f29f11f379e6a7545323b3723ace7a7840f5408b31c72861d4ca0a92f40b0 WatchSource:0}: Error finding container e19f29f11f379e6a7545323b3723ace7a7840f5408b31c72861d4ca0a92f40b0: Status 404 returned error can't find the container with id e19f29f11f379e6a7545323b3723ace7a7840f5408b31c72861d4ca0a92f40b0
Jun 15 05:49:46.274125 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.274109    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 15 05:49:46.284450 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.284434    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw25z\" (UniqueName: \"kubernetes.io/projected/e7f3df42-7203-4da4-b346-c0bea9490657-kube-api-access-tw25z\") pod \"network-check-target-bcpdg\" (UID: \"e7f3df42-7203-4da4-b346-c0bea9490657\") " pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:46.451646 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.451625    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kxrkb\""
Jun 15 05:49:46.457261 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.457240    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqf9b\""
Jun 15 05:49:46.460144 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.460129    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:46.465634 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.465619    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhbs2"
Jun 15 05:49:46.568478 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.568439    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rvr6v" event={"ID":"6a65ec4b-de31-4506-937e-2c1bfdc83280","Type":"ContainerStarted","Data":"e19f29f11f379e6a7545323b3723ace7a7840f5408b31c72861d4ca0a92f40b0"}
Jun 15 05:49:46.621724 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.621695    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bcpdg"]
Jun 15 05:49:46.624491 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:49:46.624466    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f3df42_7203_4da4_b346_c0bea9490657.slice/crio-6dce8b62be1a6dbde22bce318fc398a97043cace723ec25ba0dff5a270dd9c84 WatchSource:0}: Error finding container 6dce8b62be1a6dbde22bce318fc398a97043cace723ec25ba0dff5a270dd9c84: Status 404 returned error can't find the container with id 6dce8b62be1a6dbde22bce318fc398a97043cace723ec25ba0dff5a270dd9c84
Jun 15 05:49:46.642978 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:46.642950    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jhbs2"]
Jun 15 05:49:46.645962 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:49:46.645937    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a6ebad_3d70_4308_a712_b575b7e589b9.slice/crio-6f3c07c9caeecf7a952ab2212910a54418737a78d2b00aabd6ea164c19602a84 WatchSource:0}: Error finding container 6f3c07c9caeecf7a952ab2212910a54418737a78d2b00aabd6ea164c19602a84: Status 404 returned error can't find the container with id 6f3c07c9caeecf7a952ab2212910a54418737a78d2b00aabd6ea164c19602a84
Jun 15 05:49:47.573922 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:47.573882    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bcpdg" event={"ID":"e7f3df42-7203-4da4-b346-c0bea9490657","Type":"ContainerStarted","Data":"6dce8b62be1a6dbde22bce318fc398a97043cace723ec25ba0dff5a270dd9c84"}
Jun 15 05:49:47.575562 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:47.575527    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jhbs2" event={"ID":"20a6ebad-3d70-4308-a712-b575b7e589b9","Type":"ContainerStarted","Data":"6f3c07c9caeecf7a952ab2212910a54418737a78d2b00aabd6ea164c19602a84"}
Jun 15 05:49:48.177713 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.177683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:48.177828 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.177772    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:48.180886 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.180838    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls\") pod \"image-registry-6494b9fc86-5gjpq\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") " pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:48.181934 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.181909    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf41c355-b017-42b9-861a-0315d6a804ef-metrics-tls\") pod \"dns-default-tcnn8\" (UID: \"cf41c355-b017-42b9-861a-0315d6a804ef\") " pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:48.401059 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.400892    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bq244\""
Jun 15 05:49:48.409330 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.409230    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:48.410031 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.410008    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qnxfb\""
Jun 15 05:49:48.419056 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.418973    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:48.564556 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.564475    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6494b9fc86-5gjpq"]
Jun 15 05:49:48.583573 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.583544    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jhbs2" event={"ID":"20a6ebad-3d70-4308-a712-b575b7e589b9","Type":"ContainerStarted","Data":"70e0ffe4d17aa7586db4dee26c2026679d16eb8c74177d7a5e6f44249874e720"}
Jun 15 05:49:48.584065 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.583606    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jhbs2" event={"ID":"20a6ebad-3d70-4308-a712-b575b7e589b9","Type":"ContainerStarted","Data":"2ff739379f3283d56e5463d02a094b1abb4e1e68cb77880485a332ab7a750cb1"}
Jun 15 05:49:48.614790 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.614376    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jhbs2" podStartSLOduration=67.164898118 podStartE2EDuration="1m8.614359359s" totalImagesPullingTime="1.449461241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:48.613244793 +0000 UTC m=+68.747418044" watchObservedRunningTime="2026-06-15 05:49:48.614359359 +0000 UTC m=+68.748532609"
Jun 15 05:49:48.621035 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.621010    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-749ffdbb68-qbnt2"]
Jun 15 05:49:48.631962 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:49:48.631930    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf41c355_b017_42b9_861a_0315d6a804ef.slice/crio-31f47b486a5f189cbfa9fbcd166dee0eac9cf943559778fab84c8663850f493a WatchSource:0}: Error finding container 31f47b486a5f189cbfa9fbcd166dee0eac9cf943559778fab84c8663850f493a: Status 404 returned error can't find the container with id 31f47b486a5f189cbfa9fbcd166dee0eac9cf943559778fab84c8663850f493a
Jun 15 05:49:48.651634 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.651231    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tcnn8"]
Jun 15 05:49:48.651634 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.651295    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749ffdbb68-qbnt2"]
Jun 15 05:49:48.651634 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.651408    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.654519 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.654494    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6494b9fc86-5gjpq"]
Jun 15 05:49:48.656315 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:49:48.656285    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73a3f0e_77b7_4628_95e7_0914dc752f8e.slice/crio-f97cd7c898de6ca083b78051b192696dfe50a3e1b15092f85fe3fef3722f62ac WatchSource:0}: Error finding container f97cd7c898de6ca083b78051b192696dfe50a3e1b15092f85fe3fef3722f62ac: Status 404 returned error can't find the container with id f97cd7c898de6ca083b78051b192696dfe50a3e1b15092f85fe3fef3722f62ac
Jun 15 05:49:48.781597 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.781572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caa637b4-927a-4d9b-995a-c5db1795fb86-registry-tls\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.781717 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.781607    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/caa637b4-927a-4d9b-995a-c5db1795fb86-bound-sa-token\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.781717 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.781652    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/caa637b4-927a-4d9b-995a-c5db1795fb86-ca-trust-extracted\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.781820 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.781732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/caa637b4-927a-4d9b-995a-c5db1795fb86-installation-pull-secrets\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.781820 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.781773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/caa637b4-927a-4d9b-995a-c5db1795fb86-image-registry-private-configuration\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.781906 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.781817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7sf2\" (UniqueName: \"kubernetes.io/projected/caa637b4-927a-4d9b-995a-c5db1795fb86-kube-api-access-l7sf2\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.781906 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.781862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/caa637b4-927a-4d9b-995a-c5db1795fb86-registry-certificates\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.781906 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.781888    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/caa637b4-927a-4d9b-995a-c5db1795fb86-trusted-ca\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.882778 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.882703    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caa637b4-927a-4d9b-995a-c5db1795fb86-registry-tls\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.882778 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.882737    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/caa637b4-927a-4d9b-995a-c5db1795fb86-bound-sa-token\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.882778 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.882767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/caa637b4-927a-4d9b-995a-c5db1795fb86-ca-trust-extracted\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.883020 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.882934    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/caa637b4-927a-4d9b-995a-c5db1795fb86-installation-pull-secrets\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.883020 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.882976    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/caa637b4-927a-4d9b-995a-c5db1795fb86-image-registry-private-configuration\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.883020 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.883005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7sf2\" (UniqueName: \"kubernetes.io/projected/caa637b4-927a-4d9b-995a-c5db1795fb86-kube-api-access-l7sf2\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.883194 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.883042    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/caa637b4-927a-4d9b-995a-c5db1795fb86-registry-certificates\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.883194 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.883066    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/caa637b4-927a-4d9b-995a-c5db1795fb86-trusted-ca\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.883194 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.883137    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/caa637b4-927a-4d9b-995a-c5db1795fb86-ca-trust-extracted\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.884189 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.884164    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/caa637b4-927a-4d9b-995a-c5db1795fb86-trusted-ca\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.884342 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.884198    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/caa637b4-927a-4d9b-995a-c5db1795fb86-registry-certificates\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.885569 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.885549    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caa637b4-927a-4d9b-995a-c5db1795fb86-registry-tls\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.885675 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.885598    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/caa637b4-927a-4d9b-995a-c5db1795fb86-installation-pull-secrets\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.885907 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.885890    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/caa637b4-927a-4d9b-995a-c5db1795fb86-image-registry-private-configuration\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.894167 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.894148    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/caa637b4-927a-4d9b-995a-c5db1795fb86-bound-sa-token\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.894395 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.894379    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7sf2\" (UniqueName: \"kubernetes.io/projected/caa637b4-927a-4d9b-995a-c5db1795fb86-kube-api-access-l7sf2\") pod \"image-registry-749ffdbb68-qbnt2\" (UID: \"caa637b4-927a-4d9b-995a-c5db1795fb86\") " pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:48.967479 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:48.967247    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:49.589718 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:49.589680    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq" event={"ID":"d73a3f0e-77b7-4628-95e7-0914dc752f8e","Type":"ContainerStarted","Data":"e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20"}
Jun 15 05:49:49.590170 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:49.589745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq" event={"ID":"d73a3f0e-77b7-4628-95e7-0914dc752f8e","Type":"ContainerStarted","Data":"f97cd7c898de6ca083b78051b192696dfe50a3e1b15092f85fe3fef3722f62ac"}
Jun 15 05:49:49.590170 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:49.589888    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:49:49.594170 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:49.592125    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tcnn8" event={"ID":"cf41c355-b017-42b9-861a-0315d6a804ef","Type":"ContainerStarted","Data":"31f47b486a5f189cbfa9fbcd166dee0eac9cf943559778fab84c8663850f493a"}
Jun 15 05:49:49.611072 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:49.611017    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq" podStartSLOduration=69.610999381 podStartE2EDuration="1m9.610999381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:49.609757102 +0000 UTC m=+69.743930384" watchObservedRunningTime="2026-06-15 05:49:49.610999381 +0000 UTC m=+69.745172634"
Jun 15 05:49:51.393807 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:51.391339    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749ffdbb68-qbnt2"]
Jun 15 05:49:51.399275 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:49:51.399228    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa637b4_927a_4d9b_995a_c5db1795fb86.slice/crio-cc1a81f0e5ab38e52b2c3b6abcefa10ffd24d5e6113b71c6b70b261751b6157e WatchSource:0}: Error finding container cc1a81f0e5ab38e52b2c3b6abcefa10ffd24d5e6113b71c6b70b261751b6157e: Status 404 returned error can't find the container with id cc1a81f0e5ab38e52b2c3b6abcefa10ffd24d5e6113b71c6b70b261751b6157e
Jun 15 05:49:51.602055 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:51.601962    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2" event={"ID":"caa637b4-927a-4d9b-995a-c5db1795fb86","Type":"ContainerStarted","Data":"da3a71aed1f9280b05873fb6fdc0b855732a87f0eccb61d32820b94867bbc1c6"}
Jun 15 05:49:51.602240 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:51.602070    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2" event={"ID":"caa637b4-927a-4d9b-995a-c5db1795fb86","Type":"ContainerStarted","Data":"cc1a81f0e5ab38e52b2c3b6abcefa10ffd24d5e6113b71c6b70b261751b6157e"}
Jun 15 05:49:51.602871 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:51.602846    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:49:51.605543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:51.605513    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rvr6v" event={"ID":"6a65ec4b-de31-4506-937e-2c1bfdc83280","Type":"ContainerStarted","Data":"86ad841760506b1a972b10134f8e7b1d41cac4eedef4769d2ed55b8264ed16c9"}
Jun 15 05:49:51.607399 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:51.607378    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bcpdg" event={"ID":"e7f3df42-7203-4da4-b346-c0bea9490657","Type":"ContainerStarted","Data":"019aadfc5f22b4f823e08b93dfc286d4ec6181d76ca4ffab6a5e450ced6d050f"}
Jun 15 05:49:51.607518 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:51.607505    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:49:51.624270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:51.623831    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2" podStartSLOduration=3.623817297 podStartE2EDuration="3.623817297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:49:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:51.622873232 +0000 UTC m=+71.757046482" watchObservedRunningTime="2026-06-15 05:49:51.623817297 +0000 UTC m=+71.757990547"
Jun 15 05:49:51.638804 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:51.638750    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rvr6v" podStartSLOduration=66.646569857 podStartE2EDuration="1m11.638733646s" totalImagesPullingTime="4.992163789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:51.637933225 +0000 UTC m=+71.772106532" watchObservedRunningTime="2026-06-15 05:49:51.638733646 +0000 UTC m=+71.772906899"
Jun 15 05:49:51.653127 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:51.653060    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bcpdg" podStartSLOduration=67.01717063 podStartE2EDuration="1m11.653043428s" totalImagesPullingTime="4.635872798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:51.65286538 +0000 UTC m=+71.787038634" watchObservedRunningTime="2026-06-15 05:49:51.653043428 +0000 UTC m=+71.787216679"
Jun 15 05:49:52.614960 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:52.614925    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tcnn8" event={"ID":"cf41c355-b017-42b9-861a-0315d6a804ef","Type":"ContainerStarted","Data":"aa23291cc9e3081cd28ba0b5080ed81bd4c4472e5f2474ad7165651cffcedfe7"}
Jun 15 05:49:53.620382 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:53.620348    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tcnn8" event={"ID":"cf41c355-b017-42b9-861a-0315d6a804ef","Type":"ContainerStarted","Data":"c6a897af024a8fe0cd97fd0a66b2e63df0ffce3d3abb7e5862f501f4fa4ff4f4"}
Jun 15 05:49:53.620770 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:53.620585    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:49:53.645338 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:49:53.645294    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tcnn8" podStartSLOduration=33.781758513 podStartE2EDuration="37.64527614s" totalImagesPullingTime="3.863517627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:53.644873054 +0000 UTC m=+73.779046303" watchObservedRunningTime="2026-06-15 05:49:53.64527614 +0000 UTC m=+73.779449390"
Jun 15 05:50:00.684930 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.684898    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"]
Jun 15 05:50:00.689786 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.689769    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:00.692505 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.692485    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 15 05:50:00.692817 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.692801    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 15 05:50:00.692898 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.692820    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 15 05:50:00.693211 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.693193    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 15 05:50:00.693270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.693211    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ds2p2\""
Jun 15 05:50:00.693313 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.693269    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 15 05:50:00.704831 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.704812    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"]
Jun 15 05:50:00.712867 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.712849    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t8h8g"]
Jun 15 05:50:00.715982 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.715969    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.718616 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.718592    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 15 05:50:00.718695 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.718616    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 15 05:50:00.718695 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.718668    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 15 05:50:00.718995 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.718979    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dzg2h\""
Jun 15 05:50:00.757049 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757020    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c553ea1e-df3e-4909-81d9-a436ee756df0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:00.757223 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757059    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d055b417-cb68-4566-9ab6-12ea2e5c6103-metrics-client-ca\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.757223 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757104    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d055b417-cb68-4566-9ab6-12ea2e5c6103-sys\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.757223 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757165    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c553ea1e-df3e-4909-81d9-a436ee756df0-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:00.757324 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757235    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8bfn\" (UniqueName: \"kubernetes.io/projected/d055b417-cb68-4566-9ab6-12ea2e5c6103-kube-api-access-s8bfn\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.757324 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757260    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-textfile\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.757324 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757283    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-wtmp\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.757324 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757303    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d055b417-cb68-4566-9ab6-12ea2e5c6103-root\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.757434 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-accelerators-collector-config\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.757434 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757351    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c553ea1e-df3e-4909-81d9-a436ee756df0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:00.757434 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-tls\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.757434 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.757549 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.757443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2bzb\" (UniqueName: \"kubernetes.io/projected/c553ea1e-df3e-4909-81d9-a436ee756df0-kube-api-access-x2bzb\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:00.858027 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.857994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8bfn\" (UniqueName: \"kubernetes.io/projected/d055b417-cb68-4566-9ab6-12ea2e5c6103-kube-api-access-s8bfn\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858027 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-textfile\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-wtmp\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d055b417-cb68-4566-9ab6-12ea2e5c6103-root\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-accelerators-collector-config\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858110    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c553ea1e-df3e-4909-81d9-a436ee756df0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:00.858270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-tls\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858192    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d055b417-cb68-4566-9ab6-12ea2e5c6103-root\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858233    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-wtmp\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858270 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858295    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bzb\" (UniqueName: \"kubernetes.io/projected/c553ea1e-df3e-4909-81d9-a436ee756df0-kube-api-access-x2bzb\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:00.858656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c553ea1e-df3e-4909-81d9-a436ee756df0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:00.858656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d055b417-cb68-4566-9ab6-12ea2e5c6103-metrics-client-ca\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858656 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:50:00.858360    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 15 05:50:00.858656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d055b417-cb68-4566-9ab6-12ea2e5c6103-sys\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858485    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-textfile\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858656 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:50:00.858506    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-tls podName:d055b417-cb68-4566-9ab6-12ea2e5c6103 nodeName:}" failed. No retries permitted until 2026-06-15 05:50:01.358486119 +0000 UTC m=+81.492659375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-tls") pod "node-exporter-t8h8g" (UID: "d055b417-cb68-4566-9ab6-12ea2e5c6103") : secret "node-exporter-tls" not found
Jun 15 05:50:00.858656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858518    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d055b417-cb68-4566-9ab6-12ea2e5c6103-sys\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.858656 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:50:00.858435    2573 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jun 15 05:50:00.858656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c553ea1e-df3e-4909-81d9-a436ee756df0-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:00.858656 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:50:00.858590    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c553ea1e-df3e-4909-81d9-a436ee756df0-openshift-state-metrics-tls podName:c553ea1e-df3e-4909-81d9-a436ee756df0 nodeName:}" failed. No retries permitted until 2026-06-15 05:50:01.358572782 +0000 UTC m=+81.492746025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c553ea1e-df3e-4909-81d9-a436ee756df0-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-dwz9z" (UID: "c553ea1e-df3e-4909-81d9-a436ee756df0") : secret "openshift-state-metrics-tls" not found
Jun 15 05:50:00.859097 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858757    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-accelerators-collector-config\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.859097 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.858925    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d055b417-cb68-4566-9ab6-12ea2e5c6103-metrics-client-ca\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.859177 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.859160    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c553ea1e-df3e-4909-81d9-a436ee756df0-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:00.861265 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.861234    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.861371 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.861297    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c553ea1e-df3e-4909-81d9-a436ee756df0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:00.867795 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.867769    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8bfn\" (UniqueName: \"kubernetes.io/projected/d055b417-cb68-4566-9ab6-12ea2e5c6103-kube-api-access-s8bfn\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:00.868014 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:00.867997    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2bzb\" (UniqueName: \"kubernetes.io/projected/c553ea1e-df3e-4909-81d9-a436ee756df0-kube-api-access-x2bzb\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:01.361871 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:01.361839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c553ea1e-df3e-4909-81d9-a436ee756df0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:01.362050 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:01.361899    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-tls\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:01.364348 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:01.364322    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c553ea1e-df3e-4909-81d9-a436ee756df0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-dwz9z\" (UID: \"c553ea1e-df3e-4909-81d9-a436ee756df0\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:01.364462 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:01.364350    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d055b417-cb68-4566-9ab6-12ea2e5c6103-node-exporter-tls\") pod \"node-exporter-t8h8g\" (UID: \"d055b417-cb68-4566-9ab6-12ea2e5c6103\") " pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:01.598698 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:01.598665    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"
Jun 15 05:50:01.624237 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:01.624177    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t8h8g"
Jun 15 05:50:01.635407 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:50:01.635369    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd055b417_cb68_4566_9ab6_12ea2e5c6103.slice/crio-ac96f45c6f8e901078377e62842706cc06e939390197d168c89ecbf37451501b WatchSource:0}: Error finding container ac96f45c6f8e901078377e62842706cc06e939390197d168c89ecbf37451501b: Status 404 returned error can't find the container with id ac96f45c6f8e901078377e62842706cc06e939390197d168c89ecbf37451501b
Jun 15 05:50:01.651275 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:01.651238    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8h8g" event={"ID":"d055b417-cb68-4566-9ab6-12ea2e5c6103","Type":"ContainerStarted","Data":"ac96f45c6f8e901078377e62842706cc06e939390197d168c89ecbf37451501b"}
Jun 15 05:50:01.753417 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:01.753336    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z"]
Jun 15 05:50:01.755883 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:50:01.755857    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc553ea1e_df3e_4909_81d9_a436ee756df0.slice/crio-d7bd79d8a2a9af201c0c47b6c8d90af66f333db646da5acb9602beca48178c8a WatchSource:0}: Error finding container d7bd79d8a2a9af201c0c47b6c8d90af66f333db646da5acb9602beca48178c8a: Status 404 returned error can't find the container with id d7bd79d8a2a9af201c0c47b6c8d90af66f333db646da5acb9602beca48178c8a
Jun 15 05:50:02.588138 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.588107    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"]
Jun 15 05:50:02.591672 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.591649    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.595958 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.595932    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dtif4r5q2elum\""
Jun 15 05:50:02.596247 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.596225    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 15 05:50:02.596368 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.596225    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 15 05:50:02.596368 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.596286    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 15 05:50:02.596608 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.596589    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jrvhj\""
Jun 15 05:50:02.596686 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.596589    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 15 05:50:02.596686 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.596628    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 15 05:50:02.609942 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.608771    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"]
Jun 15 05:50:02.657633 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.657591    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z" event={"ID":"c553ea1e-df3e-4909-81d9-a436ee756df0","Type":"ContainerStarted","Data":"61cd7704d8ea700bd5f1ee23824ffbc29604d997bd54d0fa912ec2287b307974"}
Jun 15 05:50:02.657771 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.657653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z" event={"ID":"c553ea1e-df3e-4909-81d9-a436ee756df0","Type":"ContainerStarted","Data":"40186e881ef74dd4f7d573f47ca363db8b21125ef817583899d4472ef54e0bce"}
Jun 15 05:50:02.657771 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.657680    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z" event={"ID":"c553ea1e-df3e-4909-81d9-a436ee756df0","Type":"ContainerStarted","Data":"d7bd79d8a2a9af201c0c47b6c8d90af66f333db646da5acb9602beca48178c8a"}
Jun 15 05:50:02.671164 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.671126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.671164 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.671168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.671400 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.671207    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-grpc-tls\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.671400 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.671283    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-tls\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.671400 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.671338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.671538 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.671431    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrkms\" (UniqueName: \"kubernetes.io/projected/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-kube-api-access-nrkms\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.671538 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.671466    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-metrics-client-ca\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.671538 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.671495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.772393 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.772357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.772393 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.772403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.772908 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.772440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-grpc-tls\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.772908 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.772507    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-tls\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.772908 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.772565    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.772908 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.772602    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrkms\" (UniqueName: \"kubernetes.io/projected/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-kube-api-access-nrkms\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.772908 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.772632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-metrics-client-ca\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.772908 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.772661    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.773618 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.773590    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-metrics-client-ca\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.775699 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.775670    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.775812 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.775706    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-tls\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.775963 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.775895    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-grpc-tls\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.775963 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.775902    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.776312 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.776289    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.776659 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.776639    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.782977 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.782958    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrkms\" (UniqueName: \"kubernetes.io/projected/bfe197c5-cfc0-4ba3-b269-8d2056fc720b-kube-api-access-nrkms\") pod \"thanos-querier-5fc75ff8df-4h5kr\" (UID: \"bfe197c5-cfc0-4ba3-b269-8d2056fc720b\") " pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:02.902920 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:02.902898    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:03.073980 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:03.073947    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"]
Jun 15 05:50:03.108005 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:50:03.107966    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe197c5_cfc0_4ba3_b269_8d2056fc720b.slice/crio-30faf77b3e479b0b88a5e33061a26e66ad37ba4382df63b225340e682b82dc37 WatchSource:0}: Error finding container 30faf77b3e479b0b88a5e33061a26e66ad37ba4382df63b225340e682b82dc37: Status 404 returned error can't find the container with id 30faf77b3e479b0b88a5e33061a26e66ad37ba4382df63b225340e682b82dc37
Jun 15 05:50:03.625998 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:03.625974    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tcnn8"
Jun 15 05:50:03.662802 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:03.662769    2573 generic.go:356] "Generic (PLEG): container finished" podID="d055b417-cb68-4566-9ab6-12ea2e5c6103" containerID="575ab1e1ac9ef369f331de3e50987b799896b6cf130beaa2ea87288a77f3f414" exitCode=0
Jun 15 05:50:03.662970 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:03.662858    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8h8g" event={"ID":"d055b417-cb68-4566-9ab6-12ea2e5c6103","Type":"ContainerDied","Data":"575ab1e1ac9ef369f331de3e50987b799896b6cf130beaa2ea87288a77f3f414"}
Jun 15 05:50:03.665873 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:03.665846    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z" event={"ID":"c553ea1e-df3e-4909-81d9-a436ee756df0","Type":"ContainerStarted","Data":"2e344fae0deb6b0700aa734030484af4be4ff6e99cc761b702abab01e0446fc3"}
Jun 15 05:50:03.667331 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:03.667306    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr" event={"ID":"bfe197c5-cfc0-4ba3-b269-8d2056fc720b","Type":"ContainerStarted","Data":"30faf77b3e479b0b88a5e33061a26e66ad37ba4382df63b225340e682b82dc37"}
Jun 15 05:50:03.708739 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:03.708689    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-dwz9z" podStartSLOduration=2.698800703 podStartE2EDuration="3.708669908s" totalImagesPullingTime="1.009869205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:50:03.708051824 +0000 UTC m=+83.842225075" watchObservedRunningTime="2026-06-15 05:50:03.708669908 +0000 UTC m=+83.842843187"
Jun 15 05:50:04.673690 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:04.673651    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8h8g" event={"ID":"d055b417-cb68-4566-9ab6-12ea2e5c6103","Type":"ContainerStarted","Data":"209b5f4f716d692d9fe1f07ecaac44583f208e1d4de2e4f11e5a95d268332eef"}
Jun 15 05:50:04.674114 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:04.673713    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8h8g" event={"ID":"d055b417-cb68-4566-9ab6-12ea2e5c6103","Type":"ContainerStarted","Data":"5c6b4eb4b4f198a0a1bb5e23e1e2b1794b838be85d23bbb1e0252a9733582ec4"}
Jun 15 05:50:04.705894 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:04.705822    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t8h8g" podStartSLOduration=3.383594632 podStartE2EDuration="4.705801105s" totalImagesPullingTime="1.243949403s" totalInitContainerRuntime="78.25707ms" isStatefulPod=true podCreationTimestamp="2026-06-15 05:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:50:04.703856269 +0000 UTC m=+84.838029520" watchObservedRunningTime="2026-06-15 05:50:04.705801105 +0000 UTC m=+84.839974355"
Jun 15 05:50:05.384896 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.384815    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"]
Jun 15 05:50:05.387980 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.387965    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"
Jun 15 05:50:05.391955 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.391936    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jun 15 05:50:05.392738 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.392721    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-j5lqx\""
Jun 15 05:50:05.405213 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.405185    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"]
Jun 15 05:50:05.493963 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.493924    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67d2a45c-c745-4455-93a8-af6176c98b06-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-cwbxl\" (UID: \"67d2a45c-c745-4455-93a8-af6176c98b06\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"
Jun 15 05:50:05.494158 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.494013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t49gk\" (UniqueName: \"kubernetes.io/projected/67d2a45c-c745-4455-93a8-af6176c98b06-kube-api-access-t49gk\") pod \"monitoring-plugin-589576dfc7-cwbxl\" (UID: \"67d2a45c-c745-4455-93a8-af6176c98b06\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"
Jun 15 05:50:05.594911 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.594868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t49gk\" (UniqueName: \"kubernetes.io/projected/67d2a45c-c745-4455-93a8-af6176c98b06-kube-api-access-t49gk\") pod \"monitoring-plugin-589576dfc7-cwbxl\" (UID: \"67d2a45c-c745-4455-93a8-af6176c98b06\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"
Jun 15 05:50:05.594911 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.594914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67d2a45c-c745-4455-93a8-af6176c98b06-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-cwbxl\" (UID: \"67d2a45c-c745-4455-93a8-af6176c98b06\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"
Jun 15 05:50:05.597753 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.597720    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67d2a45c-c745-4455-93a8-af6176c98b06-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-cwbxl\" (UID: \"67d2a45c-c745-4455-93a8-af6176c98b06\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"
Jun 15 05:50:05.604201 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.604167    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t49gk\" (UniqueName: \"kubernetes.io/projected/67d2a45c-c745-4455-93a8-af6176c98b06-kube-api-access-t49gk\") pod \"monitoring-plugin-589576dfc7-cwbxl\" (UID: \"67d2a45c-c745-4455-93a8-af6176c98b06\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"
Jun 15 05:50:05.679070 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.679038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr" event={"ID":"bfe197c5-cfc0-4ba3-b269-8d2056fc720b","Type":"ContainerStarted","Data":"deec99cde12301760eaf89c579150e5a6571ed28892bab927c18315a54e27249"}
Jun 15 05:50:05.679433 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.679125    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr" event={"ID":"bfe197c5-cfc0-4ba3-b269-8d2056fc720b","Type":"ContainerStarted","Data":"450a9b216d8f52a0dd2610dde2d6e05b672f80c9b894e057d67040f6cb634a30"}
Jun 15 05:50:05.679433 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.679152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr" event={"ID":"bfe197c5-cfc0-4ba3-b269-8d2056fc720b","Type":"ContainerStarted","Data":"67576894b1505e2b35d925c4cbea364c9a7d43f95b750a2ec9b291303f1a21d2"}
Jun 15 05:50:05.696349 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.696326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"
Jun 15 05:50:05.930641 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:05.930565    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"]
Jun 15 05:50:05.939124 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:50:05.939059    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d2a45c_c745_4455_93a8_af6176c98b06.slice/crio-e4f518777baadaf76b186e9401d11a89a220b50e1a69be28babf3f72c10a31b2 WatchSource:0}: Error finding container e4f518777baadaf76b186e9401d11a89a220b50e1a69be28babf3f72c10a31b2: Status 404 returned error can't find the container with id e4f518777baadaf76b186e9401d11a89a220b50e1a69be28babf3f72c10a31b2
Jun 15 05:50:06.686370 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:06.686331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr" event={"ID":"bfe197c5-cfc0-4ba3-b269-8d2056fc720b","Type":"ContainerStarted","Data":"f4a042757dd16d3c58688bd5eef6380bd432dd0e1ce42e1b23552a86b680896a"}
Jun 15 05:50:06.686874 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:06.686418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr" event={"ID":"bfe197c5-cfc0-4ba3-b269-8d2056fc720b","Type":"ContainerStarted","Data":"e0dabf8d9af28ea59e5d5f407fa3448c96b8530b490d8b53b36179011bfcc9b4"}
Jun 15 05:50:06.686874 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:06.686463    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr" event={"ID":"bfe197c5-cfc0-4ba3-b269-8d2056fc720b","Type":"ContainerStarted","Data":"e83b7e97aa3008697966fc7d270e06dd2a68ae5ed0092bb05517ebf742e7837d"}
Jun 15 05:50:06.686874 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:06.686508    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:06.687605 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:06.687582    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl" event={"ID":"67d2a45c-c745-4455-93a8-af6176c98b06","Type":"ContainerStarted","Data":"e4f518777baadaf76b186e9401d11a89a220b50e1a69be28babf3f72c10a31b2"}
Jun 15 05:50:06.715333 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:06.715294    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr" podStartSLOduration=2.160626208 podStartE2EDuration="4.71527853s" totalImagesPullingTime="2.554652322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:50:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:50:06.71358876 +0000 UTC m=+86.847762013" watchObservedRunningTime="2026-06-15 05:50:06.71527853 +0000 UTC m=+86.849451780"
Jun 15 05:50:07.692785 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:07.692752    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl" event={"ID":"67d2a45c-c745-4455-93a8-af6176c98b06","Type":"ContainerStarted","Data":"dba98b9e13a1e6a274d0445ecae3853864b80b8c9d5e628271068fc74992bcc0"}
Jun 15 05:50:07.693166 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:07.693122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"
Jun 15 05:50:07.697686 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:07.697666    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl"
Jun 15 05:50:07.713238 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:07.713190    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cwbxl" podStartSLOduration=1.534760339 podStartE2EDuration="2.713174238s" totalImagesPullingTime="1.178413899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:50:07.71230407 +0000 UTC m=+87.846477320" watchObservedRunningTime="2026-06-15 05:50:07.713174238 +0000 UTC m=+87.847347491"
Jun 15 05:50:09.595788 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:09.595758    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:50:09.983420 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:09.983393    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-nvblt"]
Jun 15 05:50:09.986634 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:09.986620    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-nvblt"
Jun 15 05:50:09.991595 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:09.991571    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 15 05:50:09.991778 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:09.991756    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-67598\""
Jun 15 05:50:09.991778 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:09.991773    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 15 05:50:10.000708 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:10.000687    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-nvblt"]
Jun 15 05:50:10.025844 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:10.025815    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm79t\" (UniqueName: \"kubernetes.io/projected/68e8bf12-3723-4bfe-b3eb-b4cc906ec673-kube-api-access-mm79t\") pod \"downloads-694c955b9-nvblt\" (UID: \"68e8bf12-3723-4bfe-b3eb-b4cc906ec673\") " pod="openshift-console/downloads-694c955b9-nvblt"
Jun 15 05:50:10.127190 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:10.127151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm79t\" (UniqueName: \"kubernetes.io/projected/68e8bf12-3723-4bfe-b3eb-b4cc906ec673-kube-api-access-mm79t\") pod \"downloads-694c955b9-nvblt\" (UID: \"68e8bf12-3723-4bfe-b3eb-b4cc906ec673\") " pod="openshift-console/downloads-694c955b9-nvblt"
Jun 15 05:50:10.136984 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:10.136959    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm79t\" (UniqueName: \"kubernetes.io/projected/68e8bf12-3723-4bfe-b3eb-b4cc906ec673-kube-api-access-mm79t\") pod \"downloads-694c955b9-nvblt\" (UID: \"68e8bf12-3723-4bfe-b3eb-b4cc906ec673\") " pod="openshift-console/downloads-694c955b9-nvblt"
Jun 15 05:50:10.296010 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:10.295936    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-nvblt"
Jun 15 05:50:10.427480 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:10.427404    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-nvblt"]
Jun 15 05:50:10.429807 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:50:10.429785    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e8bf12_3723_4bfe_b3eb_b4cc906ec673.slice/crio-097ed4b07b32d98bfa8684d6ac48c2cc8678d946da0cf0a81bee0492d5eb4fa1 WatchSource:0}: Error finding container 097ed4b07b32d98bfa8684d6ac48c2cc8678d946da0cf0a81bee0492d5eb4fa1: Status 404 returned error can't find the container with id 097ed4b07b32d98bfa8684d6ac48c2cc8678d946da0cf0a81bee0492d5eb4fa1
Jun 15 05:50:10.704242 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:10.704203    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-nvblt" event={"ID":"68e8bf12-3723-4bfe-b3eb-b4cc906ec673","Type":"ContainerStarted","Data":"097ed4b07b32d98bfa8684d6ac48c2cc8678d946da0cf0a81bee0492d5eb4fa1"}
Jun 15 05:50:12.699862 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:12.699834    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5fc75ff8df-4h5kr"
Jun 15 05:50:13.625239 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:13.625215    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-749ffdbb68-qbnt2"
Jun 15 05:50:14.612341 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.612294    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq" podUID="d73a3f0e-77b7-4628-95e7-0914dc752f8e" containerName="registry" containerID="cri-o://e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20" gracePeriod=30
Jun 15 05:50:14.881881 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.881826    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:50:14.968580 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.968544    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls\") pod \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") "
Jun 15 05:50:14.969042 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.968599    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-bound-sa-token\") pod \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") "
Jun 15 05:50:14.969042 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.968628    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-installation-pull-secrets\") pod \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") "
Jun 15 05:50:14.969042 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.968659    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d73a3f0e-77b7-4628-95e7-0914dc752f8e-ca-trust-extracted\") pod \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") "
Jun 15 05:50:14.969042 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.968680    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-trusted-ca\") pod \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") "
Jun 15 05:50:14.969042 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.968702    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-image-registry-private-configuration\") pod \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") "
Jun 15 05:50:14.969042 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.968739    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-certificates\") pod \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") "
Jun 15 05:50:14.969042 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.968768    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wlq5\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-kube-api-access-6wlq5\") pod \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\" (UID: \"d73a3f0e-77b7-4628-95e7-0914dc752f8e\") "
Jun 15 05:50:14.969525 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.969466    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d73a3f0e-77b7-4628-95e7-0914dc752f8e" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:50:14.970188 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.969937    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d73a3f0e-77b7-4628-95e7-0914dc752f8e" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:50:14.971967 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.971924    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d73a3f0e-77b7-4628-95e7-0914dc752f8e" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:50:14.972359 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.972309    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d73a3f0e-77b7-4628-95e7-0914dc752f8e" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:50:14.972499 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.972460    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d73a3f0e-77b7-4628-95e7-0914dc752f8e" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:50:14.972806 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.972779    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d73a3f0e-77b7-4628-95e7-0914dc752f8e" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:50:14.972961 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.972813    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-kube-api-access-6wlq5" (OuterVolumeSpecName: "kube-api-access-6wlq5") pod "d73a3f0e-77b7-4628-95e7-0914dc752f8e" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e"). InnerVolumeSpecName "kube-api-access-6wlq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:50:14.981869 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:14.981846    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d73a3f0e-77b7-4628-95e7-0914dc752f8e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d73a3f0e-77b7-4628-95e7-0914dc752f8e" (UID: "d73a3f0e-77b7-4628-95e7-0914dc752f8e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:50:15.069357 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.069322    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-bound-sa-token\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:50:15.069357 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.069356    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-installation-pull-secrets\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:50:15.069555 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.069368    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d73a3f0e-77b7-4628-95e7-0914dc752f8e-ca-trust-extracted\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:50:15.069555 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.069380    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-trusted-ca\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:50:15.069555 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.069393    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d73a3f0e-77b7-4628-95e7-0914dc752f8e-image-registry-private-configuration\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:50:15.069555 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.069404    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-certificates\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:50:15.069555 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.069414    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wlq5\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-kube-api-access-6wlq5\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:50:15.069555 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.069426    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d73a3f0e-77b7-4628-95e7-0914dc752f8e-registry-tls\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:50:15.727635 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.727601    2573 generic.go:356] "Generic (PLEG): container finished" podID="d73a3f0e-77b7-4628-95e7-0914dc752f8e" containerID="e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20" exitCode=0
Jun 15 05:50:15.727635 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.727647    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq"
Jun 15 05:50:15.728132 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.727694    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq" event={"ID":"d73a3f0e-77b7-4628-95e7-0914dc752f8e","Type":"ContainerDied","Data":"e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20"}
Jun 15 05:50:15.728132 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.727747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6494b9fc86-5gjpq" event={"ID":"d73a3f0e-77b7-4628-95e7-0914dc752f8e","Type":"ContainerDied","Data":"f97cd7c898de6ca083b78051b192696dfe50a3e1b15092f85fe3fef3722f62ac"}
Jun 15 05:50:15.728132 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.727777    2573 scope.go:117] "RemoveContainer" containerID="e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20"
Jun 15 05:50:15.746854 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.746837    2573 scope.go:117] "RemoveContainer" containerID="e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20"
Jun 15 05:50:15.747235 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:50:15.747209    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20\": container with ID starting with e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20 not found: ID does not exist" containerID="e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20"
Jun 15 05:50:15.747330 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.747246    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20"} err="failed to get container status \"e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20\": rpc error: code = NotFound desc = could not find container \"e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20\": container with ID starting with e0042bc1283754953035d41a56b795a6f77246cb3df745966ef1a3309b743d20 not found: ID does not exist"
Jun 15 05:50:15.750840 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.750821    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6494b9fc86-5gjpq"]
Jun 15 05:50:15.757730 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:15.757708    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6494b9fc86-5gjpq"]
Jun 15 05:50:16.335934 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:16.335896    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d73a3f0e-77b7-4628-95e7-0914dc752f8e" path="/var/lib/kubelet/pods/d73a3f0e-77b7-4628-95e7-0914dc752f8e/volumes"
Jun 15 05:50:21.689774 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.689738    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6898848748-s286j"]
Jun 15 05:50:21.690211 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.690146    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d73a3f0e-77b7-4628-95e7-0914dc752f8e" containerName="registry"
Jun 15 05:50:21.690211 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.690165    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d73a3f0e-77b7-4628-95e7-0914dc752f8e" containerName="registry"
Jun 15 05:50:21.690326 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.690223    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d73a3f0e-77b7-4628-95e7-0914dc752f8e" containerName="registry"
Jun 15 05:50:21.693006 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.692982    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.695717 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.695698    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 15 05:50:21.696022 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.696003    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 15 05:50:21.696428 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.696408    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-277vz\""
Jun 15 05:50:21.696526 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.696435    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 15 05:50:21.696749 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.696732    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 15 05:50:21.696749 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.696742    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 15 05:50:21.703018 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.702983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6898848748-s286j"]
Jun 15 05:50:21.827840 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.827803    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-oauth-serving-cert\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.828003 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.827844    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-oauth-config\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.828003 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.827883    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-console-config\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.828003 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.827961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg992\" (UniqueName: \"kubernetes.io/projected/a128c0b5-013f-4e17-a008-2331d518cf0e-kube-api-access-xg992\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.828003 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.827986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-service-ca\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.828202 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.828007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-serving-cert\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.929102 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.929054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg992\" (UniqueName: \"kubernetes.io/projected/a128c0b5-013f-4e17-a008-2331d518cf0e-kube-api-access-xg992\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.929269 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.929120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-service-ca\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.929269 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.929147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-serving-cert\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.929269 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.929217    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-oauth-serving-cert\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.929269 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.929249    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-oauth-config\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.929469 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.929291    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-console-config\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.929866 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.929837    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-service-ca\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.930009 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.929981    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-oauth-serving-cert\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.930009 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.929998    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-console-config\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.932498 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.932475    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-oauth-config\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.932602 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.932583    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-serving-cert\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:21.938538 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:21.938514    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg992\" (UniqueName: \"kubernetes.io/projected/a128c0b5-013f-4e17-a008-2331d518cf0e-kube-api-access-xg992\") pod \"console-6898848748-s286j\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") " pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:22.004630 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:22.004565    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:22.618722 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:22.618688    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bcpdg"
Jun 15 05:50:26.359818 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:26.359777    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6898848748-s286j"]
Jun 15 05:50:26.363282 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:50:26.363253    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda128c0b5_013f_4e17_a008_2331d518cf0e.slice/crio-e46e2a2a133981452c3e12bca3e793336a848aba4525863067466fcc93ab0329 WatchSource:0}: Error finding container e46e2a2a133981452c3e12bca3e793336a848aba4525863067466fcc93ab0329: Status 404 returned error can't find the container with id e46e2a2a133981452c3e12bca3e793336a848aba4525863067466fcc93ab0329
Jun 15 05:50:26.770595 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:26.770558    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6898848748-s286j" event={"ID":"a128c0b5-013f-4e17-a008-2331d518cf0e","Type":"ContainerStarted","Data":"e46e2a2a133981452c3e12bca3e793336a848aba4525863067466fcc93ab0329"}
Jun 15 05:50:26.771895 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:26.771867    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-nvblt" event={"ID":"68e8bf12-3723-4bfe-b3eb-b4cc906ec673","Type":"ContainerStarted","Data":"7503d6ae8c6e7c44f1eaf0c02518a0914a16f12943b7206b26625e604036c927"}
Jun 15 05:50:26.772101 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:26.772060    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-nvblt"
Jun 15 05:50:26.773442 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:26.773416    2573 patch_prober.go:28] interesting pod/downloads-694c955b9-nvblt container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" start-of-body=
Jun 15 05:50:26.773517 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:26.773456    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-694c955b9-nvblt" podUID="68e8bf12-3723-4bfe-b3eb-b4cc906ec673" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused"
Jun 15 05:50:26.796261 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:26.796217    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-nvblt" podStartSLOduration=1.59712279 podStartE2EDuration="17.796205338s" totalImagesPullingTime="16.199082548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:50:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:50:26.794382247 +0000 UTC m=+106.928555497" watchObservedRunningTime="2026-06-15 05:50:26.796205338 +0000 UTC m=+106.930378585"
Jun 15 05:50:27.787808 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:27.787764    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-nvblt"
Jun 15 05:50:30.791161 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:30.791126    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6898848748-s286j" event={"ID":"a128c0b5-013f-4e17-a008-2331d518cf0e","Type":"ContainerStarted","Data":"e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7"}
Jun 15 05:50:30.811525 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:30.811477    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6898848748-s286j" podStartSLOduration=6.22098039 podStartE2EDuration="9.811463546s" totalImagesPullingTime="3.590483156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:50:30.810249516 +0000 UTC m=+110.944422768" watchObservedRunningTime="2026-06-15 05:50:30.811463546 +0000 UTC m=+110.945636797"
Jun 15 05:50:30.874742 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:30.874707    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c9779df98-xwjtw"]
Jun 15 05:50:30.894755 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:30.894726    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9779df98-xwjtw"]
Jun 15 05:50:30.894965 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:30.894839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:30.908918 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:30.908445    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 15 05:50:31.009066 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.009033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-serving-cert\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.009238 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.009103    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-service-ca\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.009238 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.009169    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-trusted-ca-bundle\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.009362 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.009243    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-config\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.009362 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.009273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-oauth-config\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.009362 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.009292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-oauth-serving-cert\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.009362 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.009327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdrsc\" (UniqueName: \"kubernetes.io/projected/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-kube-api-access-cdrsc\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.110075 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.109995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-serving-cert\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.110075 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.110041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-service-ca\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.110075 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.110070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-trusted-ca-bundle\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.110336 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.110141    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-config\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.110336 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.110164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-oauth-config\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.110336 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.110184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-oauth-serving-cert\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.110479 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.110383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdrsc\" (UniqueName: \"kubernetes.io/projected/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-kube-api-access-cdrsc\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.111044 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.111021    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-service-ca\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.111607 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.111583    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-oauth-serving-cert\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.111762 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.111737    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-config\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.111924 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.111751    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-trusted-ca-bundle\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.113049 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.113022    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-oauth-config\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.113164 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.113149    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-serving-cert\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.119956 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.119932    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdrsc\" (UniqueName: \"kubernetes.io/projected/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-kube-api-access-cdrsc\") pod \"console-c9779df98-xwjtw\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") " pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.207782 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.207751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:31.394952 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.394876    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9779df98-xwjtw"]
Jun 15 05:50:31.400779 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:50:31.400745    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8642e7_4392_45c1_9b8e_ffa3ba50b06b.slice/crio-36a9ebbe41883106ba989de2adb5112ec707723ea466475297df40ae04f25b55 WatchSource:0}: Error finding container 36a9ebbe41883106ba989de2adb5112ec707723ea466475297df40ae04f25b55: Status 404 returned error can't find the container with id 36a9ebbe41883106ba989de2adb5112ec707723ea466475297df40ae04f25b55
Jun 15 05:50:31.799425 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.799389    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9779df98-xwjtw" event={"ID":"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b","Type":"ContainerStarted","Data":"3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602"}
Jun 15 05:50:31.799903 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.799450    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9779df98-xwjtw" event={"ID":"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b","Type":"ContainerStarted","Data":"36a9ebbe41883106ba989de2adb5112ec707723ea466475297df40ae04f25b55"}
Jun 15 05:50:31.834811 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:31.834756    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c9779df98-xwjtw" podStartSLOduration=1.834739253 podStartE2EDuration="1.834739253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:50:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:50:31.833437091 +0000 UTC m=+111.967610341" watchObservedRunningTime="2026-06-15 05:50:31.834739253 +0000 UTC m=+111.968912503"
Jun 15 05:50:32.004984 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:32.004910    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:32.004984 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:32.004983    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:32.010566 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:32.010541    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:32.807941 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:32.807914    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6898848748-s286j"
Jun 15 05:50:41.208034 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:41.207996    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:41.208464 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:41.208099    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:41.212744 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:41.212725    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:41.850654 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:41.850625    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:50:41.910926 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:50:41.910893    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6898848748-s286j"]
Jun 15 05:51:06.938656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:06.938600    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6898848748-s286j" podUID="a128c0b5-013f-4e17-a008-2331d518cf0e" containerName="console" containerID="cri-o://e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7" gracePeriod=15
Jun 15 05:51:07.218758 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.218736    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6898848748-s286j"
Jun 15 05:51:07.290655 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.290624    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-oauth-serving-cert\") pod \"a128c0b5-013f-4e17-a008-2331d518cf0e\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") "
Jun 15 05:51:07.290813 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.290681    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-service-ca\") pod \"a128c0b5-013f-4e17-a008-2331d518cf0e\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") "
Jun 15 05:51:07.290813 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.290783    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-console-config\") pod \"a128c0b5-013f-4e17-a008-2331d518cf0e\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") "
Jun 15 05:51:07.290933 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.290823    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-serving-cert\") pod \"a128c0b5-013f-4e17-a008-2331d518cf0e\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") "
Jun 15 05:51:07.290933 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.290849    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-oauth-config\") pod \"a128c0b5-013f-4e17-a008-2331d518cf0e\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") "
Jun 15 05:51:07.290933 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.290894    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg992\" (UniqueName: \"kubernetes.io/projected/a128c0b5-013f-4e17-a008-2331d518cf0e-kube-api-access-xg992\") pod \"a128c0b5-013f-4e17-a008-2331d518cf0e\" (UID: \"a128c0b5-013f-4e17-a008-2331d518cf0e\") "
Jun 15 05:51:07.291150 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.291072    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a128c0b5-013f-4e17-a008-2331d518cf0e" (UID: "a128c0b5-013f-4e17-a008-2331d518cf0e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:51:07.291150 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.291076    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-service-ca" (OuterVolumeSpecName: "service-ca") pod "a128c0b5-013f-4e17-a008-2331d518cf0e" (UID: "a128c0b5-013f-4e17-a008-2331d518cf0e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:51:07.291319 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.291203    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-console-config" (OuterVolumeSpecName: "console-config") pod "a128c0b5-013f-4e17-a008-2331d518cf0e" (UID: "a128c0b5-013f-4e17-a008-2331d518cf0e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:51:07.293176 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.293148    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a128c0b5-013f-4e17-a008-2331d518cf0e" (UID: "a128c0b5-013f-4e17-a008-2331d518cf0e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:51:07.293261 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.293202    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a128c0b5-013f-4e17-a008-2331d518cf0e-kube-api-access-xg992" (OuterVolumeSpecName: "kube-api-access-xg992") pod "a128c0b5-013f-4e17-a008-2331d518cf0e" (UID: "a128c0b5-013f-4e17-a008-2331d518cf0e"). InnerVolumeSpecName "kube-api-access-xg992". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:51:07.293261 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.293240    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a128c0b5-013f-4e17-a008-2331d518cf0e" (UID: "a128c0b5-013f-4e17-a008-2331d518cf0e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:51:07.391732 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.391707    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-oauth-config\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:51:07.391732 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.391730    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg992\" (UniqueName: \"kubernetes.io/projected/a128c0b5-013f-4e17-a008-2331d518cf0e-kube-api-access-xg992\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:51:07.391864 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.391744    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-oauth-serving-cert\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:51:07.391864 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.391758    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-service-ca\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:51:07.391864 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.391771    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a128c0b5-013f-4e17-a008-2331d518cf0e-console-config\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:51:07.391864 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.391782    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a128c0b5-013f-4e17-a008-2331d518cf0e-console-serving-cert\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:51:07.929997 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.929968    2573 generic.go:356] "Generic (PLEG): container finished" podID="a128c0b5-013f-4e17-a008-2331d518cf0e" containerID="e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7" exitCode=0
Jun 15 05:51:07.930166 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.930005    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6898848748-s286j"
Jun 15 05:51:07.930166 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.930014    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6898848748-s286j" event={"ID":"a128c0b5-013f-4e17-a008-2331d518cf0e","Type":"ContainerDied","Data":"e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7"}
Jun 15 05:51:07.930166 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.930052    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6898848748-s286j" event={"ID":"a128c0b5-013f-4e17-a008-2331d518cf0e","Type":"ContainerDied","Data":"e46e2a2a133981452c3e12bca3e793336a848aba4525863067466fcc93ab0329"}
Jun 15 05:51:07.930166 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.930072    2573 scope.go:117] "RemoveContainer" containerID="e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7"
Jun 15 05:51:07.938486 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.938470    2573 scope.go:117] "RemoveContainer" containerID="e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7"
Jun 15 05:51:07.938745 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:51:07.938728    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7\": container with ID starting with e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7 not found: ID does not exist" containerID="e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7"
Jun 15 05:51:07.938985 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.938753    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7"} err="failed to get container status \"e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7\": rpc error: code = NotFound desc = could not find container \"e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7\": container with ID starting with e40ef6708b8e340cf58ca1d1e76ede9b4d984d66c8d03c6f130c5e36670022e7 not found: ID does not exist"
Jun 15 05:51:07.958986 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.958962    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6898848748-s286j"]
Jun 15 05:51:07.963218 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:07.963200    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6898848748-s286j"]
Jun 15 05:51:08.335153 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:08.335061    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a128c0b5-013f-4e17-a008-2331d518cf0e" path="/var/lib/kubelet/pods/a128c0b5-013f-4e17-a008-2331d518cf0e/volumes"
Jun 15 05:51:25.030298 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.030268    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6545f694f6-ctq84"]
Jun 15 05:51:25.030710 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.030546    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a128c0b5-013f-4e17-a008-2331d518cf0e" containerName="console"
Jun 15 05:51:25.030710 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.030558    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a128c0b5-013f-4e17-a008-2331d518cf0e" containerName="console"
Jun 15 05:51:25.030710 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.030601    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a128c0b5-013f-4e17-a008-2331d518cf0e" containerName="console"
Jun 15 05:51:25.032395 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.032381    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.034752 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.034716    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fxpfv\""
Jun 15 05:51:25.034752 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.034723    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 15 05:51:25.034752 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.034745    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 15 05:51:25.035007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.034992    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 15 05:51:25.035057 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.035023    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 15 05:51:25.035461 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.035445    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 15 05:51:25.040272 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.040245    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 15 05:51:25.045764 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.045743    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6545f694f6-ctq84"]
Jun 15 05:51:25.115041 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.115014    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.115181 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.115049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-metrics-client-ca\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.115181 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.115101    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-federate-client-tls\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.115181 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.115130    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-telemeter-client-tls\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.115181 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.115162    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.115324 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.115195    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cmmw\" (UniqueName: \"kubernetes.io/projected/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-kube-api-access-9cmmw\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.115324 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.115270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-serving-certs-ca-bundle\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.115385 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.115321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-secret-telemeter-client\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.216528 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.216500    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-serving-certs-ca-bundle\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.216666 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.216538    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-secret-telemeter-client\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.216666 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.216561    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.216666 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.216595    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-metrics-client-ca\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.216815 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.216769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-federate-client-tls\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.216815 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.216803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-telemeter-client-tls\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.216917 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.216827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.216917 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.216863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cmmw\" (UniqueName: \"kubernetes.io/projected/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-kube-api-access-9cmmw\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.217334 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.217308    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-serving-certs-ca-bundle\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.217558 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.217532    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-metrics-client-ca\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.217691 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.217669    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.219176 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.219151    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-secret-telemeter-client\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.219326 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.219308    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-federate-client-tls\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.219823 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.219797    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.219892 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.219847    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-telemeter-client-tls\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.226554 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.226515    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cmmw\" (UniqueName: \"kubernetes.io/projected/aaf30b3c-3b29-4fe8-ba40-5c2901447a74-kube-api-access-9cmmw\") pod \"telemeter-client-6545f694f6-ctq84\" (UID: \"aaf30b3c-3b29-4fe8-ba40-5c2901447a74\") " pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.341197 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.341122    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84"
Jun 15 05:51:25.475028 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.474991    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6545f694f6-ctq84"]
Jun 15 05:51:25.477671 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:51:25.477642    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf30b3c_3b29_4fe8_ba40_5c2901447a74.slice/crio-919d2f6dcaa65142eee37f2c637178322a74415515a8a8a3ef466c18d9cb54e4 WatchSource:0}: Error finding container 919d2f6dcaa65142eee37f2c637178322a74415515a8a8a3ef466c18d9cb54e4: Status 404 returned error can't find the container with id 919d2f6dcaa65142eee37f2c637178322a74415515a8a8a3ef466c18d9cb54e4
Jun 15 05:51:25.994356 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:25.994314    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84" event={"ID":"aaf30b3c-3b29-4fe8-ba40-5c2901447a74","Type":"ContainerStarted","Data":"919d2f6dcaa65142eee37f2c637178322a74415515a8a8a3ef466c18d9cb54e4"}
Jun 15 05:51:26.999406 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:26.999381    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84" event={"ID":"aaf30b3c-3b29-4fe8-ba40-5c2901447a74","Type":"ContainerStarted","Data":"dc2724eccddaf59d7cd8fe483638601703611b2e419f33bf2f0dc37c5c61a7e0"}
Jun 15 05:51:28.004113 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:28.004070    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84" event={"ID":"aaf30b3c-3b29-4fe8-ba40-5c2901447a74","Type":"ContainerStarted","Data":"4236a385a89c97ee859edec8ac388fb52476e6ab2787685cc7e1e7471e5ec791"}
Jun 15 05:51:29.009353 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:29.009316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84" event={"ID":"aaf30b3c-3b29-4fe8-ba40-5c2901447a74","Type":"ContainerStarted","Data":"48d9c318168c07e3e7ae3519928830d4d3f909cc3ba9cc386f633c99ef2a7831"}
Jun 15 05:51:29.034462 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:29.034416    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6545f694f6-ctq84" podStartSLOduration=1.665238965 podStartE2EDuration="4.034401821s" totalImagesPullingTime="2.369162856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:51:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:51:29.033419569 +0000 UTC m=+169.167592817" watchObservedRunningTime="2026-06-15 05:51:29.034401821 +0000 UTC m=+169.168575072"
Jun 15 05:51:30.422987 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.422958    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68dd79d5bf-r9nnk"]
Jun 15 05:51:30.425014 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.424999    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.436807 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.436782    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68dd79d5bf-r9nnk"]
Jun 15 05:51:30.460779 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.460755    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-oauth-serving-cert\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.460895 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.460786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-console-config\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.460895 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.460815    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-serving-cert\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.460895 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.460868    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-service-ca\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.460895 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.460891    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-trusted-ca-bundle\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.461064 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.460959    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj7gn\" (UniqueName: \"kubernetes.io/projected/10803494-79ef-4830-8a70-39dc97f50f13-kube-api-access-sj7gn\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.461064 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.460987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-oauth-config\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.561922 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.561891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-console-config\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.562077 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.561942    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-serving-cert\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.562077 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.561981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-service-ca\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.562077 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.562005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-trusted-ca-bundle\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.562077 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.562041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj7gn\" (UniqueName: \"kubernetes.io/projected/10803494-79ef-4830-8a70-39dc97f50f13-kube-api-access-sj7gn\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.562077 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.562066    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-oauth-config\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.562356 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.562135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-oauth-serving-cert\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.562754 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.562720    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-console-config\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.562921 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.562902    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-oauth-serving-cert\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.562921 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.562912    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-trusted-ca-bundle\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.563010 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.562952    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-service-ca\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.564570 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.564549    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-serving-cert\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.564638 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.564613    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-oauth-config\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.571177 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.571156    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj7gn\" (UniqueName: \"kubernetes.io/projected/10803494-79ef-4830-8a70-39dc97f50f13-kube-api-access-sj7gn\") pod \"console-68dd79d5bf-r9nnk\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") " pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.733470 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.733394    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:30.861604 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:30.861577    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68dd79d5bf-r9nnk"]
Jun 15 05:51:30.866406 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:51:30.866372    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10803494_79ef_4830_8a70_39dc97f50f13.slice/crio-5cbfab1e5edd240ffa222f9d6b6971824cab636191518cfc40d34c40f0972dbc WatchSource:0}: Error finding container 5cbfab1e5edd240ffa222f9d6b6971824cab636191518cfc40d34c40f0972dbc: Status 404 returned error can't find the container with id 5cbfab1e5edd240ffa222f9d6b6971824cab636191518cfc40d34c40f0972dbc
Jun 15 05:51:31.017728 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:31.017650    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dd79d5bf-r9nnk" event={"ID":"10803494-79ef-4830-8a70-39dc97f50f13","Type":"ContainerStarted","Data":"faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476"}
Jun 15 05:51:31.017728 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:31.017703    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dd79d5bf-r9nnk" event={"ID":"10803494-79ef-4830-8a70-39dc97f50f13","Type":"ContainerStarted","Data":"5cbfab1e5edd240ffa222f9d6b6971824cab636191518cfc40d34c40f0972dbc"}
Jun 15 05:51:31.040231 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:31.040189    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68dd79d5bf-r9nnk" podStartSLOduration=1.040173565 podStartE2EDuration="1.040173565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:51:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:51:31.038338085 +0000 UTC m=+171.172511335" watchObservedRunningTime="2026-06-15 05:51:31.040173565 +0000 UTC m=+171.174346815"
Jun 15 05:51:40.733969 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:40.733928    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:40.734354 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:40.733985    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:40.738697 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:40.738679    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:41.056977 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:41.056906    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:51:41.129136 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:51:41.129106    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9779df98-xwjtw"]
Jun 15 05:52:06.150968 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.150928    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c9779df98-xwjtw" podUID="3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" containerName="console" containerID="cri-o://3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602" gracePeriod=15
Jun 15 05:52:06.385694 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.385674    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:52:06.533814 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.533791    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdrsc\" (UniqueName: \"kubernetes.io/projected/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-kube-api-access-cdrsc\") pod \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") "
Jun 15 05:52:06.533967 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.533846    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-oauth-config\") pod \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") "
Jun 15 05:52:06.533967 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.533874    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-serving-cert\") pod \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") "
Jun 15 05:52:06.533967 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.533897    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-trusted-ca-bundle\") pod \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") "
Jun 15 05:52:06.533967 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.533917    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-oauth-serving-cert\") pod \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") "
Jun 15 05:52:06.533967 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.533934    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-service-ca\") pod \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") "
Jun 15 05:52:06.533967 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.533965    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-config\") pod \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\" (UID: \"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b\") "
Jun 15 05:52:06.534383 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.534342    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" (UID: "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:52:06.534484 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.534414    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-config" (OuterVolumeSpecName: "console-config") pod "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" (UID: "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:52:06.534484 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.534419    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-service-ca" (OuterVolumeSpecName: "service-ca") pod "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" (UID: "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:52:06.534484 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.534431    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" (UID: "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:52:06.536237 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.536210    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" (UID: "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:52:06.536508 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.536476    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" (UID: "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:52:06.536595 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.536533    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-kube-api-access-cdrsc" (OuterVolumeSpecName: "kube-api-access-cdrsc") pod "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" (UID: "3c8642e7-4392-45c1-9b8e-ffa3ba50b06b"). InnerVolumeSpecName "kube-api-access-cdrsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:52:06.634516 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.634488    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-trusted-ca-bundle\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:52:06.634516 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.634516    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-oauth-serving-cert\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:52:06.634516 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.634526    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-service-ca\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:52:06.634671 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.634534    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-config\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:52:06.634671 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.634541    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdrsc\" (UniqueName: \"kubernetes.io/projected/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-kube-api-access-cdrsc\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:52:06.634671 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.634549    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-oauth-config\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:52:06.634671 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:06.634558    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b-console-serving-cert\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:52:07.142759 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:07.142728    2573 generic.go:356] "Generic (PLEG): container finished" podID="3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" containerID="3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602" exitCode=0
Jun 15 05:52:07.142891 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:07.142775    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9779df98-xwjtw"
Jun 15 05:52:07.142891 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:07.142818    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9779df98-xwjtw" event={"ID":"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b","Type":"ContainerDied","Data":"3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602"}
Jun 15 05:52:07.142891 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:07.142870    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9779df98-xwjtw" event={"ID":"3c8642e7-4392-45c1-9b8e-ffa3ba50b06b","Type":"ContainerDied","Data":"36a9ebbe41883106ba989de2adb5112ec707723ea466475297df40ae04f25b55"}
Jun 15 05:52:07.143004 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:07.142892    2573 scope.go:117] "RemoveContainer" containerID="3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602"
Jun 15 05:52:07.151313 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:07.151298    2573 scope.go:117] "RemoveContainer" containerID="3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602"
Jun 15 05:52:07.151564 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:52:07.151540    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602\": container with ID starting with 3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602 not found: ID does not exist" containerID="3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602"
Jun 15 05:52:07.151603 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:07.151562    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602"} err="failed to get container status \"3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602\": rpc error: code = NotFound desc = could not find container \"3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602\": container with ID starting with 3564776dfda12e5ab92c063b7ce15dce5180f7b859c50862af2597c279632602 not found: ID does not exist"
Jun 15 05:52:07.169719 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:07.169694    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9779df98-xwjtw"]
Jun 15 05:52:07.177134 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:07.177116    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c9779df98-xwjtw"]
Jun 15 05:52:08.335777 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:52:08.335745    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" path="/var/lib/kubelet/pods/3c8642e7-4392-45c1-9b8e-ffa3ba50b06b/volumes"
Jun 15 05:53:10.186649 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.186621    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d7469d577-mrl6z"]
Jun 15 05:53:10.187042 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.186868    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" containerName="console"
Jun 15 05:53:10.187042 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.186878    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" containerName="console"
Jun 15 05:53:10.187042 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.186931    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c8642e7-4392-45c1-9b8e-ffa3ba50b06b" containerName="console"
Jun 15 05:53:10.188793 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.188778    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.201678 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.201654    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7469d577-mrl6z"]
Jun 15 05:53:10.298401 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.298378    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-trusted-ca-bundle\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.298534 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.298420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-service-ca\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.298534 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.298442    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-oauth-serving-cert\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.298534 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.298495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-oauth-config\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.298534 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.298521    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-config\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.298677 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.298580    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxxcn\" (UniqueName: \"kubernetes.io/projected/eb8239da-d72d-49ae-807f-7ba2b28821d9-kube-api-access-vxxcn\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.298677 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.298620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-serving-cert\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.399929 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.399905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-serving-cert\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.400108 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.399951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-trusted-ca-bundle\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.400108 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.399986    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-service-ca\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.400108 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.400007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-oauth-serving-cert\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.400108 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.400041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-oauth-config\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.400330 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.400116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-config\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.400330 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.400161    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxxcn\" (UniqueName: \"kubernetes.io/projected/eb8239da-d72d-49ae-807f-7ba2b28821d9-kube-api-access-vxxcn\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.400866 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.400839    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-service-ca\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.400970 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.400839    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-oauth-serving-cert\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.400970 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.400840    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-config\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.401277 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.401253    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-trusted-ca-bundle\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.402497 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.402476    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-oauth-config\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.402610 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.402594    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-serving-cert\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.409886 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.409857    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxxcn\" (UniqueName: \"kubernetes.io/projected/eb8239da-d72d-49ae-807f-7ba2b28821d9-kube-api-access-vxxcn\") pod \"console-5d7469d577-mrl6z\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") " pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.497644 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.497579    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:10.628950 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:10.628928    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7469d577-mrl6z"]
Jun 15 05:53:10.631558 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:53:10.631533    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8239da_d72d_49ae_807f_7ba2b28821d9.slice/crio-dad797d6185a17df3f2a06f30ebad5c2e01ee7673b5df29db790718e2de4e913 WatchSource:0}: Error finding container dad797d6185a17df3f2a06f30ebad5c2e01ee7673b5df29db790718e2de4e913: Status 404 returned error can't find the container with id dad797d6185a17df3f2a06f30ebad5c2e01ee7673b5df29db790718e2de4e913
Jun 15 05:53:11.361521 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:11.361483    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7469d577-mrl6z" event={"ID":"eb8239da-d72d-49ae-807f-7ba2b28821d9","Type":"ContainerStarted","Data":"47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634"}
Jun 15 05:53:11.361882 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:11.361537    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7469d577-mrl6z" event={"ID":"eb8239da-d72d-49ae-807f-7ba2b28821d9","Type":"ContainerStarted","Data":"dad797d6185a17df3f2a06f30ebad5c2e01ee7673b5df29db790718e2de4e913"}
Jun 15 05:53:11.385812 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:11.385761    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d7469d577-mrl6z" podStartSLOduration=1.385746867 podStartE2EDuration="1.385746867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:53:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:53:11.38458041 +0000 UTC m=+271.518753661" watchObservedRunningTime="2026-06-15 05:53:11.385746867 +0000 UTC m=+271.519920116"
Jun 15 05:53:20.497945 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:20.497921    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:20.498372 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:20.497988    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:20.503399 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:20.503371    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:21.398001 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:21.397968    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:53:21.450996 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:21.450966    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68dd79d5bf-r9nnk"]
Jun 15 05:53:38.897780 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:38.897745    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"]
Jun 15 05:53:38.899860 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:38.899844    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:38.905012 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:38.904989    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 15 05:53:38.905685 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:38.905661    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 15 05:53:38.905808 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:38.905780    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 15 05:53:38.905909 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:38.905891    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 15 05:53:38.915928 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:38.915907    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"]
Jun 15 05:53:39.007423 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.007393    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d7b2e555-96ce-4603-89f5-d66dc24c5d70-klusterlet-config\") pod \"klusterlet-addon-workmgr-777485d587-9zgwz\" (UID: \"d7b2e555-96ce-4603-89f5-d66dc24c5d70\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:39.007548 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.007450    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7b2e555-96ce-4603-89f5-d66dc24c5d70-tmp\") pod \"klusterlet-addon-workmgr-777485d587-9zgwz\" (UID: \"d7b2e555-96ce-4603-89f5-d66dc24c5d70\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:39.007548 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.007493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlwbg\" (UniqueName: \"kubernetes.io/projected/d7b2e555-96ce-4603-89f5-d66dc24c5d70-kube-api-access-nlwbg\") pod \"klusterlet-addon-workmgr-777485d587-9zgwz\" (UID: \"d7b2e555-96ce-4603-89f5-d66dc24c5d70\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:39.108759 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.108716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d7b2e555-96ce-4603-89f5-d66dc24c5d70-klusterlet-config\") pod \"klusterlet-addon-workmgr-777485d587-9zgwz\" (UID: \"d7b2e555-96ce-4603-89f5-d66dc24c5d70\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:39.108917 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.108778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7b2e555-96ce-4603-89f5-d66dc24c5d70-tmp\") pod \"klusterlet-addon-workmgr-777485d587-9zgwz\" (UID: \"d7b2e555-96ce-4603-89f5-d66dc24c5d70\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:39.108917 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.108891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlwbg\" (UniqueName: \"kubernetes.io/projected/d7b2e555-96ce-4603-89f5-d66dc24c5d70-kube-api-access-nlwbg\") pod \"klusterlet-addon-workmgr-777485d587-9zgwz\" (UID: \"d7b2e555-96ce-4603-89f5-d66dc24c5d70\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:39.109144 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.109123    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7b2e555-96ce-4603-89f5-d66dc24c5d70-tmp\") pod \"klusterlet-addon-workmgr-777485d587-9zgwz\" (UID: \"d7b2e555-96ce-4603-89f5-d66dc24c5d70\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:39.111350 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.111330    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d7b2e555-96ce-4603-89f5-d66dc24c5d70-klusterlet-config\") pod \"klusterlet-addon-workmgr-777485d587-9zgwz\" (UID: \"d7b2e555-96ce-4603-89f5-d66dc24c5d70\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:39.121639 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.121621    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlwbg\" (UniqueName: \"kubernetes.io/projected/d7b2e555-96ce-4603-89f5-d66dc24c5d70-kube-api-access-nlwbg\") pod \"klusterlet-addon-workmgr-777485d587-9zgwz\" (UID: \"d7b2e555-96ce-4603-89f5-d66dc24c5d70\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:39.209563 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.209543    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:39.344836 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.344809    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"]
Jun 15 05:53:39.348056 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:53:39.348024    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b2e555_96ce_4603_89f5_d66dc24c5d70.slice/crio-46412b95ee4e9a25cdb2d688b3867ace1a7f126a854b08feb7c823111544c9f2 WatchSource:0}: Error finding container 46412b95ee4e9a25cdb2d688b3867ace1a7f126a854b08feb7c823111544c9f2: Status 404 returned error can't find the container with id 46412b95ee4e9a25cdb2d688b3867ace1a7f126a854b08feb7c823111544c9f2
Jun 15 05:53:39.457470 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:39.457446    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz" event={"ID":"d7b2e555-96ce-4603-89f5-d66dc24c5d70","Type":"ContainerStarted","Data":"46412b95ee4e9a25cdb2d688b3867ace1a7f126a854b08feb7c823111544c9f2"}
Jun 15 05:53:40.293585 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:40.293550    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jun 15 05:53:43.477213 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:43.477176    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz" event={"ID":"d7b2e555-96ce-4603-89f5-d66dc24c5d70","Type":"ContainerStarted","Data":"fc1345ba0c13ccf954729d21e44a013ca0af7e545f4b461e68693a3fbed83cff"}
Jun 15 05:53:43.477642 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:43.477322    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:43.478951 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:43.478926    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz"
Jun 15 05:53:43.496988 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:43.496942    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777485d587-9zgwz" podStartSLOduration=1.9750650699999999 podStartE2EDuration="5.496928763s" totalImagesPullingTime="3.521863693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:53:43.495486657 +0000 UTC m=+303.629659907" watchObservedRunningTime="2026-06-15 05:53:43.496928763 +0000 UTC m=+303.631102014"
Jun 15 05:53:46.471015 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.470950    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68dd79d5bf-r9nnk" podUID="10803494-79ef-4830-8a70-39dc97f50f13" containerName="console" containerID="cri-o://faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476" gracePeriod=15
Jun 15 05:53:46.707911 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.707890    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:53:46.872872 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.872807    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-console-config\") pod \"10803494-79ef-4830-8a70-39dc97f50f13\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") "
Jun 15 05:53:46.872872 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.872834    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-trusted-ca-bundle\") pod \"10803494-79ef-4830-8a70-39dc97f50f13\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") "
Jun 15 05:53:46.872872 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.872864    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-oauth-serving-cert\") pod \"10803494-79ef-4830-8a70-39dc97f50f13\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") "
Jun 15 05:53:46.873142 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.872888    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-service-ca\") pod \"10803494-79ef-4830-8a70-39dc97f50f13\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") "
Jun 15 05:53:46.873142 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.872919    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-oauth-config\") pod \"10803494-79ef-4830-8a70-39dc97f50f13\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") "
Jun 15 05:53:46.873142 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.872943    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-serving-cert\") pod \"10803494-79ef-4830-8a70-39dc97f50f13\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") "
Jun 15 05:53:46.873142 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.872976    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj7gn\" (UniqueName: \"kubernetes.io/projected/10803494-79ef-4830-8a70-39dc97f50f13-kube-api-access-sj7gn\") pod \"10803494-79ef-4830-8a70-39dc97f50f13\" (UID: \"10803494-79ef-4830-8a70-39dc97f50f13\") "
Jun 15 05:53:46.873346 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.873284    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-console-config" (OuterVolumeSpecName: "console-config") pod "10803494-79ef-4830-8a70-39dc97f50f13" (UID: "10803494-79ef-4830-8a70-39dc97f50f13"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:53:46.873398 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.873351    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "10803494-79ef-4830-8a70-39dc97f50f13" (UID: "10803494-79ef-4830-8a70-39dc97f50f13"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:53:46.873398 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.873362    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "10803494-79ef-4830-8a70-39dc97f50f13" (UID: "10803494-79ef-4830-8a70-39dc97f50f13"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:53:46.873475 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.873425    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-service-ca" (OuterVolumeSpecName: "service-ca") pod "10803494-79ef-4830-8a70-39dc97f50f13" (UID: "10803494-79ef-4830-8a70-39dc97f50f13"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:53:46.875420 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.875381    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10803494-79ef-4830-8a70-39dc97f50f13-kube-api-access-sj7gn" (OuterVolumeSpecName: "kube-api-access-sj7gn") pod "10803494-79ef-4830-8a70-39dc97f50f13" (UID: "10803494-79ef-4830-8a70-39dc97f50f13"). InnerVolumeSpecName "kube-api-access-sj7gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:53:46.875420 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.875397    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "10803494-79ef-4830-8a70-39dc97f50f13" (UID: "10803494-79ef-4830-8a70-39dc97f50f13"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:53:46.875559 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.875454    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "10803494-79ef-4830-8a70-39dc97f50f13" (UID: "10803494-79ef-4830-8a70-39dc97f50f13"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:53:46.973708 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.973683    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-oauth-serving-cert\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:53:46.973708 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.973704    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-service-ca\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:53:46.973845 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.973715    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-oauth-config\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:53:46.973845 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.973730    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10803494-79ef-4830-8a70-39dc97f50f13-console-serving-cert\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:53:46.973845 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.973757    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj7gn\" (UniqueName: \"kubernetes.io/projected/10803494-79ef-4830-8a70-39dc97f50f13-kube-api-access-sj7gn\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:53:46.973845 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.973767    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-console-config\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:53:46.973845 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:46.973775    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10803494-79ef-4830-8a70-39dc97f50f13-trusted-ca-bundle\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:53:47.490916 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:47.490883    2573 generic.go:356] "Generic (PLEG): container finished" podID="10803494-79ef-4830-8a70-39dc97f50f13" containerID="faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476" exitCode=0
Jun 15 05:53:47.490916 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:47.490920    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dd79d5bf-r9nnk"
Jun 15 05:53:47.491356 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:47.490955    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dd79d5bf-r9nnk" event={"ID":"10803494-79ef-4830-8a70-39dc97f50f13","Type":"ContainerDied","Data":"faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476"}
Jun 15 05:53:47.491356 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:47.490990    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dd79d5bf-r9nnk" event={"ID":"10803494-79ef-4830-8a70-39dc97f50f13","Type":"ContainerDied","Data":"5cbfab1e5edd240ffa222f9d6b6971824cab636191518cfc40d34c40f0972dbc"}
Jun 15 05:53:47.491356 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:47.491009    2573 scope.go:117] "RemoveContainer" containerID="faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476"
Jun 15 05:53:47.499610 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:47.499592    2573 scope.go:117] "RemoveContainer" containerID="faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476"
Jun 15 05:53:47.499860 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:53:47.499843    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476\": container with ID starting with faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476 not found: ID does not exist" containerID="faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476"
Jun 15 05:53:47.499913 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:47.499869    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476"} err="failed to get container status \"faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476\": rpc error: code = NotFound desc = could not find container \"faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476\": container with ID starting with faa6be45541e8f7efe1c2fd96f389f8b1696852707827d1edc60b6cec4a68476 not found: ID does not exist"
Jun 15 05:53:47.513785 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:47.513761    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68dd79d5bf-r9nnk"]
Jun 15 05:53:47.519252 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:47.519232    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68dd79d5bf-r9nnk"]
Jun 15 05:53:48.335044 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:53:48.335012    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10803494-79ef-4830-8a70-39dc97f50f13" path="/var/lib/kubelet/pods/10803494-79ef-4830-8a70-39dc97f50f13/volumes"
Jun 15 05:54:01.687718 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.687678    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"]
Jun 15 05:54:01.688198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.688065    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10803494-79ef-4830-8a70-39dc97f50f13" containerName="console"
Jun 15 05:54:01.688198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.688100    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="10803494-79ef-4830-8a70-39dc97f50f13" containerName="console"
Jun 15 05:54:01.688198 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.688185    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="10803494-79ef-4830-8a70-39dc97f50f13" containerName="console"
Jun 15 05:54:01.689958 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.689939    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"
Jun 15 05:54:01.694716 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.694692    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jun 15 05:54:01.695148 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.695134    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-6h89t\""
Jun 15 05:54:01.695436 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.695419    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jun 15 05:54:01.696059 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.695939    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jun 15 05:54:01.708394 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.708374    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"]
Jun 15 05:54:01.768521 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.768487    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bnff\" (UniqueName: \"kubernetes.io/projected/423792cc-c70b-4987-bb92-66765b8588a3-kube-api-access-4bnff\") pod \"custom-metrics-autoscaler-operator-6685d4df84-b4lgr\" (UID: \"423792cc-c70b-4987-bb92-66765b8588a3\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"
Jun 15 05:54:01.768670 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.768547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/423792cc-c70b-4987-bb92-66765b8588a3-certificates\") pod \"custom-metrics-autoscaler-operator-6685d4df84-b4lgr\" (UID: \"423792cc-c70b-4987-bb92-66765b8588a3\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"
Jun 15 05:54:01.869060 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.869012    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/423792cc-c70b-4987-bb92-66765b8588a3-certificates\") pod \"custom-metrics-autoscaler-operator-6685d4df84-b4lgr\" (UID: \"423792cc-c70b-4987-bb92-66765b8588a3\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"
Jun 15 05:54:01.869278 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.869129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bnff\" (UniqueName: \"kubernetes.io/projected/423792cc-c70b-4987-bb92-66765b8588a3-kube-api-access-4bnff\") pod \"custom-metrics-autoscaler-operator-6685d4df84-b4lgr\" (UID: \"423792cc-c70b-4987-bb92-66765b8588a3\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"
Jun 15 05:54:01.871528 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.871506    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/423792cc-c70b-4987-bb92-66765b8588a3-certificates\") pod \"custom-metrics-autoscaler-operator-6685d4df84-b4lgr\" (UID: \"423792cc-c70b-4987-bb92-66765b8588a3\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"
Jun 15 05:54:01.881314 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.881284    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bnff\" (UniqueName: \"kubernetes.io/projected/423792cc-c70b-4987-bb92-66765b8588a3-kube-api-access-4bnff\") pod \"custom-metrics-autoscaler-operator-6685d4df84-b4lgr\" (UID: \"423792cc-c70b-4987-bb92-66765b8588a3\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"
Jun 15 05:54:01.999831 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:01.999739    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"
Jun 15 05:54:02.138272 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:02.138248    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"]
Jun 15 05:54:02.140476 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:54:02.140445    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423792cc_c70b_4987_bb92_66765b8588a3.slice/crio-26e3312893530409ad7b62aa27e15968cef17a8e9e6645ad066a778161d07643 WatchSource:0}: Error finding container 26e3312893530409ad7b62aa27e15968cef17a8e9e6645ad066a778161d07643: Status 404 returned error can't find the container with id 26e3312893530409ad7b62aa27e15968cef17a8e9e6645ad066a778161d07643
Jun 15 05:54:02.142367 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:02.142350    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 05:54:02.543656 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:02.543618    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr" event={"ID":"423792cc-c70b-4987-bb92-66765b8588a3","Type":"ContainerStarted","Data":"26e3312893530409ad7b62aa27e15968cef17a8e9e6645ad066a778161d07643"}
Jun 15 05:54:06.563512 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:06.563429    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr" event={"ID":"423792cc-c70b-4987-bb92-66765b8588a3","Type":"ContainerStarted","Data":"bfb128d3e94f7cea9bfa1a920de2f8a30ba4115e70eb6e116527a6e8dd233e0e"}
Jun 15 05:54:06.563862 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:06.563573    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"
Jun 15 05:54:06.588303 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:06.588257    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr" podStartSLOduration=1.474302386 podStartE2EDuration="5.588245661s" totalImagesPullingTime="4.113943275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:54:06.586903082 +0000 UTC m=+326.721076332" watchObservedRunningTime="2026-06-15 05:54:06.588245661 +0000 UTC m=+326.722418927"
Jun 15 05:54:07.377757 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:07.377724    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-c6d879546-v7nv9"]
Jun 15 05:54:07.379750 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:07.379735    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-c6d879546-v7nv9"
Jun 15 05:54:07.382746 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:07.382726    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jun 15 05:54:07.382860 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:07.382761    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-2v4gw\""
Jun 15 05:54:07.382860 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:07.382815    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jun 15 05:54:07.394959 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:07.394938    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-c6d879546-v7nv9"]
Jun 15 05:54:07.414889 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:07.414871    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7b969f5c-d082-481b-9b1b-c0004881fc11-certificates\") pod \"keda-admission-c6d879546-v7nv9\" (UID: \"7b969f5c-d082-481b-9b1b-c0004881fc11\") " pod="openshift-keda/keda-admission-c6d879546-v7nv9"
Jun 15 05:54:07.414990 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:07.414919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgsrx\" (UniqueName: \"kubernetes.io/projected/7b969f5c-d082-481b-9b1b-c0004881fc11-kube-api-access-jgsrx\") pod \"keda-admission-c6d879546-v7nv9\" (UID: \"7b969f5c-d082-481b-9b1b-c0004881fc11\") " pod="openshift-keda/keda-admission-c6d879546-v7nv9"
Jun 15 05:54:07.515628 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:07.515608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgsrx\" (UniqueName: \"kubernetes.io/projected/7b969f5c-d082-481b-9b1b-c0004881fc11-kube-api-access-jgsrx\") pod \"keda-admission-c6d879546-v7nv9\" (UID: \"7b969f5c-d082-481b-9b1b-c0004881fc11\") " pod="openshift-keda/keda-admission-c6d879546-v7nv9"
Jun 15 05:54:07.515743 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:07.515663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7b969f5c-d082-481b-9b1b-c0004881fc11-certificates\") pod \"keda-admission-c6d879546-v7nv9\" (UID: \"7b969f5c-d082-481b-9b1b-c0004881fc11\") " pod="openshift-keda/keda-admission-c6d879546-v7nv9"
Jun 15 05:54:07.515814 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:54:07.515798    2573 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Jun 15 05:54:07.515870 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:54:07.515825    2573 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-c6d879546-v7nv9: secret "keda-admission-webhooks-certs" not found
Jun 15 05:54:07.515927 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:54:07.515904    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b969f5c-d082-481b-9b1b-c0004881fc11-certificates podName:7b969f5c-d082-481b-9b1b-c0004881fc11 nodeName:}" failed. No retries permitted until 2026-06-15 05:54:08.015884828 +0000 UTC m=+328.150058059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/7b969f5c-d082-481b-9b1b-c0004881fc11-certificates") pod "keda-admission-c6d879546-v7nv9" (UID: "7b969f5c-d082-481b-9b1b-c0004881fc11") : secret "keda-admission-webhooks-certs" not found
Jun 15 05:54:07.529022 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:07.529005    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgsrx\" (UniqueName: \"kubernetes.io/projected/7b969f5c-d082-481b-9b1b-c0004881fc11-kube-api-access-jgsrx\") pod \"keda-admission-c6d879546-v7nv9\" (UID: \"7b969f5c-d082-481b-9b1b-c0004881fc11\") " pod="openshift-keda/keda-admission-c6d879546-v7nv9"
Jun 15 05:54:08.020527 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:08.020491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7b969f5c-d082-481b-9b1b-c0004881fc11-certificates\") pod \"keda-admission-c6d879546-v7nv9\" (UID: \"7b969f5c-d082-481b-9b1b-c0004881fc11\") " pod="openshift-keda/keda-admission-c6d879546-v7nv9"
Jun 15 05:54:08.023121 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:08.023077    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7b969f5c-d082-481b-9b1b-c0004881fc11-certificates\") pod \"keda-admission-c6d879546-v7nv9\" (UID: \"7b969f5c-d082-481b-9b1b-c0004881fc11\") " pod="openshift-keda/keda-admission-c6d879546-v7nv9"
Jun 15 05:54:08.289807 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:08.289734    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-c6d879546-v7nv9"
Jun 15 05:54:08.421943 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:08.421912    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-c6d879546-v7nv9"]
Jun 15 05:54:08.425451 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:54:08.425427    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b969f5c_d082_481b_9b1b_c0004881fc11.slice/crio-d0f4363d6097f91f6e9a96e7d82d19ff827f493c0d1a62e390b662291ec4d6fe WatchSource:0}: Error finding container d0f4363d6097f91f6e9a96e7d82d19ff827f493c0d1a62e390b662291ec4d6fe: Status 404 returned error can't find the container with id d0f4363d6097f91f6e9a96e7d82d19ff827f493c0d1a62e390b662291ec4d6fe
Jun 15 05:54:08.573400 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:08.573339    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-c6d879546-v7nv9" event={"ID":"7b969f5c-d082-481b-9b1b-c0004881fc11","Type":"ContainerStarted","Data":"d0f4363d6097f91f6e9a96e7d82d19ff827f493c0d1a62e390b662291ec4d6fe"}
Jun 15 05:54:10.581769 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:10.581735    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-c6d879546-v7nv9" event={"ID":"7b969f5c-d082-481b-9b1b-c0004881fc11","Type":"ContainerStarted","Data":"4a805e1435337effc884141e67e4e980e9cc4eda4f930872517ae20ace1ae819"}
Jun 15 05:54:10.582204 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:10.581847    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-c6d879546-v7nv9"
Jun 15 05:54:10.601262 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:10.601223    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-c6d879546-v7nv9" podStartSLOduration=2.212000147 podStartE2EDuration="3.601210784s" totalImagesPullingTime="1.389210637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:54:10.599715438 +0000 UTC m=+330.733888691" watchObservedRunningTime="2026-06-15 05:54:10.601210784 +0000 UTC m=+330.735384033"
Jun 15 05:54:27.569898 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:27.569869    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-b4lgr"
Jun 15 05:54:31.587830 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:54:31.587800    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-c6d879546-v7nv9"
Jun 15 05:55:17.046447 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.046412    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6c7654bd99-fz97p"]
Jun 15 05:55:17.048707 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.048686    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:55:17.049480 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.049456    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6c7654bd99-fz97p"]
Jun 15 05:55:17.056632 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.056613    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jun 15 05:55:17.056749 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.056632    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jun 15 05:55:17.057434 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.057414    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jun 15 05:55:17.057528 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.057415    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-mckr6\""
Jun 15 05:55:17.077248 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.077219    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"]
Jun 15 05:55:17.079772 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.079757    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 05:55:17.083296 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.083281    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-dg796\""
Jun 15 05:55:17.083560 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.083543    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jun 15 05:55:17.093031 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.093009    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"]
Jun 15 05:55:17.142206 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.142183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3874d0fa-8684-41d2-ab9a-22a45b59ba70-cert\") pod \"kserve-controller-manager-6c7654bd99-fz97p\" (UID: \"3874d0fa-8684-41d2-ab9a-22a45b59ba70\") " pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:55:17.142340 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.142214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-cert\") pod \"llmisvc-controller-manager-58d9dd6777-f4fnv\" (UID: \"8f596b9f-5a78-4580-8e9c-f3ca752ba88e\") " pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 05:55:17.142340 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.142276    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb7p9\" (UniqueName: \"kubernetes.io/projected/3874d0fa-8684-41d2-ab9a-22a45b59ba70-kube-api-access-tb7p9\") pod \"kserve-controller-manager-6c7654bd99-fz97p\" (UID: \"3874d0fa-8684-41d2-ab9a-22a45b59ba70\") " pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:55:17.142340 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.142334    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7dkn\" (UniqueName: \"kubernetes.io/projected/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-kube-api-access-h7dkn\") pod \"llmisvc-controller-manager-58d9dd6777-f4fnv\" (UID: \"8f596b9f-5a78-4580-8e9c-f3ca752ba88e\") " pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 05:55:17.243182 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.243154    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7dkn\" (UniqueName: \"kubernetes.io/projected/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-kube-api-access-h7dkn\") pod \"llmisvc-controller-manager-58d9dd6777-f4fnv\" (UID: \"8f596b9f-5a78-4580-8e9c-f3ca752ba88e\") " pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 05:55:17.243358 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.243198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3874d0fa-8684-41d2-ab9a-22a45b59ba70-cert\") pod \"kserve-controller-manager-6c7654bd99-fz97p\" (UID: \"3874d0fa-8684-41d2-ab9a-22a45b59ba70\") " pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:55:17.243358 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.243321    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-cert\") pod \"llmisvc-controller-manager-58d9dd6777-f4fnv\" (UID: \"8f596b9f-5a78-4580-8e9c-f3ca752ba88e\") " pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 05:55:17.243473 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.243390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb7p9\" (UniqueName: \"kubernetes.io/projected/3874d0fa-8684-41d2-ab9a-22a45b59ba70-kube-api-access-tb7p9\") pod \"kserve-controller-manager-6c7654bd99-fz97p\" (UID: \"3874d0fa-8684-41d2-ab9a-22a45b59ba70\") " pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:55:17.245712 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.245690    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3874d0fa-8684-41d2-ab9a-22a45b59ba70-cert\") pod \"kserve-controller-manager-6c7654bd99-fz97p\" (UID: \"3874d0fa-8684-41d2-ab9a-22a45b59ba70\") " pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:55:17.245819 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.245731    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-cert\") pod \"llmisvc-controller-manager-58d9dd6777-f4fnv\" (UID: \"8f596b9f-5a78-4580-8e9c-f3ca752ba88e\") " pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 05:55:17.253337 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.253318    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7dkn\" (UniqueName: \"kubernetes.io/projected/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-kube-api-access-h7dkn\") pod \"llmisvc-controller-manager-58d9dd6777-f4fnv\" (UID: \"8f596b9f-5a78-4580-8e9c-f3ca752ba88e\") " pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 05:55:17.254202 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.254179    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb7p9\" (UniqueName: \"kubernetes.io/projected/3874d0fa-8684-41d2-ab9a-22a45b59ba70-kube-api-access-tb7p9\") pod \"kserve-controller-manager-6c7654bd99-fz97p\" (UID: \"3874d0fa-8684-41d2-ab9a-22a45b59ba70\") " pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:55:17.360029 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.359962    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:55:17.389662 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.389638    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 05:55:17.500225 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.500167    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6c7654bd99-fz97p"]
Jun 15 05:55:17.502311 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:55:17.502282    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3874d0fa_8684_41d2_ab9a_22a45b59ba70.slice/crio-3ca7b1b117a41a3111685ca897132095ce3d74d71113cea5adcd57242c402e7a WatchSource:0}: Error finding container 3ca7b1b117a41a3111685ca897132095ce3d74d71113cea5adcd57242c402e7a: Status 404 returned error can't find the container with id 3ca7b1b117a41a3111685ca897132095ce3d74d71113cea5adcd57242c402e7a
Jun 15 05:55:17.522092 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.522066    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"]
Jun 15 05:55:17.527034 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:55:17.527005    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8f596b9f_5a78_4580_8e9c_f3ca752ba88e.slice/crio-06a58efe0cf390175f4b121f23944f4b2b1e0d47b386ffb81ee3bebcb44622ed WatchSource:0}: Error finding container 06a58efe0cf390175f4b121f23944f4b2b1e0d47b386ffb81ee3bebcb44622ed: Status 404 returned error can't find the container with id 06a58efe0cf390175f4b121f23944f4b2b1e0d47b386ffb81ee3bebcb44622ed
Jun 15 05:55:17.825928 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.825894    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv" event={"ID":"8f596b9f-5a78-4580-8e9c-f3ca752ba88e","Type":"ContainerStarted","Data":"06a58efe0cf390175f4b121f23944f4b2b1e0d47b386ffb81ee3bebcb44622ed"}
Jun 15 05:55:17.826914 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:17.826886    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p" event={"ID":"3874d0fa-8684-41d2-ab9a-22a45b59ba70","Type":"ContainerStarted","Data":"3ca7b1b117a41a3111685ca897132095ce3d74d71113cea5adcd57242c402e7a"}
Jun 15 05:55:20.842098 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:20.842047    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv" event={"ID":"8f596b9f-5a78-4580-8e9c-f3ca752ba88e","Type":"ContainerStarted","Data":"070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687"}
Jun 15 05:55:20.842518 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:20.842126    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 05:55:20.843574 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:20.843550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p" event={"ID":"3874d0fa-8684-41d2-ab9a-22a45b59ba70","Type":"ContainerStarted","Data":"e1721449330c29955ebcd8903f5af312d066e3542dcbe87abc5186cbf65408e2"}
Jun 15 05:55:20.843692 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:20.843655    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:55:20.861205 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:20.861161    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv" podStartSLOduration=0.721158906 podStartE2EDuration="3.861145571s" totalImagesPullingTime="3.139986665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:55:20.860320817 +0000 UTC m=+400.994494069" watchObservedRunningTime="2026-06-15 05:55:20.861145571 +0000 UTC m=+400.995318820"
Jun 15 05:55:20.881884 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:20.881841    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p" podStartSLOduration=1.716802025 podStartE2EDuration="4.881828009s" totalImagesPullingTime="3.165025984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:55:20.881019328 +0000 UTC m=+401.015192579" watchObservedRunningTime="2026-06-15 05:55:20.881828009 +0000 UTC m=+401.016001304"
Jun 15 05:55:51.850039 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:51.849958    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 05:55:51.853147 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:55:51.853128    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:56:37.525588 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.525557    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-688rx"]
Jun 15 05:56:37.528861 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.528841    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx"
Jun 15 05:56:37.531259 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.531229    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jun 15 05:56:37.531369 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.531256    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zh4kp\""
Jun 15 05:56:37.531369 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.531270    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jun 15 05:56:37.538208 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.538183    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-688rx"]
Jun 15 05:56:37.550729 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.550709    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn7z7\" (UniqueName: \"kubernetes.io/projected/dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4-kube-api-access-tn7z7\") pod \"cert-manager-webhook-7dc76cbb94-688rx\" (UID: \"dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx"
Jun 15 05:56:37.550809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.550752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-688rx\" (UID: \"dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx"
Jun 15 05:56:37.651100 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.651067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn7z7\" (UniqueName: \"kubernetes.io/projected/dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4-kube-api-access-tn7z7\") pod \"cert-manager-webhook-7dc76cbb94-688rx\" (UID: \"dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx"
Jun 15 05:56:37.651236 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.651134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-688rx\" (UID: \"dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx"
Jun 15 05:56:37.663649 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.663627    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-688rx\" (UID: \"dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx"
Jun 15 05:56:37.664261 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.664233    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn7z7\" (UniqueName: \"kubernetes.io/projected/dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4-kube-api-access-tn7z7\") pod \"cert-manager-webhook-7dc76cbb94-688rx\" (UID: \"dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx"
Jun 15 05:56:37.852035 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.851952    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx"
Jun 15 05:56:37.986062 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:37.986033    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-688rx"]
Jun 15 05:56:37.988521 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:56:37.988492    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcf94bd4_67fd_4aae_80ee_d3f021cdd6f4.slice/crio-15703bd54844709101f02d25643aca160bdc11416c6ed0a8dd1a11950efb0555 WatchSource:0}: Error finding container 15703bd54844709101f02d25643aca160bdc11416c6ed0a8dd1a11950efb0555: Status 404 returned error can't find the container with id 15703bd54844709101f02d25643aca160bdc11416c6ed0a8dd1a11950efb0555
Jun 15 05:56:38.146428 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:38.146347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx" event={"ID":"dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4","Type":"ContainerStarted","Data":"15703bd54844709101f02d25643aca160bdc11416c6ed0a8dd1a11950efb0555"}
Jun 15 05:56:41.161227 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:41.161198    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx" event={"ID":"dcf94bd4-67fd-4aae-80ee-d3f021cdd6f4","Type":"ContainerStarted","Data":"6e18b05bd2f1bd14c8a6ace4e8bc43916f5336ee5d0e6f23fa89d21e7533d93a"}
Jun 15 05:56:41.161598 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:41.161323    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx"
Jun 15 05:56:41.181632 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:41.181588    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx" podStartSLOduration=1.130447027 podStartE2EDuration="4.181558373s" totalImagesPullingTime="3.051111346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:56:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:56:41.180739979 +0000 UTC m=+481.314913262" watchObservedRunningTime="2026-06-15 05:56:41.181558373 +0000 UTC m=+481.315731623"
Jun 15 05:56:42.655411 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.655375    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6db995c7bf-t6hv2"]
Jun 15 05:56:42.659462 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.659432    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.671452 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.671429    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6db995c7bf-t6hv2"]
Jun 15 05:56:42.692284 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.692256    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-trusted-ca-bundle\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.692399 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.692296    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-console-oauth-config\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.692399 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.692328    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-oauth-serving-cert\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.692399 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.692378    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-service-ca\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.692521 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.692414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lcxr\" (UniqueName: \"kubernetes.io/projected/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-kube-api-access-7lcxr\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.692521 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.692434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-console-config\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.692521 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.692454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-console-serving-cert\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.792866 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.792835    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-console-serving-cert\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.793007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.792895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-trusted-ca-bundle\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.793007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.792926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-console-oauth-config\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.793007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.792956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-oauth-serving-cert\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.793007 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.792990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-service-ca\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.793248 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.793026    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lcxr\" (UniqueName: \"kubernetes.io/projected/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-kube-api-access-7lcxr\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.793248 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.793056    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-console-config\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.793813 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.793783    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-service-ca\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.793891 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.793792    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-console-config\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.793891 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.793868    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-trusted-ca-bundle\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.793961 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.793893    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-oauth-serving-cert\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.795507 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.795482    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-console-oauth-config\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.795594 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.795483    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-console-serving-cert\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.802443 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.802422    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lcxr\" (UniqueName: \"kubernetes.io/projected/f717a237-4dd9-47ab-b3f9-83e2d756b1b3-kube-api-access-7lcxr\") pod \"console-6db995c7bf-t6hv2\" (UID: \"f717a237-4dd9-47ab-b3f9-83e2d756b1b3\") " pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:42.969550 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:42.969513    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:43.114637 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:43.114612    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6db995c7bf-t6hv2"]
Jun 15 05:56:43.117058 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:56:43.117031    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf717a237_4dd9_47ab_b3f9_83e2d756b1b3.slice/crio-774ab06af563d0fe95a7b8167222df9d9cad605432a9e69dbad73b74008cb642 WatchSource:0}: Error finding container 774ab06af563d0fe95a7b8167222df9d9cad605432a9e69dbad73b74008cb642: Status 404 returned error can't find the container with id 774ab06af563d0fe95a7b8167222df9d9cad605432a9e69dbad73b74008cb642
Jun 15 05:56:43.170306 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:43.170281    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db995c7bf-t6hv2" event={"ID":"f717a237-4dd9-47ab-b3f9-83e2d756b1b3","Type":"ContainerStarted","Data":"774ab06af563d0fe95a7b8167222df9d9cad605432a9e69dbad73b74008cb642"}
Jun 15 05:56:44.175486 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:44.175447    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db995c7bf-t6hv2" event={"ID":"f717a237-4dd9-47ab-b3f9-83e2d756b1b3","Type":"ContainerStarted","Data":"4904ea56b76babb2001777283d0e26725400f9f1b814ab10427a7bdba5be9b17"}
Jun 15 05:56:44.198922 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:44.198877    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6db995c7bf-t6hv2" podStartSLOduration=2.198863918 podStartE2EDuration="2.198863918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:56:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:56:44.198030242 +0000 UTC m=+484.332203494" watchObservedRunningTime="2026-06-15 05:56:44.198863918 +0000 UTC m=+484.333037223"
Jun 15 05:56:47.167523 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:47.167487    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-688rx"
Jun 15 05:56:52.969651 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:52.969611    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:52.970067 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:52.969695    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:52.974228 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:52.974211    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:53.217701 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:53.217673    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6db995c7bf-t6hv2"
Jun 15 05:56:53.272829 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:56:53.272757    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7469d577-mrl6z"]
Jun 15 05:57:16.434440 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.434407    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"]
Jun 15 05:57:16.438501 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.438484    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"
Jun 15 05:57:16.442068 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.442047    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-bzgk7\""
Jun 15 05:57:16.442204 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.442049    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
Jun 15 05:57:16.442710 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.442692    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
Jun 15 05:57:16.469186 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.469167    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"]
Jun 15 05:57:16.558637 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.558609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4229277a-90a9-4198-9b7e-2909a3443e8c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8cd6g\" (UID: \"4229277a-90a9-4198-9b7e-2909a3443e8c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"
Jun 15 05:57:16.558775 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.558652    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7krz\" (UniqueName: \"kubernetes.io/projected/4229277a-90a9-4198-9b7e-2909a3443e8c-kube-api-access-k7krz\") pod \"servicemesh-operator3-57f65f65fb-8cd6g\" (UID: \"4229277a-90a9-4198-9b7e-2909a3443e8c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"
Jun 15 05:57:16.659621 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.659593    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4229277a-90a9-4198-9b7e-2909a3443e8c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8cd6g\" (UID: \"4229277a-90a9-4198-9b7e-2909a3443e8c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"
Jun 15 05:57:16.659729 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.659637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7krz\" (UniqueName: \"kubernetes.io/projected/4229277a-90a9-4198-9b7e-2909a3443e8c-kube-api-access-k7krz\") pod \"servicemesh-operator3-57f65f65fb-8cd6g\" (UID: \"4229277a-90a9-4198-9b7e-2909a3443e8c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"
Jun 15 05:57:16.662216 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.662197    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4229277a-90a9-4198-9b7e-2909a3443e8c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8cd6g\" (UID: \"4229277a-90a9-4198-9b7e-2909a3443e8c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"
Jun 15 05:57:16.670451 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.670431    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7krz\" (UniqueName: \"kubernetes.io/projected/4229277a-90a9-4198-9b7e-2909a3443e8c-kube-api-access-k7krz\") pod \"servicemesh-operator3-57f65f65fb-8cd6g\" (UID: \"4229277a-90a9-4198-9b7e-2909a3443e8c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"
Jun 15 05:57:16.748158 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.748109    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"
Jun 15 05:57:16.914809 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:16.914789    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"]
Jun 15 05:57:16.917563 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:57:16.917537    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4229277a_90a9_4198_9b7e_2909a3443e8c.slice/crio-98994a199e83011ed717da31610995fb062fef73693a09c41c81a6ebb2538924 WatchSource:0}: Error finding container 98994a199e83011ed717da31610995fb062fef73693a09c41c81a6ebb2538924: Status 404 returned error can't find the container with id 98994a199e83011ed717da31610995fb062fef73693a09c41c81a6ebb2538924
Jun 15 05:57:17.310542 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:17.310506    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g" event={"ID":"4229277a-90a9-4198-9b7e-2909a3443e8c","Type":"ContainerStarted","Data":"98994a199e83011ed717da31610995fb062fef73693a09c41c81a6ebb2538924"}
Jun 15 05:57:18.293798 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:18.293741    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d7469d577-mrl6z" podUID="eb8239da-d72d-49ae-807f-7ba2b28821d9" containerName="console" containerID="cri-o://47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634" gracePeriod=15
Jun 15 05:57:19.319906 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.319880    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:57:19.320981 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.320960    2573 generic.go:356] "Generic (PLEG): container finished" podID="eb8239da-d72d-49ae-807f-7ba2b28821d9" containerID="47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634" exitCode=0
Jun 15 05:57:19.321071 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.321014    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7469d577-mrl6z" event={"ID":"eb8239da-d72d-49ae-807f-7ba2b28821d9","Type":"ContainerDied","Data":"47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634"}
Jun 15 05:57:19.321071 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.321050    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7469d577-mrl6z" event={"ID":"eb8239da-d72d-49ae-807f-7ba2b28821d9","Type":"ContainerDied","Data":"dad797d6185a17df3f2a06f30ebad5c2e01ee7673b5df29db790718e2de4e913"}
Jun 15 05:57:19.321071 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.321070    2573 scope.go:117] "RemoveContainer" containerID="47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634"
Jun 15 05:57:19.332297 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.332276    2573 scope.go:117] "RemoveContainer" containerID="47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634"
Jun 15 05:57:19.332567 ip-10-0-141-25 kubenswrapper[2573]: E0615 05:57:19.332547    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634\": container with ID starting with 47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634 not found: ID does not exist" containerID="47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634"
Jun 15 05:57:19.332636 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.332578    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634"} err="failed to get container status \"47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634\": rpc error: code = NotFound desc = could not find container \"47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634\": container with ID starting with 47d4fe56c5a4a279ae97104f180ddc89b5e499d08ff1e5741ec84cd732559634 not found: ID does not exist"
Jun 15 05:57:19.483334 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.483306    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-oauth-config\") pod \"eb8239da-d72d-49ae-807f-7ba2b28821d9\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") "
Jun 15 05:57:19.483492 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.483339    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-serving-cert\") pod \"eb8239da-d72d-49ae-807f-7ba2b28821d9\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") "
Jun 15 05:57:19.483492 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.483389    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxxcn\" (UniqueName: \"kubernetes.io/projected/eb8239da-d72d-49ae-807f-7ba2b28821d9-kube-api-access-vxxcn\") pod \"eb8239da-d72d-49ae-807f-7ba2b28821d9\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") "
Jun 15 05:57:19.483492 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.483443    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-trusted-ca-bundle\") pod \"eb8239da-d72d-49ae-807f-7ba2b28821d9\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") "
Jun 15 05:57:19.483492 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.483468    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-oauth-serving-cert\") pod \"eb8239da-d72d-49ae-807f-7ba2b28821d9\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") "
Jun 15 05:57:19.483721 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.483520    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-service-ca\") pod \"eb8239da-d72d-49ae-807f-7ba2b28821d9\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") "
Jun 15 05:57:19.483721 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.483553    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-config\") pod \"eb8239da-d72d-49ae-807f-7ba2b28821d9\" (UID: \"eb8239da-d72d-49ae-807f-7ba2b28821d9\") "
Jun 15 05:57:19.484163 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.484052    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eb8239da-d72d-49ae-807f-7ba2b28821d9" (UID: "eb8239da-d72d-49ae-807f-7ba2b28821d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:57:19.484163 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.484065    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-config" (OuterVolumeSpecName: "console-config") pod "eb8239da-d72d-49ae-807f-7ba2b28821d9" (UID: "eb8239da-d72d-49ae-807f-7ba2b28821d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:57:19.484345 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.484142    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "eb8239da-d72d-49ae-807f-7ba2b28821d9" (UID: "eb8239da-d72d-49ae-807f-7ba2b28821d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:57:19.484451 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.484428    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eb8239da-d72d-49ae-807f-7ba2b28821d9" (UID: "eb8239da-d72d-49ae-807f-7ba2b28821d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:57:19.485820 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.485793    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eb8239da-d72d-49ae-807f-7ba2b28821d9" (UID: "eb8239da-d72d-49ae-807f-7ba2b28821d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:57:19.485909 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.485812    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8239da-d72d-49ae-807f-7ba2b28821d9-kube-api-access-vxxcn" (OuterVolumeSpecName: "kube-api-access-vxxcn") pod "eb8239da-d72d-49ae-807f-7ba2b28821d9" (UID: "eb8239da-d72d-49ae-807f-7ba2b28821d9"). InnerVolumeSpecName "kube-api-access-vxxcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:57:19.485909 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.485816    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eb8239da-d72d-49ae-807f-7ba2b28821d9" (UID: "eb8239da-d72d-49ae-807f-7ba2b28821d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:57:19.584549 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.584450    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-service-ca\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:57:19.584549 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.584484    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-config\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:57:19.584549 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.584494    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-oauth-config\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:57:19.584549 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.584503    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb8239da-d72d-49ae-807f-7ba2b28821d9-console-serving-cert\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:57:19.584549 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.584511    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxxcn\" (UniqueName: \"kubernetes.io/projected/eb8239da-d72d-49ae-807f-7ba2b28821d9-kube-api-access-vxxcn\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:57:19.584549 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.584520    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-trusted-ca-bundle\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:57:19.584549 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:19.584527    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb8239da-d72d-49ae-807f-7ba2b28821d9-oauth-serving-cert\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:57:20.326632 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:20.326601    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7469d577-mrl6z"
Jun 15 05:57:20.328589 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:20.328563    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g" event={"ID":"4229277a-90a9-4198-9b7e-2909a3443e8c","Type":"ContainerStarted","Data":"6df9b23b26039c4d97aee22a04693f92155ca5f808cf0bcaf2cb7db2693f038d"}
Jun 15 05:57:20.328706 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:20.328687    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"
Jun 15 05:57:20.389803 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:20.389711    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g" podStartSLOduration=1.971256205 podStartE2EDuration="4.389697383s" totalImagesPullingTime="2.418441178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:57:20.389314788 +0000 UTC m=+520.523488163" watchObservedRunningTime="2026-06-15 05:57:20.389697383 +0000 UTC m=+520.523870633"
Jun 15 05:57:20.420554 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:20.420519    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7469d577-mrl6z"]
Jun 15 05:57:20.425693 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:20.425672    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d7469d577-mrl6z"]
Jun 15 05:57:22.342472 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:22.342442    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb8239da-d72d-49ae-807f-7ba2b28821d9" path="/var/lib/kubelet/pods/eb8239da-d72d-49ae-807f-7ba2b28821d9/volumes"
Jun 15 05:57:25.714776 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.714740    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"]
Jun 15 05:57:25.715261 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.715244    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8239da-d72d-49ae-807f-7ba2b28821d9" containerName="console"
Jun 15 05:57:25.715320 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.715263    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8239da-d72d-49ae-807f-7ba2b28821d9" containerName="console"
Jun 15 05:57:25.715365 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.715342    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8239da-d72d-49ae-807f-7ba2b28821d9" containerName="console"
Jun 15 05:57:25.717610 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.717595    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.719883 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.719851    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 15 05:57:25.720011 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.719997    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 15 05:57:25.720103 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.720002    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4mggc\""
Jun 15 05:57:25.720103 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.720098    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 15 05:57:25.720225 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.720157    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 15 05:57:25.720225 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.720109    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 15 05:57:25.720328 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.720289    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 15 05:57:25.730589 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.730567    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"]
Jun 15 05:57:25.733095 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.733063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b2s5\" (UniqueName: \"kubernetes.io/projected/bd668c67-4e01-4178-be57-e43a17a4657d-kube-api-access-2b2s5\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.733176 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.733153    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd668c67-4e01-4178-be57-e43a17a4657d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.733215 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.733192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd668c67-4e01-4178-be57-e43a17a4657d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.733215 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.733209    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bd668c67-4e01-4178-be57-e43a17a4657d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.733286 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.733227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bd668c67-4e01-4178-be57-e43a17a4657d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.733317 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.733284    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bd668c67-4e01-4178-be57-e43a17a4657d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.733317 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.733303    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd668c67-4e01-4178-be57-e43a17a4657d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.833654 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.833624    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd668c67-4e01-4178-be57-e43a17a4657d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.833810 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.833666    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd668c67-4e01-4178-be57-e43a17a4657d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.833810 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.833684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bd668c67-4e01-4178-be57-e43a17a4657d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.833810 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.833709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bd668c67-4e01-4178-be57-e43a17a4657d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.833810 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.833741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bd668c67-4e01-4178-be57-e43a17a4657d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.833810 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.833765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd668c67-4e01-4178-be57-e43a17a4657d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.834065 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.833818    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b2s5\" (UniqueName: \"kubernetes.io/projected/bd668c67-4e01-4178-be57-e43a17a4657d-kube-api-access-2b2s5\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.834414 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.834387    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bd668c67-4e01-4178-be57-e43a17a4657d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.836173 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.836151    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bd668c67-4e01-4178-be57-e43a17a4657d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.836277 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.836235    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd668c67-4e01-4178-be57-e43a17a4657d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.836277 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.836236    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd668c67-4e01-4178-be57-e43a17a4657d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.836375 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.836303    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bd668c67-4e01-4178-be57-e43a17a4657d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.845016 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.844997    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd668c67-4e01-4178-be57-e43a17a4657d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:25.845741 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:25.845721    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b2s5\" (UniqueName: \"kubernetes.io/projected/bd668c67-4e01-4178-be57-e43a17a4657d-kube-api-access-2b2s5\") pod \"istiod-openshift-gateway-75c67f8887-qbmcr\" (UID: \"bd668c67-4e01-4178-be57-e43a17a4657d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:26.027478 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:26.027394    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:26.164847 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:26.164822    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"]
Jun 15 05:57:26.166998 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:57:26.166975    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd668c67_4e01_4178_be57_e43a17a4657d.slice/crio-d21b8abe90afeb12fa2346ccd5a7e97009a647f5602443958e0f05bae5ab08e4 WatchSource:0}: Error finding container d21b8abe90afeb12fa2346ccd5a7e97009a647f5602443958e0f05bae5ab08e4: Status 404 returned error can't find the container with id d21b8abe90afeb12fa2346ccd5a7e97009a647f5602443958e0f05bae5ab08e4
Jun 15 05:57:26.362339 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:26.362258    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr" event={"ID":"bd668c67-4e01-4178-be57-e43a17a4657d","Type":"ContainerStarted","Data":"d21b8abe90afeb12fa2346ccd5a7e97009a647f5602443958e0f05bae5ab08e4"}
Jun 15 05:57:28.447951 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:28.447915    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jun 15 05:57:28.448213 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:28.447980    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jun 15 05:57:29.380506 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:29.380474    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr" event={"ID":"bd668c67-4e01-4178-be57-e43a17a4657d","Type":"ContainerStarted","Data":"83f4aee86d016c62c6b08b71aeea35f5950860cc4d672f88fb97bb6e2c7e8a8b"}
Jun 15 05:57:29.380694 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:29.380674    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:29.382402 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:29.382374    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-qbmcr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jun 15 05:57:29.382519 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:29.382428    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr" podUID="bd668c67-4e01-4178-be57-e43a17a4657d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 15 05:57:30.385316 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:30.385292    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr"
Jun 15 05:57:30.420489 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:30.420434    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr" podStartSLOduration=3.141592329 podStartE2EDuration="5.420418527s" totalImagesPullingTime="2.278826198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:57:29.410454893 +0000 UTC m=+529.544628141" watchObservedRunningTime="2026-06-15 05:57:30.420418527 +0000 UTC m=+530.554591776"
Jun 15 05:57:31.334565 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:31.334530    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8cd6g"
Jun 15 05:57:33.423284 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.423248    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"]
Jun 15 05:57:33.425433 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.425412    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.431772 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.431470    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-lt7cn\""
Jun 15 05:57:33.461409 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.461381    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"]
Jun 15 05:57:33.495676 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.495644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-workload-certs\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.495804 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.495686    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.495804 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.495713    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mh8v\" (UniqueName: \"kubernetes.io/projected/80d602fe-af57-4796-94f6-2bfcac712cb4-kube-api-access-9mh8v\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.495804 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.495798    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-data\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.495930 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.495837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.495930 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.495907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-token\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.495999 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.495951    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-credential-socket\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.495999 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.495978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-workload-socket\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.496078 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.496000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80d602fe-af57-4796-94f6-2bfcac712cb4-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.596667 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.596627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-workload-certs\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.596667 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.596666    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.596899 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.596683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mh8v\" (UniqueName: \"kubernetes.io/projected/80d602fe-af57-4796-94f6-2bfcac712cb4-kube-api-access-9mh8v\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.596899 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.596741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-data\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.596899 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.596771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.596899 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.596799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-token\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.596899 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.596873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-credential-socket\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.597176 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.596907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-workload-socket\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.597176 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.596942    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80d602fe-af57-4796-94f6-2bfcac712cb4-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.597282 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.597213    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-data\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.597282 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.597255    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-credential-socket\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.597386 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.597319    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-workload-socket\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.597496 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.597448    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-workload-certs\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.597641 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.597619    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80d602fe-af57-4796-94f6-2bfcac712cb4-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.599442 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.599413    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.599532 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.599455    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.625121 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.625072    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80d602fe-af57-4796-94f6-2bfcac712cb4-istio-token\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.625458 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.625436    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mh8v\" (UniqueName: \"kubernetes.io/projected/80d602fe-af57-4796-94f6-2bfcac712cb4-kube-api-access-9mh8v\") pod \"openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd\" (UID: \"80d602fe-af57-4796-94f6-2bfcac712cb4\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.735240 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.735212    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:33.877654 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:33.877627    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"]
Jun 15 05:57:33.880068 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:57:33.880039    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d602fe_af57_4796_94f6_2bfcac712cb4.slice/crio-f28b8543dfd6ba582adb7121acbb0d257d315ed04e271140a13914022386d37e WatchSource:0}: Error finding container f28b8543dfd6ba582adb7121acbb0d257d315ed04e271140a13914022386d37e: Status 404 returned error can't find the container with id f28b8543dfd6ba582adb7121acbb0d257d315ed04e271140a13914022386d37e
Jun 15 05:57:34.404630 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:34.404584    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" event={"ID":"80d602fe-af57-4796-94f6-2bfcac712cb4","Type":"ContainerStarted","Data":"f28b8543dfd6ba582adb7121acbb0d257d315ed04e271140a13914022386d37e"}
Jun 15 05:57:36.228384 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:36.228345    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jun 15 05:57:36.228757 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:36.228437    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jun 15 05:57:36.228757 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:36.228486    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jun 15 05:57:36.417806 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:36.417772    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" event={"ID":"80d602fe-af57-4796-94f6-2bfcac712cb4","Type":"ContainerStarted","Data":"9fc1d317d4ee71f3e085bdf6a645555a9c5a320ca21bdb1ba5d6866b6b4b6cc7"}
Jun 15 05:57:36.440903 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:36.440850    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podStartSLOduration=1.094762496 podStartE2EDuration="3.440834587s" totalImagesPullingTime="2.346072091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:57:36.439122087 +0000 UTC m=+536.573295336" watchObservedRunningTime="2026-06-15 05:57:36.440834587 +0000 UTC m=+536.575007847"
Jun 15 05:57:36.736148 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:36.736114    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:37.740793 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:37.740768    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:38.426151 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:38.426121    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:38.426971 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:38.426953    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 05:57:59.531312 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:59.531278    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6d75c86569-cxdzr"]
Jun 15 05:57:59.547316 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:59.547287    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d75c86569-cxdzr"
Jun 15 05:57:59.548976 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:59.548949    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d75c86569-cxdzr"]
Jun 15 05:57:59.549928 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:59.549898    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 15 05:57:59.550038 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:59.549966    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-r5zhw\""
Jun 15 05:57:59.550164 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:59.550116    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 15 05:57:59.620883 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:59.620856    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpfgb\" (UniqueName: \"kubernetes.io/projected/d7702eb8-c68c-4f71-b444-704933993bed-kube-api-access-lpfgb\") pod \"authorino-operator-6d75c86569-cxdzr\" (UID: \"d7702eb8-c68c-4f71-b444-704933993bed\") " pod="kuadrant-system/authorino-operator-6d75c86569-cxdzr"
Jun 15 05:57:59.722128 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:59.722097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpfgb\" (UniqueName: \"kubernetes.io/projected/d7702eb8-c68c-4f71-b444-704933993bed-kube-api-access-lpfgb\") pod \"authorino-operator-6d75c86569-cxdzr\" (UID: \"d7702eb8-c68c-4f71-b444-704933993bed\") " pod="kuadrant-system/authorino-operator-6d75c86569-cxdzr"
Jun 15 05:57:59.733403 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:59.733381    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpfgb\" (UniqueName: \"kubernetes.io/projected/d7702eb8-c68c-4f71-b444-704933993bed-kube-api-access-lpfgb\") pod \"authorino-operator-6d75c86569-cxdzr\" (UID: \"d7702eb8-c68c-4f71-b444-704933993bed\") " pod="kuadrant-system/authorino-operator-6d75c86569-cxdzr"
Jun 15 05:57:59.858624 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:59.858545    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d75c86569-cxdzr"
Jun 15 05:57:59.998344 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:57:59.998314    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d75c86569-cxdzr"]
Jun 15 05:58:00.002164 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:58:00.002138    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7702eb8_c68c_4f71_b444_704933993bed.slice/crio-4c4d106cd9d82035cb3addc268cf34f008e059f5b9e38d33f41dfc80f644b383 WatchSource:0}: Error finding container 4c4d106cd9d82035cb3addc268cf34f008e059f5b9e38d33f41dfc80f644b383: Status 404 returned error can't find the container with id 4c4d106cd9d82035cb3addc268cf34f008e059f5b9e38d33f41dfc80f644b383
Jun 15 05:58:00.519789 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:00.519758    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d75c86569-cxdzr" event={"ID":"d7702eb8-c68c-4f71-b444-704933993bed","Type":"ContainerStarted","Data":"4c4d106cd9d82035cb3addc268cf34f008e059f5b9e38d33f41dfc80f644b383"}
Jun 15 05:58:03.538596 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:03.538563    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d75c86569-cxdzr" event={"ID":"d7702eb8-c68c-4f71-b444-704933993bed","Type":"ContainerStarted","Data":"2434fb8d7a088fe6dc1840d471538ce71251cc9ee9b345d0a6e1feba61e73a13"}
Jun 15 05:58:03.538982 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:03.538674    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6d75c86569-cxdzr"
Jun 15 05:58:03.570035 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:03.569987    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6d75c86569-cxdzr" podStartSLOduration=2.101459657 podStartE2EDuration="4.569972151s" totalImagesPullingTime="2.468512494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:58:03.567857473 +0000 UTC m=+563.702030723" watchObservedRunningTime="2026-06-15 05:58:03.569972151 +0000 UTC m=+563.704145400"
Jun 15 05:58:07.951061 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:07.951029    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h"]
Jun 15 05:58:07.954447 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:07.954431    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h"
Jun 15 05:58:07.956750 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:07.956735    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-26lw5\""
Jun 15 05:58:08.007543 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:08.007518    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h"]
Jun 15 05:58:08.095963 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:08.095938    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gh66\" (UniqueName: \"kubernetes.io/projected/c11ebb87-dc2e-473b-8d76-7e645a23a065-kube-api-access-6gh66\") pod \"limitador-operator-controller-manager-6f9f468797-cgn2h\" (UID: \"c11ebb87-dc2e-473b-8d76-7e645a23a065\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h"
Jun 15 05:58:08.196642 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:08.196613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gh66\" (UniqueName: \"kubernetes.io/projected/c11ebb87-dc2e-473b-8d76-7e645a23a065-kube-api-access-6gh66\") pod \"limitador-operator-controller-manager-6f9f468797-cgn2h\" (UID: \"c11ebb87-dc2e-473b-8d76-7e645a23a065\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h"
Jun 15 05:58:08.210513 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:08.210454    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gh66\" (UniqueName: \"kubernetes.io/projected/c11ebb87-dc2e-473b-8d76-7e645a23a065-kube-api-access-6gh66\") pod \"limitador-operator-controller-manager-6f9f468797-cgn2h\" (UID: \"c11ebb87-dc2e-473b-8d76-7e645a23a065\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h"
Jun 15 05:58:08.264424 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:08.264404    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h"
Jun 15 05:58:08.406289 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:08.406265    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h"]
Jun 15 05:58:08.408440 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:58:08.408412    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11ebb87_dc2e_473b_8d76_7e645a23a065.slice/crio-53d6d7e7c04e889cdfe848dba96e592585241ca5f048095e1ed456baf59941f9 WatchSource:0}: Error finding container 53d6d7e7c04e889cdfe848dba96e592585241ca5f048095e1ed456baf59941f9: Status 404 returned error can't find the container with id 53d6d7e7c04e889cdfe848dba96e592585241ca5f048095e1ed456baf59941f9
Jun 15 05:58:08.559939 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:08.559872    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h" event={"ID":"c11ebb87-dc2e-473b-8d76-7e645a23a065","Type":"ContainerStarted","Data":"53d6d7e7c04e889cdfe848dba96e592585241ca5f048095e1ed456baf59941f9"}
Jun 15 05:58:10.571386 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:10.571351    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h" event={"ID":"c11ebb87-dc2e-473b-8d76-7e645a23a065","Type":"ContainerStarted","Data":"f5b0912f8d59401685bbb1ecce857716f046299afab17646ecc9aabddf71c790"}
Jun 15 05:58:10.571752 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:10.571411    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h"
Jun 15 05:58:10.594008 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:10.593964    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h" podStartSLOduration=2.09845599 podStartE2EDuration="3.593949426s" totalImagesPullingTime="1.495493436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:58:10.593148605 +0000 UTC m=+570.727321855" watchObservedRunningTime="2026-06-15 05:58:10.593949426 +0000 UTC m=+570.728122676"
Jun 15 05:58:14.544610 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:14.544580    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6d75c86569-cxdzr"
Jun 15 05:58:21.578411 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:21.578383    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h"
Jun 15 05:58:53.965170 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:53.965095    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-qnf8x"]
Jun 15 05:58:53.967220 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:53.967206    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x"
Jun 15 05:58:53.970181 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:53.970159    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 15 05:58:53.970338 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:53.970320    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dvq6x\""
Jun 15 05:58:53.983253 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:53.983230    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-qnf8x"]
Jun 15 05:58:54.001033 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:54.001009    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-qnf8x"]
Jun 15 05:58:54.079682 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:54.079655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ee0e0e76-378b-4fdf-9532-b20ff00fdbaf-config-file\") pod \"limitador-limitador-69574b596d-qnf8x\" (UID: \"ee0e0e76-378b-4fdf-9532-b20ff00fdbaf\") " pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x"
Jun 15 05:58:54.079789 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:54.079700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bt6t\" (UniqueName: \"kubernetes.io/projected/ee0e0e76-378b-4fdf-9532-b20ff00fdbaf-kube-api-access-6bt6t\") pod \"limitador-limitador-69574b596d-qnf8x\" (UID: \"ee0e0e76-378b-4fdf-9532-b20ff00fdbaf\") " pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x"
Jun 15 05:58:54.180400 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:54.180370    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ee0e0e76-378b-4fdf-9532-b20ff00fdbaf-config-file\") pod \"limitador-limitador-69574b596d-qnf8x\" (UID: \"ee0e0e76-378b-4fdf-9532-b20ff00fdbaf\") " pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x"
Jun 15 05:58:54.180518 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:54.180419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bt6t\" (UniqueName: \"kubernetes.io/projected/ee0e0e76-378b-4fdf-9532-b20ff00fdbaf-kube-api-access-6bt6t\") pod \"limitador-limitador-69574b596d-qnf8x\" (UID: \"ee0e0e76-378b-4fdf-9532-b20ff00fdbaf\") " pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x"
Jun 15 05:58:54.181002 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:54.180985    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ee0e0e76-378b-4fdf-9532-b20ff00fdbaf-config-file\") pod \"limitador-limitador-69574b596d-qnf8x\" (UID: \"ee0e0e76-378b-4fdf-9532-b20ff00fdbaf\") " pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x"
Jun 15 05:58:54.190994 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:54.190961    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bt6t\" (UniqueName: \"kubernetes.io/projected/ee0e0e76-378b-4fdf-9532-b20ff00fdbaf-kube-api-access-6bt6t\") pod \"limitador-limitador-69574b596d-qnf8x\" (UID: \"ee0e0e76-378b-4fdf-9532-b20ff00fdbaf\") " pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x"
Jun 15 05:58:54.277218 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:54.277139    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x"
Jun 15 05:58:54.430460 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:54.430432    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-qnf8x"]
Jun 15 05:58:54.430753 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:58:54.430727    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee0e0e76_378b_4fdf_9532_b20ff00fdbaf.slice/crio-113734ec3d49caa2a71b6e605582f8f5ae7de1b8fd629a7fe01e48638c54ca56 WatchSource:0}: Error finding container 113734ec3d49caa2a71b6e605582f8f5ae7de1b8fd629a7fe01e48638c54ca56: Status 404 returned error can't find the container with id 113734ec3d49caa2a71b6e605582f8f5ae7de1b8fd629a7fe01e48638c54ca56
Jun 15 05:58:54.766350 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:54.766314    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x" event={"ID":"ee0e0e76-378b-4fdf-9532-b20ff00fdbaf","Type":"ContainerStarted","Data":"113734ec3d49caa2a71b6e605582f8f5ae7de1b8fd629a7fe01e48638c54ca56"}
Jun 15 05:58:58.790235 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:58.790200    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x" event={"ID":"ee0e0e76-378b-4fdf-9532-b20ff00fdbaf","Type":"ContainerStarted","Data":"82348edc169b97572e479b20d1eeb849d61ec1ed445787b62968e3954e764867"}
Jun 15 05:58:58.790599 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:58.790326    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x"
Jun 15 05:58:58.809935 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:58:58.809891    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x" podStartSLOduration=2.466013647 podStartE2EDuration="5.809876942s" totalImagesPullingTime="3.343863295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:58:58.808233341 +0000 UTC m=+618.942406601" watchObservedRunningTime="2026-06-15 05:58:58.809876942 +0000 UTC m=+618.944050192"
Jun 15 05:59:09.795491 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:09.795459    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-69574b596d-qnf8x"
Jun 15 05:59:25.777321 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.777290    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6c7654bd99-fz97p"]
Jun 15 05:59:25.777797 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.777488    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p" podUID="3874d0fa-8684-41d2-ab9a-22a45b59ba70" containerName="manager" containerID="cri-o://e1721449330c29955ebcd8903f5af312d066e3542dcbe87abc5186cbf65408e2" gracePeriod=10
Jun 15 05:59:25.805948 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.805922    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6c7654bd99-m8vkw"]
Jun 15 05:59:25.809009 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.808995    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw"
Jun 15 05:59:25.823165 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.823143    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6c7654bd99-m8vkw"]
Jun 15 05:59:25.830586 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.830565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ced559b-fcd7-405f-ae68-54de2269dc47-cert\") pod \"kserve-controller-manager-6c7654bd99-m8vkw\" (UID: \"4ced559b-fcd7-405f-ae68-54de2269dc47\") " pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw"
Jun 15 05:59:25.830670 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.830606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp4fw\" (UniqueName: \"kubernetes.io/projected/4ced559b-fcd7-405f-ae68-54de2269dc47-kube-api-access-jp4fw\") pod \"kserve-controller-manager-6c7654bd99-m8vkw\" (UID: \"4ced559b-fcd7-405f-ae68-54de2269dc47\") " pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw"
Jun 15 05:59:25.919774 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.919745    2573 generic.go:356] "Generic (PLEG): container finished" podID="3874d0fa-8684-41d2-ab9a-22a45b59ba70" containerID="e1721449330c29955ebcd8903f5af312d066e3542dcbe87abc5186cbf65408e2" exitCode=0
Jun 15 05:59:25.919916 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.919783    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p" event={"ID":"3874d0fa-8684-41d2-ab9a-22a45b59ba70","Type":"ContainerDied","Data":"e1721449330c29955ebcd8903f5af312d066e3542dcbe87abc5186cbf65408e2"}
Jun 15 05:59:25.931101 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.931055    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ced559b-fcd7-405f-ae68-54de2269dc47-cert\") pod \"kserve-controller-manager-6c7654bd99-m8vkw\" (UID: \"4ced559b-fcd7-405f-ae68-54de2269dc47\") " pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw"
Jun 15 05:59:25.931218 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.931137    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp4fw\" (UniqueName: \"kubernetes.io/projected/4ced559b-fcd7-405f-ae68-54de2269dc47-kube-api-access-jp4fw\") pod \"kserve-controller-manager-6c7654bd99-m8vkw\" (UID: \"4ced559b-fcd7-405f-ae68-54de2269dc47\") " pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw"
Jun 15 05:59:25.933501 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.933480    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ced559b-fcd7-405f-ae68-54de2269dc47-cert\") pod \"kserve-controller-manager-6c7654bd99-m8vkw\" (UID: \"4ced559b-fcd7-405f-ae68-54de2269dc47\") " pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw"
Jun 15 05:59:25.941770 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:25.941747    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp4fw\" (UniqueName: \"kubernetes.io/projected/4ced559b-fcd7-405f-ae68-54de2269dc47-kube-api-access-jp4fw\") pod \"kserve-controller-manager-6c7654bd99-m8vkw\" (UID: \"4ced559b-fcd7-405f-ae68-54de2269dc47\") " pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw"
Jun 15 05:59:26.021722 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.021701    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:59:26.132812 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.132733    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tb7p9\" (UniqueName: \"kubernetes.io/projected/3874d0fa-8684-41d2-ab9a-22a45b59ba70-kube-api-access-tb7p9\") pod \"3874d0fa-8684-41d2-ab9a-22a45b59ba70\" (UID: \"3874d0fa-8684-41d2-ab9a-22a45b59ba70\") "
Jun 15 05:59:26.132948 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.132864    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3874d0fa-8684-41d2-ab9a-22a45b59ba70-cert\") pod \"3874d0fa-8684-41d2-ab9a-22a45b59ba70\" (UID: \"3874d0fa-8684-41d2-ab9a-22a45b59ba70\") "
Jun 15 05:59:26.135040 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.135013    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3874d0fa-8684-41d2-ab9a-22a45b59ba70-kube-api-access-tb7p9" (OuterVolumeSpecName: "kube-api-access-tb7p9") pod "3874d0fa-8684-41d2-ab9a-22a45b59ba70" (UID: "3874d0fa-8684-41d2-ab9a-22a45b59ba70"). InnerVolumeSpecName "kube-api-access-tb7p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:59:26.135040 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.135025    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3874d0fa-8684-41d2-ab9a-22a45b59ba70-cert" (OuterVolumeSpecName: "cert") pod "3874d0fa-8684-41d2-ab9a-22a45b59ba70" (UID: "3874d0fa-8684-41d2-ab9a-22a45b59ba70"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:59:26.169240 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.169207    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw"
Jun 15 05:59:26.234949 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.234927    2573 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3874d0fa-8684-41d2-ab9a-22a45b59ba70-cert\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:59:26.235180 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.235162    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tb7p9\" (UniqueName: \"kubernetes.io/projected/3874d0fa-8684-41d2-ab9a-22a45b59ba70-kube-api-access-tb7p9\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 05:59:26.304322 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.304299    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6c7654bd99-m8vkw"]
Jun 15 05:59:26.305886 ip-10-0-141-25 kubenswrapper[2573]: W0615 05:59:26.305864    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ced559b_fcd7_405f_ae68_54de2269dc47.slice/crio-1d4e93da41ca6d2e1f31a7b1183c6ce220fabf062c0efe21e41ea095e76d5bc6 WatchSource:0}: Error finding container 1d4e93da41ca6d2e1f31a7b1183c6ce220fabf062c0efe21e41ea095e76d5bc6: Status 404 returned error can't find the container with id 1d4e93da41ca6d2e1f31a7b1183c6ce220fabf062c0efe21e41ea095e76d5bc6
Jun 15 05:59:26.307212 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.307193    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 05:59:26.925502 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.925439    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p"
Jun 15 05:59:26.925881 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.925444    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6c7654bd99-fz97p" event={"ID":"3874d0fa-8684-41d2-ab9a-22a45b59ba70","Type":"ContainerDied","Data":"3ca7b1b117a41a3111685ca897132095ce3d74d71113cea5adcd57242c402e7a"}
Jun 15 05:59:26.925881 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.925604    2573 scope.go:117] "RemoveContainer" containerID="e1721449330c29955ebcd8903f5af312d066e3542dcbe87abc5186cbf65408e2"
Jun 15 05:59:26.926962 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.926943    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw" event={"ID":"4ced559b-fcd7-405f-ae68-54de2269dc47","Type":"ContainerStarted","Data":"2e00ac745d18a84ae72503cf364c8b0a050aa7a9dc0b1febedc147470580669c"}
Jun 15 05:59:26.927248 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.926979    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw" event={"ID":"4ced559b-fcd7-405f-ae68-54de2269dc47","Type":"ContainerStarted","Data":"1d4e93da41ca6d2e1f31a7b1183c6ce220fabf062c0efe21e41ea095e76d5bc6"}
Jun 15 05:59:26.927248 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.927059    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw"
Jun 15 05:59:26.947252 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.947228    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6c7654bd99-fz97p"]
Jun 15 05:59:26.952377 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.952357    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-6c7654bd99-fz97p"]
Jun 15 05:59:26.967531 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:26.967403    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw" podStartSLOduration=1.610885765 podStartE2EDuration="1.967386893s" totalImagesPullingTime="356.501128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:59:26.966681572 +0000 UTC m=+647.100854822" watchObservedRunningTime="2026-06-15 05:59:26.967386893 +0000 UTC m=+647.101560147"
Jun 15 05:59:28.340741 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:28.340709    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3874d0fa-8684-41d2-ab9a-22a45b59ba70" path="/var/lib/kubelet/pods/3874d0fa-8684-41d2-ab9a-22a45b59ba70/volumes"
Jun 15 05:59:57.935956 ip-10-0-141-25 kubenswrapper[2573]: I0615 05:59:57.935931    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6c7654bd99-m8vkw"
Jun 15 06:01:50.237505 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.237474    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"]
Jun 15 06:01:50.237893 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.237854    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3874d0fa-8684-41d2-ab9a-22a45b59ba70" containerName="manager"
Jun 15 06:01:50.237893 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.237866    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3874d0fa-8684-41d2-ab9a-22a45b59ba70" containerName="manager"
Jun 15 06:01:50.238114 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.237933    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3874d0fa-8684-41d2-ab9a-22a45b59ba70" containerName="manager"
Jun 15 06:01:50.240982 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.240961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.243843 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.243823    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-ns4gl\""
Jun 15 06:01:50.243960 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.243880    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jun 15 06:01:50.244589 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.244569    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jun 15 06:01:50.244690 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.244593    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fjfwp\""
Jun 15 06:01:50.244690 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.244601    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Jun 15 06:01:50.252538 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.252519    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"]
Jun 15 06:01:50.318459 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.318426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.318565 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.318480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c807fb9a-0d7d-4c96-b27e-675297ec0295-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.318565 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.318522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-698p9\" (UniqueName: \"kubernetes.io/projected/c807fb9a-0d7d-4c96-b27e-675297ec0295-kube-api-access-698p9\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.318636 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.318576    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.318670 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.318649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.419917 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.419841    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.420079 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.419980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.420079 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.420023    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c807fb9a-0d7d-4c96-b27e-675297ec0295-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.420079 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.420051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-698p9\" (UniqueName: \"kubernetes.io/projected/c807fb9a-0d7d-4c96-b27e-675297ec0295-kube-api-access-698p9\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.420296 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.420127    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.420296 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.420281    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.420497 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.420476    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.420592 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.420575    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.422592 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.422575    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c807fb9a-0d7d-4c96-b27e-675297ec0295-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.429648 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.429625    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-698p9\" (UniqueName: \"kubernetes.io/projected/c807fb9a-0d7d-4c96-b27e-675297ec0295-kube-api-access-698p9\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.550487 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.550412    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:01:50.683136 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:50.683111    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"]
Jun 15 06:01:50.686060 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:01:50.686031    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc807fb9a_0d7d_4c96_b27e_675297ec0295.slice/crio-f7593465d0bdc1691b99651fc365fcde09c6f1e832e81d290eb891f452c08635 WatchSource:0}: Error finding container f7593465d0bdc1691b99651fc365fcde09c6f1e832e81d290eb891f452c08635: Status 404 returned error can't find the container with id f7593465d0bdc1691b99651fc365fcde09c6f1e832e81d290eb891f452c08635
Jun 15 06:01:51.620639 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:51.620591    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" event={"ID":"c807fb9a-0d7d-4c96-b27e-675297ec0295","Type":"ContainerStarted","Data":"f7593465d0bdc1691b99651fc365fcde09c6f1e832e81d290eb891f452c08635"}
Jun 15 06:01:52.632313 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:01:52.632247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" event={"ID":"c807fb9a-0d7d-4c96-b27e-675297ec0295","Type":"ContainerStarted","Data":"800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa"}
Jun 15 06:02:01.686275 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:01.686239    2573 generic.go:356] "Generic (PLEG): container finished" podID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerID="9fc1d317d4ee71f3e085bdf6a645555a9c5a320ca21bdb1ba5d6866b6b4b6cc7" exitCode=0
Jun 15 06:02:01.686760 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:01.686320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" event={"ID":"80d602fe-af57-4796-94f6-2bfcac712cb4","Type":"ContainerDied","Data":"9fc1d317d4ee71f3e085bdf6a645555a9c5a320ca21bdb1ba5d6866b6b4b6cc7"}
Jun 15 06:02:01.686821 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:01.686808    2573 scope.go:117] "RemoveContainer" containerID="9fc1d317d4ee71f3e085bdf6a645555a9c5a320ca21bdb1ba5d6866b6b4b6cc7"
Jun 15 06:02:01.687893 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:01.687855    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jun 15 06:02:01.688010 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:01.687929    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jun 15 06:02:01.688010 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:01.687967    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jun 15 06:02:02.714877 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:02.714840    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" event={"ID":"80d602fe-af57-4796-94f6-2bfcac712cb4","Type":"ContainerStarted","Data":"78b3bd6a6d7779b3e4fb701fd8ab003025dcea8e145470946f90beea558394c4"}
Jun 15 06:02:02.735592 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:02.735563    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 06:02:02.735787 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:02.735766    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jun 15 06:02:02.735862 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:02.735817    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jun 15 06:02:03.736578 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:03.736541    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jun 15 06:02:03.737023 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:03.736614    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jun 15 06:02:04.735949 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:04.735917    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jun 15 06:02:04.736147 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:04.735977    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jun 15 06:02:05.736525 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:05.736490    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jun 15 06:02:05.737055 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:05.736549    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jun 15 06:02:06.736403 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:06.736372    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jun 15 06:02:06.736603 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:06.736440    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jun 15 06:02:07.735797 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:07.735761    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jun 15 06:02:07.735976 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:07.735834    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jun 15 06:02:08.426181 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:08.426147    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 06:02:08.740375 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:08.740298    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 06:02:08.750662 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:08.750638    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 06:02:24.839049 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:24.839009    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" event={"ID":"c807fb9a-0d7d-4c96-b27e-675297ec0295","Type":"ContainerStarted","Data":"9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa"}
Jun 15 06:02:24.839529 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:24.839222    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:02:24.841833 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:24.841803    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jun 15 06:02:24.862009 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:24.861960    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podStartSLOduration=1.830919707 podStartE2EDuration="34.861944758s" totalImagesPullingTime="33.031025051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:01:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:02:24.859966177 +0000 UTC m=+824.994139449" watchObservedRunningTime="2026-06-15 06:02:24.861944758 +0000 UTC m=+824.996118007"
Jun 15 06:02:25.845702 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:25.845666    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jun 15 06:02:30.550743 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:30.550710    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:02:30.551149 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:30.550769    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:02:30.551464 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:30.551426    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="tokenizer" probeResult="failure" output="Get \"http://10.133.0.34:8082/healthz\": dial tcp 10.133.0.34:8082: connect: connection refused"
Jun 15 06:02:30.552165 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:30.552142    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jun 15 06:02:40.552361 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:40.552322    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jun 15 06:02:40.552775 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:40.552754    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:02:40.553872 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:40.553848    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:02:40.554005 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:40.553982    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jun 15 06:02:40.924171 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:40.924134    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jun 15 06:02:50.924358 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:02:50.924318    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jun 15 06:03:00.924793 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:00.924750    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jun 15 06:03:08.255797 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:08.255762    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"]
Jun 15 06:03:08.256684 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:08.256632    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main" containerID="cri-o://800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa" gracePeriod=30
Jun 15 06:03:08.258310 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:08.257891    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="tokenizer" containerID="cri-o://9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa" gracePeriod=30
Jun 15 06:03:08.261250 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:08.261224    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jun 15 06:03:09.051898 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.051864    2573 generic.go:356] "Generic (PLEG): container finished" podID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerID="800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa" exitCode=0
Jun 15 06:03:09.052067 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.051928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" event={"ID":"c807fb9a-0d7d-4c96-b27e-675297ec0295","Type":"ContainerDied","Data":"800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa"}
Jun 15 06:03:09.423602 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.423573    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:03:09.535350 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.535326    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-698p9\" (UniqueName: \"kubernetes.io/projected/c807fb9a-0d7d-4c96-b27e-675297ec0295-kube-api-access-698p9\") pod \"c807fb9a-0d7d-4c96-b27e-675297ec0295\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") "
Jun 15 06:03:09.535498 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.535365    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-tmp\") pod \"c807fb9a-0d7d-4c96-b27e-675297ec0295\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") "
Jun 15 06:03:09.535498 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.535390    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-cache\") pod \"c807fb9a-0d7d-4c96-b27e-675297ec0295\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") "
Jun 15 06:03:09.535498 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.535433    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-uds\") pod \"c807fb9a-0d7d-4c96-b27e-675297ec0295\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") "
Jun 15 06:03:09.535498 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.535488    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c807fb9a-0d7d-4c96-b27e-675297ec0295-tls-certs\") pod \"c807fb9a-0d7d-4c96-b27e-675297ec0295\" (UID: \"c807fb9a-0d7d-4c96-b27e-675297ec0295\") "
Jun 15 06:03:09.535809 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.535630    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "c807fb9a-0d7d-4c96-b27e-675297ec0295" (UID: "c807fb9a-0d7d-4c96-b27e-675297ec0295"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:03:09.535809 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.535690    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "c807fb9a-0d7d-4c96-b27e-675297ec0295" (UID: "c807fb9a-0d7d-4c96-b27e-675297ec0295"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:03:09.535809 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.535701    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "c807fb9a-0d7d-4c96-b27e-675297ec0295" (UID: "c807fb9a-0d7d-4c96-b27e-675297ec0295"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:03:09.537742 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.537715    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c807fb9a-0d7d-4c96-b27e-675297ec0295-kube-api-access-698p9" (OuterVolumeSpecName: "kube-api-access-698p9") pod "c807fb9a-0d7d-4c96-b27e-675297ec0295" (UID: "c807fb9a-0d7d-4c96-b27e-675297ec0295"). InnerVolumeSpecName "kube-api-access-698p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:03:09.537742 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.537730    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c807fb9a-0d7d-4c96-b27e-675297ec0295-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c807fb9a-0d7d-4c96-b27e-675297ec0295" (UID: "c807fb9a-0d7d-4c96-b27e-675297ec0295"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:03:09.636932 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.636869    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c807fb9a-0d7d-4c96-b27e-675297ec0295-tls-certs\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:03:09.636932 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.636895    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-698p9\" (UniqueName: \"kubernetes.io/projected/c807fb9a-0d7d-4c96-b27e-675297ec0295-kube-api-access-698p9\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:03:09.636932 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.636908    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-tmp\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:03:09.636932 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.636921    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-cache\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:03:09.636932 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:09.636933    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/c807fb9a-0d7d-4c96-b27e-675297ec0295-tokenizer-uds\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:03:10.058450 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.058417    2573 generic.go:356] "Generic (PLEG): container finished" podID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerID="9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa" exitCode=0
Jun 15 06:03:10.058450 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.058453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" event={"ID":"c807fb9a-0d7d-4c96-b27e-675297ec0295","Type":"ContainerDied","Data":"9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa"}
Jun 15 06:03:10.058672 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.058459    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"
Jun 15 06:03:10.058672 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.058495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts" event={"ID":"c807fb9a-0d7d-4c96-b27e-675297ec0295","Type":"ContainerDied","Data":"f7593465d0bdc1691b99651fc365fcde09c6f1e832e81d290eb891f452c08635"}
Jun 15 06:03:10.058672 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.058518    2573 scope.go:117] "RemoveContainer" containerID="9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa"
Jun 15 06:03:10.073488 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.073470    2573 scope.go:117] "RemoveContainer" containerID="800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa"
Jun 15 06:03:10.081264 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.081248    2573 scope.go:117] "RemoveContainer" containerID="9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa"
Jun 15 06:03:10.081516 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:03:10.081496    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa\": container with ID starting with 9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa not found: ID does not exist" containerID="9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa"
Jun 15 06:03:10.081559 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.081523    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa"} err="failed to get container status \"9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa\": rpc error: code = NotFound desc = could not find container \"9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa\": container with ID starting with 9b19bbcc3ca77c9c0e88a2615833cbc66a8cd690a4c236eeedc89cb9b414bffa not found: ID does not exist"
Jun 15 06:03:10.081559 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.081539    2573 scope.go:117] "RemoveContainer" containerID="800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa"
Jun 15 06:03:10.081781 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:03:10.081763    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa\": container with ID starting with 800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa not found: ID does not exist" containerID="800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa"
Jun 15 06:03:10.081835 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.081789    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa"} err="failed to get container status \"800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa\": rpc error: code = NotFound desc = could not find container \"800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa\": container with ID starting with 800b057753657619a98a883bce3c20bebe349ff084fd7e9b4320413d6e2ef3aa not found: ID does not exist"
Jun 15 06:03:10.084513 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.084491    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"]
Jun 15 06:03:10.090666 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.090647    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts"]
Jun 15 06:03:10.336622 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:10.336547    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" path="/var/lib/kubelet/pods/c807fb9a-0d7d-4c96-b27e-675297ec0295/volumes"
Jun 15 06:03:11.450814 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.450783    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"]
Jun 15 06:03:11.451325 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.451306    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="tokenizer"
Jun 15 06:03:11.451400 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.451328    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="tokenizer"
Jun 15 06:03:11.451400 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.451342    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main"
Jun 15 06:03:11.451400 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.451349    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main"
Jun 15 06:03:11.451547 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.451433    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="main"
Jun 15 06:03:11.451547 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.451448    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c807fb9a-0d7d-4c96-b27e-675297ec0295" containerName="tokenizer"
Jun 15 06:03:11.454478 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.454456    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.456679 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.456661    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fjfwp\""
Jun 15 06:03:11.456814 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.456664    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 06:03:11.456922 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.456820    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jun 15 06:03:11.456922 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.456859    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"auth-enabled-test-kserve-self-signed-certs\""
Jun 15 06:03:11.457050 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.456948    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jun 15 06:03:11.465680 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.465660    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"]
Jun 15 06:03:11.551386 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.551359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-tmp-dir\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.551517 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.551392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-home\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.551517 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.551420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-kserve-provision-location\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.551605 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.551530    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2vjn\" (UniqueName: \"kubernetes.io/projected/03be4983-7e0f-4763-b9f9-537fa20b4610-kube-api-access-d2vjn\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.551605 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.551567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03be4983-7e0f-4763-b9f9-537fa20b4610-tls-certs\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.551605 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.551584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-dshm\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.551696 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.551606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-model-cache\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.652543 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.652513    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-tmp-dir\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.652543 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.652546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-home\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.652755 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.652569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-kserve-provision-location\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.652755 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.652620    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2vjn\" (UniqueName: \"kubernetes.io/projected/03be4983-7e0f-4763-b9f9-537fa20b4610-kube-api-access-d2vjn\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.652755 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.652649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03be4983-7e0f-4763-b9f9-537fa20b4610-tls-certs\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.652755 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.652664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-dshm\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.652755 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.652682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-model-cache\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.653025 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.652999    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-tmp-dir\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.653173 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.653035    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-kserve-provision-location\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.653173 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.653149    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-home\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.653259 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.653199    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-model-cache\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.655267 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.655247    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03be4983-7e0f-4763-b9f9-537fa20b4610-dshm\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.655343 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.655273    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03be4983-7e0f-4763-b9f9-537fa20b4610-tls-certs\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.663634 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.663609    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2vjn\" (UniqueName: \"kubernetes.io/projected/03be4983-7e0f-4763-b9f9-537fa20b4610-kube-api-access-d2vjn\") pod \"auth-enabled-test-kserve-85d86d876c-vrqhw\" (UID: \"03be4983-7e0f-4763-b9f9-537fa20b4610\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.765007 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.764937    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"
Jun 15 06:03:11.907780 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:11.907672    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw"]
Jun 15 06:03:11.910652 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:03:11.910570    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03be4983_7e0f_4763_b9f9_537fa20b4610.slice/crio-ea489177a191d776b26767842d69cb81a3d572ff14ae6877784772cd2fb38c0d WatchSource:0}: Error finding container ea489177a191d776b26767842d69cb81a3d572ff14ae6877784772cd2fb38c0d: Status 404 returned error can't find the container with id ea489177a191d776b26767842d69cb81a3d572ff14ae6877784772cd2fb38c0d
Jun 15 06:03:12.070164 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:12.070076    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw" event={"ID":"03be4983-7e0f-4763-b9f9-537fa20b4610","Type":"ContainerStarted","Data":"ea489177a191d776b26767842d69cb81a3d572ff14ae6877784772cd2fb38c0d"}
Jun 15 06:03:16.093740 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:16.093706    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw" event={"ID":"03be4983-7e0f-4763-b9f9-537fa20b4610","Type":"ContainerStarted","Data":"8b4c36867ef169438602cb7c2bd89a577c73c2c0994c64f9ca6b693147449951"}
Jun 15 06:03:31.990313 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:31.990283    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"]
Jun 15 06:03:31.992881 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:31.992861    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:31.995031 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:31.995010    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-custom-template-test-kserve-self-signed-certs\""
Jun 15 06:03:31.995206 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:31.995018    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-custom-template-test-epp-sa-dockercfg-v9j6p\""
Jun 15 06:03:32.003853 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.003830    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"]
Jun 15 06:03:32.126947 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.126917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-uds\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.126947 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.126950    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.127220 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.126976    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.127220 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.127048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2435198-0e47-45c4-b224-a18193e45d8c-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.127220 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.127070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdd4\" (UniqueName: \"kubernetes.io/projected/b2435198-0e47-45c4-b224-a18193e45d8c-kube-api-access-4hdd4\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.127220 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.127109    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-tmp\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.227750 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.227715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-uds\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.227750 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.227748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.227968 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.227783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.227968 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.227842    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2435198-0e47-45c4-b224-a18193e45d8c-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.227968 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.227868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdd4\" (UniqueName: \"kubernetes.io/projected/b2435198-0e47-45c4-b224-a18193e45d8c-kube-api-access-4hdd4\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.227968 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.227895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-tmp\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.228244 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.228222    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.228283 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.228252    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-uds\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.228283 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.228274    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.228353 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.228303    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-tmp\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.230463 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.230438    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2435198-0e47-45c4-b224-a18193e45d8c-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.237818 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.237799    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdd4\" (UniqueName: \"kubernetes.io/projected/b2435198-0e47-45c4-b224-a18193e45d8c-kube-api-access-4hdd4\") pod \"scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.303045 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.302973    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:32.454526 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:32.454494    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"]
Jun 15 06:03:32.456660 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:03:32.456629    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2435198_0e47_45c4_b224_a18193e45d8c.slice/crio-0389eef2ff64b5e75f35bdb6b31d0048288482010765dfd29838f85bd6b05fa1 WatchSource:0}: Error finding container 0389eef2ff64b5e75f35bdb6b31d0048288482010765dfd29838f85bd6b05fa1: Status 404 returned error can't find the container with id 0389eef2ff64b5e75f35bdb6b31d0048288482010765dfd29838f85bd6b05fa1
Jun 15 06:03:33.179704 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:33.179664    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx" event={"ID":"b2435198-0e47-45c4-b224-a18193e45d8c","Type":"ContainerStarted","Data":"57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a"}
Jun 15 06:03:33.180144 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:33.179743    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx" event={"ID":"b2435198-0e47-45c4-b224-a18193e45d8c","Type":"ContainerStarted","Data":"3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab"}
Jun 15 06:03:33.180144 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:33.179761    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx" event={"ID":"b2435198-0e47-45c4-b224-a18193e45d8c","Type":"ContainerStarted","Data":"0389eef2ff64b5e75f35bdb6b31d0048288482010765dfd29838f85bd6b05fa1"}
Jun 15 06:03:33.180144 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:33.179780    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:33.202162 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:33.202111    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx" podStartSLOduration=2.202095967 podStartE2EDuration="2.202095967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:03:33.200161423 +0000 UTC m=+893.334334673" watchObservedRunningTime="2026-06-15 06:03:33.202095967 +0000 UTC m=+893.336269208"
Jun 15 06:03:42.303183 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:42.303151    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:42.303561 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:42.303307    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:42.305958 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:42.305939    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:03:43.229205 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:03:43.229178    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:04:05.239168 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:05.239140    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:04:06.662162 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:06.662125    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"]
Jun 15 06:04:06.663076 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:06.663041    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx" podUID="b2435198-0e47-45c4-b224-a18193e45d8c" containerName="main" containerID="cri-o://3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab" gracePeriod=30
Jun 15 06:04:06.668182 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:06.668121    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx" podUID="b2435198-0e47-45c4-b224-a18193e45d8c" containerName="tokenizer" containerID="cri-o://57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a" gracePeriod=30
Jun 15 06:04:07.341521 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.341489    2573 generic.go:356] "Generic (PLEG): container finished" podID="b2435198-0e47-45c4-b224-a18193e45d8c" containerID="3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab" exitCode=0
Jun 15 06:04:07.341697 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.341546    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx" event={"ID":"b2435198-0e47-45c4-b224-a18193e45d8c","Type":"ContainerDied","Data":"3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab"}
Jun 15 06:04:07.916316 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.916285    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:04:07.947702 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.947636    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2435198-0e47-45c4-b224-a18193e45d8c-tls-certs\") pod \"b2435198-0e47-45c4-b224-a18193e45d8c\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") "
Jun 15 06:04:07.947702 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.947678    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-cache\") pod \"b2435198-0e47-45c4-b224-a18193e45d8c\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") "
Jun 15 06:04:07.947702 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.947693    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-tmp\") pod \"b2435198-0e47-45c4-b224-a18193e45d8c\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") "
Jun 15 06:04:07.947961 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.947742    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-cachi2-cache\") pod \"b2435198-0e47-45c4-b224-a18193e45d8c\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") "
Jun 15 06:04:07.947961 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.947761    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-uds\") pod \"b2435198-0e47-45c4-b224-a18193e45d8c\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") "
Jun 15 06:04:07.947961 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.947820    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hdd4\" (UniqueName: \"kubernetes.io/projected/b2435198-0e47-45c4-b224-a18193e45d8c-kube-api-access-4hdd4\") pod \"b2435198-0e47-45c4-b224-a18193e45d8c\" (UID: \"b2435198-0e47-45c4-b224-a18193e45d8c\") "
Jun 15 06:04:07.948137 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.947931    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "b2435198-0e47-45c4-b224-a18193e45d8c" (UID: "b2435198-0e47-45c4-b224-a18193e45d8c"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:04:07.948137 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.948023    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-cachi2-cache" (OuterVolumeSpecName: "cachi2-cache") pod "b2435198-0e47-45c4-b224-a18193e45d8c" (UID: "b2435198-0e47-45c4-b224-a18193e45d8c"). InnerVolumeSpecName "cachi2-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:04:07.948137 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.948113    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "b2435198-0e47-45c4-b224-a18193e45d8c" (UID: "b2435198-0e47-45c4-b224-a18193e45d8c"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:04:07.948137 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.948126    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "b2435198-0e47-45c4-b224-a18193e45d8c" (UID: "b2435198-0e47-45c4-b224-a18193e45d8c"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:04:07.948308 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.948184    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-cache\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:04:07.948308 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.948203    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-tmp\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:04:07.948308 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.948218    2573 reconciler_common.go:299] "Volume detached for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-cachi2-cache\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:04:07.948308 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.948231    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b2435198-0e47-45c4-b224-a18193e45d8c-tokenizer-uds\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:04:07.949935 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.949910    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2435198-0e47-45c4-b224-a18193e45d8c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b2435198-0e47-45c4-b224-a18193e45d8c" (UID: "b2435198-0e47-45c4-b224-a18193e45d8c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:04:07.950044 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:07.950023    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2435198-0e47-45c4-b224-a18193e45d8c-kube-api-access-4hdd4" (OuterVolumeSpecName: "kube-api-access-4hdd4") pod "b2435198-0e47-45c4-b224-a18193e45d8c" (UID: "b2435198-0e47-45c4-b224-a18193e45d8c"). InnerVolumeSpecName "kube-api-access-4hdd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:04:08.049658 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.049621    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hdd4\" (UniqueName: \"kubernetes.io/projected/b2435198-0e47-45c4-b224-a18193e45d8c-kube-api-access-4hdd4\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:04:08.049658 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.049654    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2435198-0e47-45c4-b224-a18193e45d8c-tls-certs\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:04:08.347410 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.347381    2573 generic.go:356] "Generic (PLEG): container finished" podID="b2435198-0e47-45c4-b224-a18193e45d8c" containerID="57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a" exitCode=0
Jun 15 06:04:08.347546 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.347430    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"
Jun 15 06:04:08.347546 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.347437    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx" event={"ID":"b2435198-0e47-45c4-b224-a18193e45d8c","Type":"ContainerDied","Data":"57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a"}
Jun 15 06:04:08.347546 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.347479    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx" event={"ID":"b2435198-0e47-45c4-b224-a18193e45d8c","Type":"ContainerDied","Data":"0389eef2ff64b5e75f35bdb6b31d0048288482010765dfd29838f85bd6b05fa1"}
Jun 15 06:04:08.347546 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.347500    2573 scope.go:117] "RemoveContainer" containerID="57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a"
Jun 15 06:04:08.355603 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.355587    2573 scope.go:117] "RemoveContainer" containerID="3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab"
Jun 15 06:04:08.363122 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.363101    2573 scope.go:117] "RemoveContainer" containerID="57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a"
Jun 15 06:04:08.363776 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:04:08.363752    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a\": container with ID starting with 57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a not found: ID does not exist" containerID="57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a"
Jun 15 06:04:08.363879 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.363782    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a"} err="failed to get container status \"57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a\": rpc error: code = NotFound desc = could not find container \"57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a\": container with ID starting with 57f130440840d8d61a84374e23ab3a0f27db99f64d679fe287b0024e96af798a not found: ID does not exist"
Jun 15 06:04:08.363879 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.363798    2573 scope.go:117] "RemoveContainer" containerID="3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab"
Jun 15 06:04:08.364034 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:04:08.364018    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab\": container with ID starting with 3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab not found: ID does not exist" containerID="3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab"
Jun 15 06:04:08.364116 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.364061    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab"} err="failed to get container status \"3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab\": rpc error: code = NotFound desc = could not find container \"3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab\": container with ID starting with 3247e6d2085532680439eec61851f72bff5c8a65099e31d88484f137162ecbab not found: ID does not exist"
Jun 15 06:04:08.365431 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.365410    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"]
Jun 15 06:04:08.368983 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:08.368964    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx"]
Jun 15 06:04:10.336730 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:10.336700    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2435198-0e47-45c4-b224-a18193e45d8c" path="/var/lib/kubelet/pods/b2435198-0e47-45c4-b224-a18193e45d8c/volumes"
Jun 15 06:04:36.158575 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.158541    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"]
Jun 15 06:04:36.159032 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.158885    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2435198-0e47-45c4-b224-a18193e45d8c" containerName="main"
Jun 15 06:04:36.159032 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.158897    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2435198-0e47-45c4-b224-a18193e45d8c" containerName="main"
Jun 15 06:04:36.159032 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.158907    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2435198-0e47-45c4-b224-a18193e45d8c" containerName="tokenizer"
Jun 15 06:04:36.159032 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.158913    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2435198-0e47-45c4-b224-a18193e45d8c" containerName="tokenizer"
Jun 15 06:04:36.159032 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.158984    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2435198-0e47-45c4-b224-a18193e45d8c" containerName="tokenizer"
Jun 15 06:04:36.159032 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.158999    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2435198-0e47-45c4-b224-a18193e45d8c" containerName="main"
Jun 15 06:04:36.162204 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.162186    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.164420 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.164376    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"precise-prefix-cache-test-kserve-self-signed-certs\""
Jun 15 06:04:36.172351 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.172326    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"]
Jun 15 06:04:36.293462 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.293423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tmp-dir\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.293625 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.293472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g54k2\" (UniqueName: \"kubernetes.io/projected/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kube-api-access-g54k2\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.293625 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.293556    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-model-cache\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.293625 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.293582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tls-certs\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.293745 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.293625    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-dshm\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.293745 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.293666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-home\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.293745 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.293696    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.394475 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.394440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tmp-dir\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.394475 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.394481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g54k2\" (UniqueName: \"kubernetes.io/projected/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kube-api-access-g54k2\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.394774 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.394527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-model-cache\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.394774 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.394548    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tls-certs\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.394774 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.394590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-dshm\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.394774 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.394633    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-home\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.394774 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.394683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.395137 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.394938    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tmp-dir\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.395137 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.394980    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.395322 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.395288    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-model-cache\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.395479 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.395305    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-home\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.397811 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.397789    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"]
Jun 15 06:04:36.398132 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.398112    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-dshm\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.398494 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.398476    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tls-certs\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.401495 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.401475    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.403851 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.403832    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"precise-prefix-cache-test-epp-sa-dockercfg-mrr4q\""
Jun 15 06:04:36.406278 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.406259    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g54k2\" (UniqueName: \"kubernetes.io/projected/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kube-api-access-g54k2\") pod \"precise-prefix-cache-test-kserve-5c556785f6-67h82\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.411157 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.411109    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"]
Jun 15 06:04:36.473261 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.473236    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:36.495501 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.495467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z99g\" (UniqueName: \"kubernetes.io/projected/16421928-012b-41b6-a662-eff710588348-kube-api-access-2z99g\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.495627 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.495542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-tmp\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.495699 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.495656    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.495699 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.495684    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16421928-012b-41b6-a662-eff710588348-tls-certs\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.495813 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.495718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-cache\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.495813 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.495743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-uds\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.596563 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.596533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16421928-012b-41b6-a662-eff710588348-tls-certs\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.596702 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.596577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-cache\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.596702 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.596598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-uds\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.596702 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.596638    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z99g\" (UniqueName: \"kubernetes.io/projected/16421928-012b-41b6-a662-eff710588348-kube-api-access-2z99g\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.596702 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.596669    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-tmp\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.596877 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.596747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.597050 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.597025    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-uds\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.597126 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.597043    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-cache\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.597126 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.597068    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-tmp\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.597266 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.597149    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.599310 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.599285    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16421928-012b-41b6-a662-eff710588348-tls-certs\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.604781 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.604753    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z99g\" (UniqueName: \"kubernetes.io/projected/16421928-012b-41b6-a662-eff710588348-kube-api-access-2z99g\") pod \"precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb\" (UID: \"16421928-012b-41b6-a662-eff710588348\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.611525 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.611495    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"]
Jun 15 06:04:36.721682 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.721639    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:36.866459 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:36.866428    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"]
Jun 15 06:04:36.869574 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:04:36.869546    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16421928_012b_41b6_a662_eff710588348.slice/crio-691ea62945bcecfb54f3e4aa528f35f84a9fc0bb8c5f9b61ab5b273d567f70f0 WatchSource:0}: Error finding container 691ea62945bcecfb54f3e4aa528f35f84a9fc0bb8c5f9b61ab5b273d567f70f0: Status 404 returned error can't find the container with id 691ea62945bcecfb54f3e4aa528f35f84a9fc0bb8c5f9b61ab5b273d567f70f0
Jun 15 06:04:37.476217 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:37.476177    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82" event={"ID":"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5","Type":"ContainerStarted","Data":"a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565"}
Jun 15 06:04:37.476684 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:37.476242    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82" event={"ID":"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5","Type":"ContainerStarted","Data":"cd738f117cda740a85f03bcdaac479d32430efb2db7f6b274356af5f552d8cc9"}
Jun 15 06:04:37.477754 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:37.477730    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" event={"ID":"16421928-012b-41b6-a662-eff710588348","Type":"ContainerStarted","Data":"499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045"}
Jun 15 06:04:37.477860 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:37.477778    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" event={"ID":"16421928-012b-41b6-a662-eff710588348","Type":"ContainerStarted","Data":"691ea62945bcecfb54f3e4aa528f35f84a9fc0bb8c5f9b61ab5b273d567f70f0"}
Jun 15 06:04:38.485802 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:38.485764    2573 generic.go:356] "Generic (PLEG): container finished" podID="16421928-012b-41b6-a662-eff710588348" containerID="499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045" exitCode=0
Jun 15 06:04:38.486362 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:38.485858    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" event={"ID":"16421928-012b-41b6-a662-eff710588348","Type":"ContainerDied","Data":"499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045"}
Jun 15 06:04:39.495008 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:39.494973    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" event={"ID":"16421928-012b-41b6-a662-eff710588348","Type":"ContainerStarted","Data":"199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9"}
Jun 15 06:04:39.495536 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:39.495024    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" event={"ID":"16421928-012b-41b6-a662-eff710588348","Type":"ContainerStarted","Data":"6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062"}
Jun 15 06:04:39.495536 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:39.495114    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:39.517810 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:39.517749    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" podStartSLOduration=2.755219534 podStartE2EDuration="3.517730462s" totalImagesPullingTime="0s" totalInitContainerRuntime="762.510928ms" isStatefulPod=false podCreationTimestamp="2026-06-15 06:04:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:04:39.516450915 +0000 UTC m=+959.650624169" watchObservedRunningTime="2026-06-15 06:04:39.517730462 +0000 UTC m=+959.651903714"
Jun 15 06:04:43.519828 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:43.519796    2573 generic.go:356] "Generic (PLEG): container finished" podID="333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" containerID="a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565" exitCode=0
Jun 15 06:04:43.520207 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:43.519881    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82" event={"ID":"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5","Type":"ContainerDied","Data":"a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565"}
Jun 15 06:04:43.521178 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:43.521165    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 06:04:45.531790 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:45.531745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82" event={"ID":"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5","Type":"ContainerStarted","Data":"71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a"}
Jun 15 06:04:45.552315 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:45.552264    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82" podStartSLOduration=2.560599636 podStartE2EDuration="9.552244648s" totalImagesPullingTime="1.023536427s" totalInitContainerRuntime="5.968108585s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:04:45.550772208 +0000 UTC m=+965.684945459" watchObservedRunningTime="2026-06-15 06:04:45.552244648 +0000 UTC m=+965.686417932"
Jun 15 06:04:46.473374 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:46.473336    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:46.473551 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:46.473414    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:46.486236 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:46.486208    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:46.547823 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:46.547790    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:04:46.722176 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:46.722139    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:46.722331 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:46.722220    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:46.724450 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:04:46.724386    2573 logging.go:55] [core] [Channel #68 SubChannel #69]grpc: addrConn.createTransport failed to connect to {Addr: "10.133.0.38:9003", ServerName: "10.133.0.38:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.133.0.38:9003: connect: connection refused"
Jun 15 06:04:46.724875 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:46.724857    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:47.542719 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:47.542685    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:04:47.722247 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:47.722210    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" podUID="16421928-012b-41b6-a662-eff710588348" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.133.0.38:9003\" within 1s: context deadline exceeded"
Jun 15 06:04:56.723050 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:04:56.722968    2573 logging.go:55] [core] [Channel #70 SubChannel #71]grpc: addrConn.createTransport failed to connect to {Addr: "10.133.0.38:9003", ServerName: "10.133.0.38:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.133.0.38:9003: connect: connection refused"
Jun 15 06:04:57.723308 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:04:57.723261    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" podUID="16421928-012b-41b6-a662-eff710588348" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.133.0.38:9003\" within 1s: context deadline exceeded"
Jun 15 06:04:57.723760 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:04:57.723385    2573 logging.go:55] [core] [Channel #70 SubChannel #71]grpc: addrConn.createTransport failed to connect to {Addr: "10.133.0.38:9003", ServerName: "10.133.0.38:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.133.0.38:9003: operation was canceled"
Jun 15 06:05:08.549892 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:08.549862    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:05:10.107645 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:10.107608    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"]
Jun 15 06:05:10.110552 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:10.110528    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"]
Jun 15 06:05:10.110751 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:10.110721    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" podUID="16421928-012b-41b6-a662-eff710588348" containerName="main" containerID="cri-o://6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062" gracePeriod=30
Jun 15 06:05:10.110835 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:10.110765    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" podUID="16421928-012b-41b6-a662-eff710588348" containerName="tokenizer" containerID="cri-o://199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9" gracePeriod=30
Jun 15 06:05:10.661185 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:10.661149    2573 generic.go:356] "Generic (PLEG): container finished" podID="16421928-012b-41b6-a662-eff710588348" containerID="6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062" exitCode=0
Jun 15 06:05:10.661354 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:10.661200    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" event={"ID":"16421928-012b-41b6-a662-eff710588348","Type":"ContainerDied","Data":"6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062"}
Jun 15 06:05:11.565720 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.565688    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:05:11.616067 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.615993    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z99g\" (UniqueName: \"kubernetes.io/projected/16421928-012b-41b6-a662-eff710588348-kube-api-access-2z99g\") pod \"16421928-012b-41b6-a662-eff710588348\" (UID: \"16421928-012b-41b6-a662-eff710588348\") "
Jun 15 06:05:11.616067 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.616025    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-kserve-provision-location\") pod \"16421928-012b-41b6-a662-eff710588348\" (UID: \"16421928-012b-41b6-a662-eff710588348\") "
Jun 15 06:05:11.616067 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.616048    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-cache\") pod \"16421928-012b-41b6-a662-eff710588348\" (UID: \"16421928-012b-41b6-a662-eff710588348\") "
Jun 15 06:05:11.616334 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.616070    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-uds\") pod \"16421928-012b-41b6-a662-eff710588348\" (UID: \"16421928-012b-41b6-a662-eff710588348\") "
Jun 15 06:05:11.616334 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.616158    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-tmp\") pod \"16421928-012b-41b6-a662-eff710588348\" (UID: \"16421928-012b-41b6-a662-eff710588348\") "
Jun 15 06:05:11.616334 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.616218    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16421928-012b-41b6-a662-eff710588348-tls-certs\") pod \"16421928-012b-41b6-a662-eff710588348\" (UID: \"16421928-012b-41b6-a662-eff710588348\") "
Jun 15 06:05:11.616482 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.616420    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "16421928-012b-41b6-a662-eff710588348" (UID: "16421928-012b-41b6-a662-eff710588348"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:05:11.616550 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.616519    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-uds\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:11.616602 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.616558    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "16421928-012b-41b6-a662-eff710588348" (UID: "16421928-012b-41b6-a662-eff710588348"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:05:11.616662 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.616636    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "16421928-012b-41b6-a662-eff710588348" (UID: "16421928-012b-41b6-a662-eff710588348"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:05:11.617077 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.617000    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "16421928-012b-41b6-a662-eff710588348" (UID: "16421928-012b-41b6-a662-eff710588348"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:05:11.618453 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.618429    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16421928-012b-41b6-a662-eff710588348-kube-api-access-2z99g" (OuterVolumeSpecName: "kube-api-access-2z99g") pod "16421928-012b-41b6-a662-eff710588348" (UID: "16421928-012b-41b6-a662-eff710588348"). InnerVolumeSpecName "kube-api-access-2z99g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:05:11.618544 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.618480    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16421928-012b-41b6-a662-eff710588348-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "16421928-012b-41b6-a662-eff710588348" (UID: "16421928-012b-41b6-a662-eff710588348"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:05:11.668133 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.668102    2573 generic.go:356] "Generic (PLEG): container finished" podID="16421928-012b-41b6-a662-eff710588348" containerID="199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9" exitCode=0
Jun 15 06:05:11.668254 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.668164    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"
Jun 15 06:05:11.668254 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.668189    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" event={"ID":"16421928-012b-41b6-a662-eff710588348","Type":"ContainerDied","Data":"199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9"}
Jun 15 06:05:11.668254 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.668243    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb" event={"ID":"16421928-012b-41b6-a662-eff710588348","Type":"ContainerDied","Data":"691ea62945bcecfb54f3e4aa528f35f84a9fc0bb8c5f9b61ab5b273d567f70f0"}
Jun 15 06:05:11.668364 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.668266    2573 scope.go:117] "RemoveContainer" containerID="199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9"
Jun 15 06:05:11.679969 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.679951    2573 scope.go:117] "RemoveContainer" containerID="6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062"
Jun 15 06:05:11.687894 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.687876    2573 scope.go:117] "RemoveContainer" containerID="499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045"
Jun 15 06:05:11.692985 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.692963    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"]
Jun 15 06:05:11.696943 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.696923    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb"]
Jun 15 06:05:11.697059 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.696941    2573 scope.go:117] "RemoveContainer" containerID="199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9"
Jun 15 06:05:11.697257 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:05:11.697240    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9\": container with ID starting with 199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9 not found: ID does not exist" containerID="199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9"
Jun 15 06:05:11.697307 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.697270    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9"} err="failed to get container status \"199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9\": rpc error: code = NotFound desc = could not find container \"199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9\": container with ID starting with 199fc6a085e35bb764799c24c9a53455d80d7878b0fcc323104507321a85c3c9 not found: ID does not exist"
Jun 15 06:05:11.697307 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.697288    2573 scope.go:117] "RemoveContainer" containerID="6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062"
Jun 15 06:05:11.697540 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:05:11.697521    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062\": container with ID starting with 6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062 not found: ID does not exist" containerID="6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062"
Jun 15 06:05:11.697582 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.697546    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062"} err="failed to get container status \"6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062\": rpc error: code = NotFound desc = could not find container \"6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062\": container with ID starting with 6d8da8240b663e32a0357b7d846d97334a110dfc544b59228f4526343a53c062 not found: ID does not exist"
Jun 15 06:05:11.697582 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.697561    2573 scope.go:117] "RemoveContainer" containerID="499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045"
Jun 15 06:05:11.697782 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:05:11.697766    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045\": container with ID starting with 499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045 not found: ID does not exist" containerID="499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045"
Jun 15 06:05:11.697833 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.697786    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045"} err="failed to get container status \"499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045\": rpc error: code = NotFound desc = could not find container \"499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045\": container with ID starting with 499d651899ff66cbec60f901aa8b4de4c2e97a480471901c42a536914b9ad045 not found: ID does not exist"
Jun 15 06:05:11.717399 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.717381    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-tmp\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:11.717467 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.717404    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16421928-012b-41b6-a662-eff710588348-tls-certs\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:11.717467 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.717417    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z99g\" (UniqueName: \"kubernetes.io/projected/16421928-012b-41b6-a662-eff710588348-kube-api-access-2z99g\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:11.717467 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.717427    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-kserve-provision-location\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:11.717467 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:11.717436    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/16421928-012b-41b6-a662-eff710588348-tokenizer-cache\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:12.336786 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:12.336748    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16421928-012b-41b6-a662-eff710588348" path="/var/lib/kubelet/pods/16421928-012b-41b6-a662-eff710588348/volumes"
Jun 15 06:05:25.131387 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.131324    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82" podUID="333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" containerName="main" containerID="cri-o://71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a" gracePeriod=45
Jun 15 06:05:25.390572 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.390520    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:05:25.534653 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.534622    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tmp-dir\") pod \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") "
Jun 15 06:05:25.534653 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.534655    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g54k2\" (UniqueName: \"kubernetes.io/projected/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kube-api-access-g54k2\") pod \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") "
Jun 15 06:05:25.534888 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.534720    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-dshm\") pod \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") "
Jun 15 06:05:25.534888 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.534745    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-home\") pod \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") "
Jun 15 06:05:25.534888 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.534762    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tls-certs\") pod \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") "
Jun 15 06:05:25.534888 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.534779    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-model-cache\") pod \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") "
Jun 15 06:05:25.534888 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.534813    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kserve-provision-location\") pod \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\" (UID: \"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5\") "
Jun 15 06:05:25.535163 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.534990    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" (UID: "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:05:25.535163 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.535026    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-home" (OuterVolumeSpecName: "home") pod "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" (UID: "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:05:25.535265 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.535198    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-model-cache" (OuterVolumeSpecName: "model-cache") pod "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" (UID: "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:05:25.537135 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.537105    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-dshm" (OuterVolumeSpecName: "dshm") pod "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" (UID: "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:05:25.537135 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.537125    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" (UID: "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:05:25.537314 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.537132    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kube-api-access-g54k2" (OuterVolumeSpecName: "kube-api-access-g54k2") pod "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" (UID: "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5"). InnerVolumeSpecName "kube-api-access-g54k2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:05:25.589170 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.589138    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" (UID: "333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:05:25.636216 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.636189    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-dshm\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:25.636216 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.636211    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-home\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:25.636216 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.636219    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tls-certs\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:25.636405 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.636228    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-model-cache\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:25.636405 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.636236    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kserve-provision-location\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:25.636405 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.636244    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-tmp-dir\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:25.636405 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.636255    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g54k2\" (UniqueName: \"kubernetes.io/projected/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5-kube-api-access-g54k2\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:05:25.737203 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.737173    2573 generic.go:356] "Generic (PLEG): container finished" podID="333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" containerID="71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a" exitCode=0
Jun 15 06:05:25.737319 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.737214    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"
Jun 15 06:05:25.737319 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.737244    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82" event={"ID":"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5","Type":"ContainerDied","Data":"71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a"}
Jun 15 06:05:25.737319 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.737289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82" event={"ID":"333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5","Type":"ContainerDied","Data":"cd738f117cda740a85f03bcdaac479d32430efb2db7f6b274356af5f552d8cc9"}
Jun 15 06:05:25.737319 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.737309    2573 scope.go:117] "RemoveContainer" containerID="71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a"
Jun 15 06:05:25.746008 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.745993    2573 scope.go:117] "RemoveContainer" containerID="a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565"
Jun 15 06:05:25.753794 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.753777    2573 scope.go:117] "RemoveContainer" containerID="71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a"
Jun 15 06:05:25.754018 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:05:25.754002    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a\": container with ID starting with 71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a not found: ID does not exist" containerID="71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a"
Jun 15 06:05:25.754063 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.754024    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a"} err="failed to get container status \"71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a\": rpc error: code = NotFound desc = could not find container \"71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a\": container with ID starting with 71029ad1ffe5f367a5ae8a3f9c054ac326bf5fa5ac2827142c2680bd9dbedb6a not found: ID does not exist"
Jun 15 06:05:25.754063 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.754039    2573 scope.go:117] "RemoveContainer" containerID="a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565"
Jun 15 06:05:25.761115 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:05:25.754826    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565\": container with ID starting with a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565 not found: ID does not exist" containerID="a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565"
Jun 15 06:05:25.761115 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.754879    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565"} err="failed to get container status \"a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565\": rpc error: code = NotFound desc = could not find container \"a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565\": container with ID starting with a6aa4c9d19b00d5c01fa4c83357419605e077db429facd39e829060fe49db565 not found: ID does not exist"
Jun 15 06:05:25.761987 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.761965    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"]
Jun 15 06:05:25.764781 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:25.764760    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82"]
Jun 15 06:05:26.336436 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:26.336408    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" path="/var/lib/kubelet/pods/333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5/volumes"
Jun 15 06:05:37.863969 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.863939    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"]
Jun 15 06:05:37.864422 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864389    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" containerName="main"
Jun 15 06:05:37.864422 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864405    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" containerName="main"
Jun 15 06:05:37.864558 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864489    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" containerName="storage-initializer"
Jun 15 06:05:37.864558 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864501    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" containerName="storage-initializer"
Jun 15 06:05:37.864558 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864533    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16421928-012b-41b6-a662-eff710588348" containerName="main"
Jun 15 06:05:37.864558 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864544    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="16421928-012b-41b6-a662-eff710588348" containerName="main"
Jun 15 06:05:37.864753 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864565    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16421928-012b-41b6-a662-eff710588348" containerName="storage-initializer"
Jun 15 06:05:37.864753 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864574    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="16421928-012b-41b6-a662-eff710588348" containerName="storage-initializer"
Jun 15 06:05:37.864753 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864592    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16421928-012b-41b6-a662-eff710588348" containerName="tokenizer"
Jun 15 06:05:37.864753 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864601    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="16421928-012b-41b6-a662-eff710588348" containerName="tokenizer"
Jun 15 06:05:37.864753 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864692    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="16421928-012b-41b6-a662-eff710588348" containerName="main"
Jun 15 06:05:37.864753 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864706    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="333369a2-6a60-4c5f-9c2a-ed9e2fc3f4b5" containerName="main"
Jun 15 06:05:37.864753 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.864718    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="16421928-012b-41b6-a662-eff710588348" containerName="tokenizer"
Jun 15 06:05:37.867799 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.867778    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:37.870743 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.870722    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Jun 15 06:05:37.870743 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.870731    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-e45d1f79-epp-sa-dockercfg-4ljbf\""
Jun 15 06:05:37.876436 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:37.876416    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"]
Jun 15 06:05:38.047149 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.047117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq5mr\" (UniqueName: \"kubernetes.io/projected/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-kube-api-access-dq5mr\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.047316 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.047178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.047316 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.047257    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-tmp\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.047316 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.047305    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-cache\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.047427 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.047349    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.148003 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.147914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.148003 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.147957    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-tmp\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.148003 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.147979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-cache\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.148283 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.148013    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.148283 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.148040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq5mr\" (UniqueName: \"kubernetes.io/projected/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-kube-api-access-dq5mr\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.148460 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.148432    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-tmp\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.148530 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.148457    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-cache\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.148530 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.148493    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.150522 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.150502    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.158198 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.158171    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq5mr\" (UniqueName: \"kubernetes.io/projected/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-kube-api-access-dq5mr\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.179022 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.178983    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.345130 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.345065    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"]
Jun 15 06:05:38.348054 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:05:38.348029    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d4fe2f8_f7d4_4c1a_90d7_eb025d8426d3.slice/crio-3e2d0b569fb340f128fec6b4df5aae38c7822c6b9f20e6552ffa77ba32188b0c WatchSource:0}: Error finding container 3e2d0b569fb340f128fec6b4df5aae38c7822c6b9f20e6552ffa77ba32188b0c: Status 404 returned error can't find the container with id 3e2d0b569fb340f128fec6b4df5aae38c7822c6b9f20e6552ffa77ba32188b0c
Jun 15 06:05:38.804114 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.804063    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz" event={"ID":"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3","Type":"ContainerStarted","Data":"88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550"}
Jun 15 06:05:38.804286 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.804165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz" event={"ID":"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3","Type":"ContainerStarted","Data":"73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254"}
Jun 15 06:05:38.804286 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.804189    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:38.804286 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.804209    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz" event={"ID":"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3","Type":"ContainerStarted","Data":"3e2d0b569fb340f128fec6b4df5aae38c7822c6b9f20e6552ffa77ba32188b0c"}
Jun 15 06:05:38.825828 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:38.825764    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz" podStartSLOduration=1.825746556 podStartE2EDuration="1.825746556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:05:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:05:38.824323509 +0000 UTC m=+1018.958496758" watchObservedRunningTime="2026-06-15 06:05:38.825746556 +0000 UTC m=+1018.959919804"
Jun 15 06:05:48.180099 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:48.180048    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:48.180612 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:48.180143    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:48.182941 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:48.182915    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:05:48.852158 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:05:48.852122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:06:09.858323 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:09.858287    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:06:11.069523 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:11.069489    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"]
Jun 15 06:06:11.069918 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:11.069711    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz" podUID="1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" containerName="main" containerID="cri-o://73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254" gracePeriod=30
Jun 15 06:06:11.069918 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:11.069782    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz" podUID="1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" containerName="tokenizer" containerID="cri-o://88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550" gracePeriod=30
Jun 15 06:06:11.980848 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:11.980817    2573 generic.go:356] "Generic (PLEG): container finished" podID="1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" containerID="73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254" exitCode=0
Jun 15 06:06:11.981008 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:11.980883    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz" event={"ID":"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3","Type":"ContainerDied","Data":"73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254"}
Jun 15 06:06:12.235115 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.235042    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:06:12.350126 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.350074    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-cache\") pod \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") "
Jun 15 06:06:12.350272 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.350158    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-uds\") pod \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") "
Jun 15 06:06:12.350272 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.350183    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq5mr\" (UniqueName: \"kubernetes.io/projected/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-kube-api-access-dq5mr\") pod \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") "
Jun 15 06:06:12.350272 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.350221    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tls-certs\") pod \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") "
Jun 15 06:06:12.350272 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.350251    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-tmp\") pod \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\" (UID: \"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3\") "
Jun 15 06:06:12.350473 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.350316    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" (UID: "1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:06:12.350473 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.350452    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" (UID: "1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:06:12.350586 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.350490    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-cache\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:06:12.350641 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.350614    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" (UID: "1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:06:12.352347 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.352327    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" (UID: "1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:06:12.352483 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.352465    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-kube-api-access-dq5mr" (OuterVolumeSpecName: "kube-api-access-dq5mr") pod "1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" (UID: "1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3"). InnerVolumeSpecName "kube-api-access-dq5mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:06:12.451616 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.451583    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-uds\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:06:12.451616 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.451608    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq5mr\" (UniqueName: \"kubernetes.io/projected/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-kube-api-access-dq5mr\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:06:12.451616 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.451617    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tls-certs\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:06:12.451616 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.451626    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3-tokenizer-tmp\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:06:12.987503 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.987466    2573 generic.go:356] "Generic (PLEG): container finished" podID="1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" containerID="88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550" exitCode=0
Jun 15 06:06:12.987647 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.987515    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"
Jun 15 06:06:12.987647 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.987543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz" event={"ID":"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3","Type":"ContainerDied","Data":"88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550"}
Jun 15 06:06:12.987647 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.987595    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz" event={"ID":"1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3","Type":"ContainerDied","Data":"3e2d0b569fb340f128fec6b4df5aae38c7822c6b9f20e6552ffa77ba32188b0c"}
Jun 15 06:06:12.987647 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.987617    2573 scope.go:117] "RemoveContainer" containerID="88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550"
Jun 15 06:06:12.996420 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:12.996404    2573 scope.go:117] "RemoveContainer" containerID="73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254"
Jun 15 06:06:13.003897 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:13.003877    2573 scope.go:117] "RemoveContainer" containerID="88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550"
Jun 15 06:06:13.004171 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:06:13.004152    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550\": container with ID starting with 88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550 not found: ID does not exist" containerID="88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550"
Jun 15 06:06:13.004215 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:13.004180    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550"} err="failed to get container status \"88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550\": rpc error: code = NotFound desc = could not find container \"88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550\": container with ID starting with 88671d0b6b39bb6cc4f1f8eb31ea386d5c7e4682d7e2db152ead8b0254ab5550 not found: ID does not exist"
Jun 15 06:06:13.004215 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:13.004196    2573 scope.go:117] "RemoveContainer" containerID="73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254"
Jun 15 06:06:13.004413 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:06:13.004396    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254\": container with ID starting with 73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254 not found: ID does not exist" containerID="73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254"
Jun 15 06:06:13.004452 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:13.004417    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254"} err="failed to get container status \"73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254\": rpc error: code = NotFound desc = could not find container \"73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254\": container with ID starting with 73495393a3d2ece804795979a906420130c1085271b0e42a47630927d3755254 not found: ID does not exist"
Jun 15 06:06:13.009599 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:13.009579    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"]
Jun 15 06:06:13.014038 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:13.014014    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz"]
Jun 15 06:06:14.336882 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:14.336853    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" path="/var/lib/kubelet/pods/1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3/volumes"
Jun 15 06:06:39.370122 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.370074    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"]
Jun 15 06:06:39.370521 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.370501    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" containerName="main"
Jun 15 06:06:39.370521 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.370514    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" containerName="main"
Jun 15 06:06:39.370589 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.370529    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" containerName="tokenizer"
Jun 15 06:06:39.370589 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.370536    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" containerName="tokenizer"
Jun 15 06:06:39.370589 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.370586    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" containerName="main"
Jun 15 06:06:39.370705 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.370598    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d4fe2f8-f7d4-4c1a-90d7-eb025d8426d3" containerName="tokenizer"
Jun 15 06:06:39.372911 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.372892    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.374249 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.374226    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jg2d\" (UniqueName: \"kubernetes.io/projected/1264e5f9-09ea-4712-8848-1be6c22009fa-kube-api-access-7jg2d\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.374326 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.374265    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/1264e5f9-09ea-4712-8848-1be6c22009fa-tokenizer-cache\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.374386 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.374324    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/1264e5f9-09ea-4712-8848-1be6c22009fa-tokenizer-tmp\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.374424 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.374384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1264e5f9-09ea-4712-8848-1be6c22009fa-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.374424 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.374406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1264e5f9-09ea-4712-8848-1be6c22009fa-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.378208 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.378192    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-5b1e8f15-epp-sa-dockercfg-rx77b\""
Jun 15 06:06:39.379037 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.379018    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs\""
Jun 15 06:06:39.384867 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.384847    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"]
Jun 15 06:06:39.475470 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.475438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jg2d\" (UniqueName: \"kubernetes.io/projected/1264e5f9-09ea-4712-8848-1be6c22009fa-kube-api-access-7jg2d\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.475470 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.475476    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/1264e5f9-09ea-4712-8848-1be6c22009fa-tokenizer-cache\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.475709 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.475515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/1264e5f9-09ea-4712-8848-1be6c22009fa-tokenizer-tmp\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.475709 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.475559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1264e5f9-09ea-4712-8848-1be6c22009fa-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.475709 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.475576    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1264e5f9-09ea-4712-8848-1be6c22009fa-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.475906 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.475887    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/1264e5f9-09ea-4712-8848-1be6c22009fa-tokenizer-cache\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.476015 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.475976    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/1264e5f9-09ea-4712-8848-1be6c22009fa-tokenizer-tmp\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.476015 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.475986    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1264e5f9-09ea-4712-8848-1be6c22009fa-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.478152 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.478136    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1264e5f9-09ea-4712-8848-1be6c22009fa-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.484276 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.484254    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jg2d\" (UniqueName: \"kubernetes.io/projected/1264e5f9-09ea-4712-8848-1be6c22009fa-kube-api-access-7jg2d\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj\" (UID: \"1264e5f9-09ea-4712-8848-1be6c22009fa\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.682117 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.682072    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:39.829172 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:39.829146    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"]
Jun 15 06:06:39.831429 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:06:39.831392    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1264e5f9_09ea_4712_8848_1be6c22009fa.slice/crio-b400f11cbaa5252471ff41707077b05990deafb4e06df56b94b70978dfb78a78 WatchSource:0}: Error finding container b400f11cbaa5252471ff41707077b05990deafb4e06df56b94b70978dfb78a78: Status 404 returned error can't find the container with id b400f11cbaa5252471ff41707077b05990deafb4e06df56b94b70978dfb78a78
Jun 15 06:06:40.123821 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:40.123789    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj" event={"ID":"1264e5f9-09ea-4712-8848-1be6c22009fa","Type":"ContainerStarted","Data":"f57a309a3b8c5c8eee249eff5a705a9ebacae81579281f80635f6407af08c507"}
Jun 15 06:06:40.123980 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:40.123838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj" event={"ID":"1264e5f9-09ea-4712-8848-1be6c22009fa","Type":"ContainerStarted","Data":"c2d6e31fd4caa01e365ddd5e74ad16e61669ffc6a74474a0486fcc133a9a87b9"}
Jun 15 06:06:40.123980 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:40.123857    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj" event={"ID":"1264e5f9-09ea-4712-8848-1be6c22009fa","Type":"ContainerStarted","Data":"b400f11cbaa5252471ff41707077b05990deafb4e06df56b94b70978dfb78a78"}
Jun 15 06:06:40.123980 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:40.123950    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:40.143805 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:40.143756    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj" podStartSLOduration=1.143740696 podStartE2EDuration="1.143740696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:06:40.141614358 +0000 UTC m=+1080.275787607" watchObservedRunningTime="2026-06-15 06:06:40.143740696 +0000 UTC m=+1080.277913945"
Jun 15 06:06:49.683155 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:49.683117    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:49.683609 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:49.683199    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:49.685834 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:49.685812    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:06:50.177215 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:06:50.177181    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:07:11.182009 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:07:11.181981    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj"
Jun 15 06:18:09.233980 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:18:09.233954    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 06:25:34.666918 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:34.666888    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 06:25:34.677347 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:34.677323    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 06:25:41.991314 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:41.991276    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"]
Jun 15 06:25:41.994906 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:41.994887    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:41.997214 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:41.997193    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-4b931143-epp-sa-dockercfg-rxpbg\""
Jun 15 06:25:41.997763 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:41.997747    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs\""
Jun 15 06:25:42.007495 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.007469    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"]
Jun 15 06:25:42.013836 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.013810    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.013929 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.013857    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.013976 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.013949    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tokenizer-cache\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.014019 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.014001    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t9fg\" (UniqueName: \"kubernetes.io/projected/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-kube-api-access-8t9fg\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.014073 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.014059    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tokenizer-tmp\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.114954 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.114922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.115151 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.115004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tokenizer-cache\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.115151 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.115030    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t9fg\" (UniqueName: \"kubernetes.io/projected/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-kube-api-access-8t9fg\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.115151 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.115057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tokenizer-tmp\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.115321 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.115211    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.115387 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.115366    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.115427 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.115397    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tokenizer-cache\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.115519 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.115500    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tokenizer-tmp\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.117804 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.117782    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.123993 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.123975    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t9fg\" (UniqueName: \"kubernetes.io/projected/8e1b69b4-ea1b-42c3-9cb9-591db3c02643-kube-api-access-8t9fg\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk\" (UID: \"8e1b69b4-ea1b-42c3-9cb9-591db3c02643\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.304777 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.304690    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:42.447054 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:42.447026    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"]
Jun 15 06:25:42.449124 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:25:42.449095    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1b69b4_ea1b_42c3_9cb9_591db3c02643.slice/crio-55eb885a159352998d9775daf07f5077cfc42eb8510d7da97cf8f4449f815c2d WatchSource:0}: Error finding container 55eb885a159352998d9775daf07f5077cfc42eb8510d7da97cf8f4449f815c2d: Status 404 returned error can't find the container with id 55eb885a159352998d9775daf07f5077cfc42eb8510d7da97cf8f4449f815c2d
Jun 15 06:25:43.387422 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:43.387381    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk" event={"ID":"8e1b69b4-ea1b-42c3-9cb9-591db3c02643","Type":"ContainerStarted","Data":"0027d74da24955b56dcac9ad15899c3fafd670b7523765b2f48f0c7501b244b3"}
Jun 15 06:25:43.387886 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:43.387441    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk" event={"ID":"8e1b69b4-ea1b-42c3-9cb9-591db3c02643","Type":"ContainerStarted","Data":"547f599db73de1ca1ad8af0e4f755607186abe4236f58063abf49196fa6337e3"}
Jun 15 06:25:43.387886 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:43.387462    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk" event={"ID":"8e1b69b4-ea1b-42c3-9cb9-591db3c02643","Type":"ContainerStarted","Data":"55eb885a159352998d9775daf07f5077cfc42eb8510d7da97cf8f4449f815c2d"}
Jun 15 06:25:43.387886 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:43.387511    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:43.405824 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:43.405762    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk" podStartSLOduration=2.405749018 podStartE2EDuration="2.405749018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:25:43.404802954 +0000 UTC m=+2223.538976205" watchObservedRunningTime="2026-06-15 06:25:43.405749018 +0000 UTC m=+2223.539922267"
Jun 15 06:25:52.305267 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:52.305182    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:52.305702 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:52.305296    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:52.307822 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:52.307800    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:25:52.435586 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:25:52.435558    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:26:14.446692 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:26:14.446663    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk"
Jun 15 06:44:38.561605 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:44:38.561567    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 06:44:38.570109 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:44:38.570073    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 06:45:13.828270 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:13.828237    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"]
Jun 15 06:45:13.832006 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:13.831970    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:13.834041 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:13.834022    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa-dockercfg-sd6cp\""
Jun 15 06:45:13.834179 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:13.834108    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs\""
Jun 15 06:45:13.842234 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:13.842200    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"]
Jun 15 06:45:13.900698 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:13.900670    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d15a90cc-1bc7-4614-9bf0-26231da0604c-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:13.900698 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:13.900698    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-tokenizer-tmp\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:13.900857 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:13.900726    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwz6g\" (UniqueName: \"kubernetes.io/projected/d15a90cc-1bc7-4614-9bf0-26231da0604c-kube-api-access-xwz6g\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:13.900857 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:13.900814    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-tokenizer-cache\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:13.900925 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:13.900896    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:13.900925 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:13.900918    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.001460 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.001426    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-tokenizer-cache\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.001612 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.001488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.001612 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.001513    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.001612 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.001561    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d15a90cc-1bc7-4614-9bf0-26231da0604c-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.001612 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.001585    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-tokenizer-tmp\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.001828 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.001621    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwz6g\" (UniqueName: \"kubernetes.io/projected/d15a90cc-1bc7-4614-9bf0-26231da0604c-kube-api-access-xwz6g\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.001898 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.001876    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-tokenizer-cache\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.001955 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.001896    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.002011 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.001950    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.002011 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.001981    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d15a90cc-1bc7-4614-9bf0-26231da0604c-tokenizer-tmp\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.004203 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.004180    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d15a90cc-1bc7-4614-9bf0-26231da0604c-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.010798 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.010779    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwz6g\" (UniqueName: \"kubernetes.io/projected/d15a90cc-1bc7-4614-9bf0-26231da0604c-kube-api-access-xwz6g\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw\" (UID: \"d15a90cc-1bc7-4614-9bf0-26231da0604c\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.142903 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.142834    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:14.281547 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.281519    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"]
Jun 15 06:45:14.282522 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:45:14.282500    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15a90cc_1bc7_4614_9bf0_26231da0604c.slice/crio-3e2b4ee3045994a9a8160d31931cc56887ae9865442587902b77976b66b122f8 WatchSource:0}: Error finding container 3e2b4ee3045994a9a8160d31931cc56887ae9865442587902b77976b66b122f8: Status 404 returned error can't find the container with id 3e2b4ee3045994a9a8160d31931cc56887ae9865442587902b77976b66b122f8
Jun 15 06:45:14.286662 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.286641    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 06:45:14.886471 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.886430    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw" event={"ID":"d15a90cc-1bc7-4614-9bf0-26231da0604c","Type":"ContainerStarted","Data":"81f8edcb9db283dbcea930e9d7dbde3e12ab040f916194724bdf612f9a6f3119"}
Jun 15 06:45:14.886950 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:14.886502    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw" event={"ID":"d15a90cc-1bc7-4614-9bf0-26231da0604c","Type":"ContainerStarted","Data":"3e2b4ee3045994a9a8160d31931cc56887ae9865442587902b77976b66b122f8"}
Jun 15 06:45:15.894282 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:15.894247    2573 generic.go:356] "Generic (PLEG): container finished" podID="d15a90cc-1bc7-4614-9bf0-26231da0604c" containerID="81f8edcb9db283dbcea930e9d7dbde3e12ab040f916194724bdf612f9a6f3119" exitCode=0
Jun 15 06:45:15.894673 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:15.894327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw" event={"ID":"d15a90cc-1bc7-4614-9bf0-26231da0604c","Type":"ContainerDied","Data":"81f8edcb9db283dbcea930e9d7dbde3e12ab040f916194724bdf612f9a6f3119"}
Jun 15 06:45:16.902114 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:16.902059    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw" event={"ID":"d15a90cc-1bc7-4614-9bf0-26231da0604c","Type":"ContainerStarted","Data":"34fb32fa06720a4f94fef5476a3ceabdbbd1523fa4b06331251b4b32b4151219"}
Jun 15 06:45:16.902591 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:16.902134    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw" event={"ID":"d15a90cc-1bc7-4614-9bf0-26231da0604c","Type":"ContainerStarted","Data":"7d276bd5f209a7e7c71ba25011b21543dcc017333731b89982cb26b3bdfdd24e"}
Jun 15 06:45:16.927744 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:16.927691    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw" podStartSLOduration=3.135688415 podStartE2EDuration="3.927676144s" totalImagesPullingTime="0s" totalInitContainerRuntime="791.987729ms" isStatefulPod=false podCreationTimestamp="2026-06-15 06:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:45:16.924826941 +0000 UTC m=+3397.059000193" watchObservedRunningTime="2026-06-15 06:45:16.927676144 +0000 UTC m=+3397.061849394"
Jun 15 06:45:17.907648 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:17.907611    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:21.827603 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:21.827525    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"]
Jun 15 06:45:21.832858 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:21.832839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:21.834875 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:21.834856    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs\""
Jun 15 06:45:21.834984 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:21.834876    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa-dockercfg-xv99p\""
Jun 15 06:45:21.840909 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:21.840877    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"]
Jun 15 06:45:21.979095 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:21.979063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-cache\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:21.979285 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:21.979152    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-uds\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:21.979285 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:21.979173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dchgx\" (UniqueName: \"kubernetes.io/projected/498fceac-69a1-4243-8b03-218bd0ebda8b-kube-api-access-dchgx\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:21.979285 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:21.979200    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-tmp\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:21.979285 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:21.979220    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/498fceac-69a1-4243-8b03-218bd0ebda8b-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:21.979449 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:21.979290    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-kserve-provision-location\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.080161 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.080048    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-cache\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.080161 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.080150    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-uds\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.080386 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.080172    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dchgx\" (UniqueName: \"kubernetes.io/projected/498fceac-69a1-4243-8b03-218bd0ebda8b-kube-api-access-dchgx\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.080386 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.080200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-tmp\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.080386 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.080220    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/498fceac-69a1-4243-8b03-218bd0ebda8b-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.080386 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.080258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-kserve-provision-location\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.080620 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.080509    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-cache\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.080679 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.080633    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-uds\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.080679 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.080651    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-tmp\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.080748 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.080722    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-kserve-provision-location\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.082767 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.082747    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/498fceac-69a1-4243-8b03-218bd0ebda8b-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.089689 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.089651    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dchgx\" (UniqueName: \"kubernetes.io/projected/498fceac-69a1-4243-8b03-218bd0ebda8b-kube-api-access-dchgx\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.144336 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.144301    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:22.290771 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.290729    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"]
Jun 15 06:45:22.936864 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.936831    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg" event={"ID":"498fceac-69a1-4243-8b03-218bd0ebda8b","Type":"ContainerStarted","Data":"eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c"}
Jun 15 06:45:22.937289 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:22.936892    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg" event={"ID":"498fceac-69a1-4243-8b03-218bd0ebda8b","Type":"ContainerStarted","Data":"b336d138dc3cdf420fa58eb25800a8ba7434282c222127e1d32d198b5ac1f887"}
Jun 15 06:45:23.943691 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:23.943656    2573 generic.go:356] "Generic (PLEG): container finished" podID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerID="eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c" exitCode=0
Jun 15 06:45:23.944060 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:23.943721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg" event={"ID":"498fceac-69a1-4243-8b03-218bd0ebda8b","Type":"ContainerDied","Data":"eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c"}
Jun 15 06:45:24.143156 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:24.143125    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:24.143313 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:24.143197    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:24.145990 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:24.145968    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:24.952726 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:24.952683    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg" event={"ID":"498fceac-69a1-4243-8b03-218bd0ebda8b","Type":"ContainerStarted","Data":"b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36"}
Jun 15 06:45:24.953221 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:24.952753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg" event={"ID":"498fceac-69a1-4243-8b03-218bd0ebda8b","Type":"ContainerStarted","Data":"c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e"}
Jun 15 06:45:24.953221 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:24.952781    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:24.954198 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:24.954177    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:24.976443 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:24.976377    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg" podStartSLOduration=3.14740617 podStartE2EDuration="3.976361749s" totalImagesPullingTime="0s" totalInitContainerRuntime="828.955579ms" isStatefulPod=false podCreationTimestamp="2026-06-15 06:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:45:24.972889277 +0000 UTC m=+3405.107062725" watchObservedRunningTime="2026-06-15 06:45:24.976361749 +0000 UTC m=+3405.110534998"
Jun 15 06:45:32.144930 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:32.144889    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:32.145361 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:32.144991    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:32.147754 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:32.147731    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:32.995280 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:32.995251    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:45:45.961753 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:45.961726    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw"
Jun 15 06:45:54.000478 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:45:54.000445    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:48:27.481438 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:27.481405    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"]
Jun 15 06:48:27.481910 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:27.481696    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg" podUID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerName="main" containerID="cri-o://c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e" gracePeriod=30
Jun 15 06:48:27.481910 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:27.481899    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg" podUID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerName="tokenizer" containerID="cri-o://b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36" gracePeriod=30
Jun 15 06:48:27.868173 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:27.868074    2573 generic.go:356] "Generic (PLEG): container finished" podID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerID="c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e" exitCode=0
Jun 15 06:48:27.868173 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:27.868116    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg" event={"ID":"498fceac-69a1-4243-8b03-218bd0ebda8b","Type":"ContainerDied","Data":"c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e"}
Jun 15 06:48:28.746555 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.746496    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:48:28.855060 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855021    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-cache\") pod \"498fceac-69a1-4243-8b03-218bd0ebda8b\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") "
Jun 15 06:48:28.855060 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855070    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dchgx\" (UniqueName: \"kubernetes.io/projected/498fceac-69a1-4243-8b03-218bd0ebda8b-kube-api-access-dchgx\") pod \"498fceac-69a1-4243-8b03-218bd0ebda8b\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") "
Jun 15 06:48:28.855305 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855181    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-kserve-provision-location\") pod \"498fceac-69a1-4243-8b03-218bd0ebda8b\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") "
Jun 15 06:48:28.855305 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855232    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/498fceac-69a1-4243-8b03-218bd0ebda8b-tls-certs\") pod \"498fceac-69a1-4243-8b03-218bd0ebda8b\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") "
Jun 15 06:48:28.855305 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855263    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "498fceac-69a1-4243-8b03-218bd0ebda8b" (UID: "498fceac-69a1-4243-8b03-218bd0ebda8b"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:48:28.855305 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855278    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-uds\") pod \"498fceac-69a1-4243-8b03-218bd0ebda8b\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") "
Jun 15 06:48:28.855526 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855309    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-tmp\") pod \"498fceac-69a1-4243-8b03-218bd0ebda8b\" (UID: \"498fceac-69a1-4243-8b03-218bd0ebda8b\") "
Jun 15 06:48:28.855526 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855463    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "498fceac-69a1-4243-8b03-218bd0ebda8b" (UID: "498fceac-69a1-4243-8b03-218bd0ebda8b"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:48:28.855634 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855618    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-uds\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:48:28.855690 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855635    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-cache\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:48:28.855749 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855701    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "498fceac-69a1-4243-8b03-218bd0ebda8b" (UID: "498fceac-69a1-4243-8b03-218bd0ebda8b"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:48:28.855962 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.855938    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "498fceac-69a1-4243-8b03-218bd0ebda8b" (UID: "498fceac-69a1-4243-8b03-218bd0ebda8b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:48:28.857408 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.857370    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/498fceac-69a1-4243-8b03-218bd0ebda8b-kube-api-access-dchgx" (OuterVolumeSpecName: "kube-api-access-dchgx") pod "498fceac-69a1-4243-8b03-218bd0ebda8b" (UID: "498fceac-69a1-4243-8b03-218bd0ebda8b"). InnerVolumeSpecName "kube-api-access-dchgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:48:28.857578 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.857556    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/498fceac-69a1-4243-8b03-218bd0ebda8b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "498fceac-69a1-4243-8b03-218bd0ebda8b" (UID: "498fceac-69a1-4243-8b03-218bd0ebda8b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:48:28.874308 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.874280    2573 generic.go:356] "Generic (PLEG): container finished" podID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerID="b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36" exitCode=0
Jun 15 06:48:28.874400 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.874334    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg" event={"ID":"498fceac-69a1-4243-8b03-218bd0ebda8b","Type":"ContainerDied","Data":"b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36"}
Jun 15 06:48:28.874400 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.874347    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"
Jun 15 06:48:28.874400 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.874386    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg" event={"ID":"498fceac-69a1-4243-8b03-218bd0ebda8b","Type":"ContainerDied","Data":"b336d138dc3cdf420fa58eb25800a8ba7434282c222127e1d32d198b5ac1f887"}
Jun 15 06:48:28.874546 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.874420    2573 scope.go:117] "RemoveContainer" containerID="b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36"
Jun 15 06:48:28.884042 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.884009    2573 scope.go:117] "RemoveContainer" containerID="c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e"
Jun 15 06:48:28.893486 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.893465    2573 scope.go:117] "RemoveContainer" containerID="eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c"
Jun 15 06:48:28.898307 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.898287    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"]
Jun 15 06:48:28.903039 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.903015    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg"]
Jun 15 06:48:28.904574 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.904551    2573 scope.go:117] "RemoveContainer" containerID="b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36"
Jun 15 06:48:28.904859 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:48:28.904839    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36\": container with ID starting with b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36 not found: ID does not exist" containerID="b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36"
Jun 15 06:48:28.904948 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.904873    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36"} err="failed to get container status \"b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36\": rpc error: code = NotFound desc = could not find container \"b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36\": container with ID starting with b87601aac23f289e4c3f68a7ef808cd4a573ab89dca35845936a58941fd65b36 not found: ID does not exist"
Jun 15 06:48:28.904948 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.904889    2573 scope.go:117] "RemoveContainer" containerID="c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e"
Jun 15 06:48:28.905196 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:48:28.905157    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e\": container with ID starting with c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e not found: ID does not exist" containerID="c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e"
Jun 15 06:48:28.905273 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.905205    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e"} err="failed to get container status \"c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e\": rpc error: code = NotFound desc = could not find container \"c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e\": container with ID starting with c666aa019cc2aa9e80708b649a41077fc9ed67cb14ee9eac166ac3bb70144a4e not found: ID does not exist"
Jun 15 06:48:28.905273 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.905229    2573 scope.go:117] "RemoveContainer" containerID="eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c"
Jun 15 06:48:28.905463 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:48:28.905445    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c\": container with ID starting with eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c not found: ID does not exist" containerID="eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c"
Jun 15 06:48:28.905530 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.905467    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c"} err="failed to get container status \"eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c\": rpc error: code = NotFound desc = could not find container \"eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c\": container with ID starting with eff8c552cd5cfd6de5e4099d49afe9b18595015410746ecfa582ba4566f9486c not found: ID does not exist"
Jun 15 06:48:28.956492 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.956461    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-kserve-provision-location\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:48:28.956492 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.956489    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/498fceac-69a1-4243-8b03-218bd0ebda8b-tls-certs\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:48:28.956640 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.956501    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/498fceac-69a1-4243-8b03-218bd0ebda8b-tokenizer-tmp\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:48:28.956640 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:28.956509    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dchgx\" (UniqueName: \"kubernetes.io/projected/498fceac-69a1-4243-8b03-218bd0ebda8b-kube-api-access-dchgx\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:48:30.339750 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:30.339715    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="498fceac-69a1-4243-8b03-218bd0ebda8b" path="/var/lib/kubelet/pods/498fceac-69a1-4243-8b03-218bd0ebda8b/volumes"
Jun 15 06:48:43.950503 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:43.950468    2573 generic.go:356] "Generic (PLEG): container finished" podID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerID="78b3bd6a6d7779b3e4fb701fd8ab003025dcea8e145470946f90beea558394c4" exitCode=137
Jun 15 06:48:43.950982 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:43.950536    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" event={"ID":"80d602fe-af57-4796-94f6-2bfcac712cb4","Type":"ContainerDied","Data":"78b3bd6a6d7779b3e4fb701fd8ab003025dcea8e145470946f90beea558394c4"}
Jun 15 06:48:43.950982 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:43.950584    2573 scope.go:117] "RemoveContainer" containerID="9fc1d317d4ee71f3e085bdf6a645555a9c5a320ca21bdb1ba5d6866b6b4b6cc7"
Jun 15 06:48:43.950982 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:43.950972    2573 scope.go:117] "RemoveContainer" containerID="78b3bd6a6d7779b3e4fb701fd8ab003025dcea8e145470946f90beea558394c4"
Jun 15 06:48:43.952076 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:43.952043    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jun 15 06:48:43.952181 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:43.952161    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jun 15 06:48:43.952229 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:43.952213    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jun 15 06:48:44.957685 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:44.957653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" event={"ID":"80d602fe-af57-4796-94f6-2bfcac712cb4","Type":"ContainerStarted","Data":"603f6d95aa9454351beaf956b7a0b57b9c9423b7b8c6c3987237d95e2828a84f"}
Jun 15 06:48:45.735788 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:45.735754    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 06:48:45.736001 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:45.735979    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jun 15 06:48:45.736077 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:45.736031    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jun 15 06:48:46.736610 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:46.736572    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jun 15 06:48:46.737113 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:46.736636    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jun 15 06:48:47.735923 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:47.735884    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jun 15 06:48:47.736158 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:47.735946    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jun 15 06:48:48.736189 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:48.736154    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jun 15 06:48:48.736564 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:48.736206    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jun 15 06:48:49.735602 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:49.735565    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jun 15 06:48:49.735781 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:49.735620    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jun 15 06:48:51.777237 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:51.777198    2573 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jun 15 06:48:51.777675 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:51.777262    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd" podUID="80d602fe-af57-4796-94f6-2bfcac712cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jun 15 06:48:51.791649 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:51.791627    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 06:48:51.791926 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:51.791902    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 06:48:51.792526 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:51.792508    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd"
Jun 15 06:48:55.404131 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.404098    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"]
Jun 15 06:48:55.404702 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.404680    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerName="main"
Jun 15 06:48:55.404702 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.404706    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerName="main"
Jun 15 06:48:55.404854 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.404723    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerName="storage-initializer"
Jun 15 06:48:55.404854 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.404732    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerName="storage-initializer"
Jun 15 06:48:55.404854 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.404765    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerName="tokenizer"
Jun 15 06:48:55.404854 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.404774    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerName="tokenizer"
Jun 15 06:48:55.405069 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.404870    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerName="main"
Jun 15 06:48:55.405069 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.404885    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="498fceac-69a1-4243-8b03-218bd0ebda8b" containerName="tokenizer"
Jun 15 06:48:55.410952 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.410792    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.413556 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.413529    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-pd-test-kserve-self-signed-certs\""
Jun 15 06:48:55.413792 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.413775    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-pd-test-epp-sa-dockercfg-nlc7f\""
Jun 15 06:48:55.426009 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.425986    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"]
Jun 15 06:48:55.501107 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.501066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54sst\" (UniqueName: \"kubernetes.io/projected/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kube-api-access-54sst\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.501273 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.501130    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.501273 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.501187    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-uds\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.501273 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.501240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-tmp\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.501273 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.501262    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.501815 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.501309    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-cache\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.602321 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.602292    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54sst\" (UniqueName: \"kubernetes.io/projected/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kube-api-access-54sst\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.602483 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.602333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.602483 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.602352    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-uds\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.602483 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.602386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-tmp\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.602643 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.602569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.602701 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.602647    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-cache\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.602753 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.602724    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-uds\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.602883 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.602757    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-tmp\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.602971 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.602935    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.603033 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.603010    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-cache\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.605038 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.605016    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.611214 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.611190    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54sst\" (UniqueName: \"kubernetes.io/projected/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kube-api-access-54sst\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.723814 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.723789    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:55.860894 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:55.860870    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"]
Jun 15 06:48:55.862324 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:48:55.862300    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac8c47f_2d30_480f_9bb4_128a5f5c4228.slice/crio-d1fa34cdabfff582ec828bbda0da0200c5b691d62a7bcd4f370cf163ee1aa995 WatchSource:0}: Error finding container d1fa34cdabfff582ec828bbda0da0200c5b691d62a7bcd4f370cf163ee1aa995: Status 404 returned error can't find the container with id d1fa34cdabfff582ec828bbda0da0200c5b691d62a7bcd4f370cf163ee1aa995
Jun 15 06:48:56.017764 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:56.017670    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7" event={"ID":"6ac8c47f-2d30-480f-9bb4-128a5f5c4228","Type":"ContainerStarted","Data":"78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09"}
Jun 15 06:48:56.017764 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:56.017736    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7" event={"ID":"6ac8c47f-2d30-480f-9bb4-128a5f5c4228","Type":"ContainerStarted","Data":"d1fa34cdabfff582ec828bbda0da0200c5b691d62a7bcd4f370cf163ee1aa995"}
Jun 15 06:48:57.024207 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:57.024123    2573 generic.go:356] "Generic (PLEG): container finished" podID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerID="78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09" exitCode=0
Jun 15 06:48:57.024207 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:57.024160    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7" event={"ID":"6ac8c47f-2d30-480f-9bb4-128a5f5c4228","Type":"ContainerDied","Data":"78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09"}
Jun 15 06:48:58.031601 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:58.031570    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7" event={"ID":"6ac8c47f-2d30-480f-9bb4-128a5f5c4228","Type":"ContainerStarted","Data":"56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e"}
Jun 15 06:48:58.031954 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:58.031621    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7" event={"ID":"6ac8c47f-2d30-480f-9bb4-128a5f5c4228","Type":"ContainerStarted","Data":"91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4"}
Jun 15 06:48:58.031954 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:58.031724    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:48:58.055579 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:48:58.055525    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7" podStartSLOduration=2.247011271 podStartE2EDuration="3.055506026s" totalImagesPullingTime="0s" totalInitContainerRuntime="808.494755ms" isStatefulPod=false podCreationTimestamp="2026-06-15 06:48:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:48:58.052823359 +0000 UTC m=+3618.186996617" watchObservedRunningTime="2026-06-15 06:48:58.055506026 +0000 UTC m=+3618.189679279"
Jun 15 06:49:05.724270 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:49:05.724235    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:49:05.724682 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:49:05.724295    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:49:05.727304 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:49:05.727278    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:49:06.079174 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:49:06.079076    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:49:27.084743 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:49:27.084716    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:51:50.979296 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:50.979264    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"]
Jun 15 06:51:50.979782 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:50.979512    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7" podUID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerName="main" containerID="cri-o://91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4" gracePeriod=30
Jun 15 06:51:50.979782 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:50.979585    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7" podUID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerName="tokenizer" containerID="cri-o://56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e" gracePeriod=30
Jun 15 06:51:51.911606 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:51.911570    2573 generic.go:356] "Generic (PLEG): container finished" podID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerID="91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4" exitCode=0
Jun 15 06:51:51.911839 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:51.911641    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7" event={"ID":"6ac8c47f-2d30-480f-9bb4-128a5f5c4228","Type":"ContainerDied","Data":"91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4"}
Jun 15 06:51:52.230831 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.230810    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:51:52.344586 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.344556    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tls-certs\") pod \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") "
Jun 15 06:51:52.344586 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.344586    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-tmp\") pod \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") "
Jun 15 06:51:52.344788 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.344606    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-cache\") pod \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") "
Jun 15 06:51:52.344788 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.344737    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kserve-provision-location\") pod \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") "
Jun 15 06:51:52.344788 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.344784    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-uds\") pod \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") "
Jun 15 06:51:52.344912 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.344840    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "6ac8c47f-2d30-480f-9bb4-128a5f5c4228" (UID: "6ac8c47f-2d30-480f-9bb4-128a5f5c4228"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:51:52.344912 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.344858    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54sst\" (UniqueName: \"kubernetes.io/projected/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kube-api-access-54sst\") pod \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\" (UID: \"6ac8c47f-2d30-480f-9bb4-128a5f5c4228\") "
Jun 15 06:51:52.345013 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.344994    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "6ac8c47f-2d30-480f-9bb4-128a5f5c4228" (UID: "6ac8c47f-2d30-480f-9bb4-128a5f5c4228"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:51:52.345053 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.345004    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "6ac8c47f-2d30-480f-9bb4-128a5f5c4228" (UID: "6ac8c47f-2d30-480f-9bb4-128a5f5c4228"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:51:52.345187 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.345172    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-tmp\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:51:52.345248 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.345188    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-cache\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:51:52.345248 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.345196    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tokenizer-uds\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:51:52.345442 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.345418    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6ac8c47f-2d30-480f-9bb4-128a5f5c4228" (UID: "6ac8c47f-2d30-480f-9bb4-128a5f5c4228"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:51:52.346823 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.346802    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ac8c47f-2d30-480f-9bb4-128a5f5c4228" (UID: "6ac8c47f-2d30-480f-9bb4-128a5f5c4228"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:51:52.347016 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.346993    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kube-api-access-54sst" (OuterVolumeSpecName: "kube-api-access-54sst") pod "6ac8c47f-2d30-480f-9bb4-128a5f5c4228" (UID: "6ac8c47f-2d30-480f-9bb4-128a5f5c4228"). InnerVolumeSpecName "kube-api-access-54sst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:51:52.446069 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.446034    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kserve-provision-location\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:51:52.446069 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.446063    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54sst\" (UniqueName: \"kubernetes.io/projected/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-kube-api-access-54sst\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:51:52.446069 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.446072    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac8c47f-2d30-480f-9bb4-128a5f5c4228-tls-certs\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 06:51:52.918806 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.918776    2573 generic.go:356] "Generic (PLEG): container finished" podID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerID="56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e" exitCode=0
Jun 15 06:51:52.918984 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.918828    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"
Jun 15 06:51:52.918984 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.918863    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7" event={"ID":"6ac8c47f-2d30-480f-9bb4-128a5f5c4228","Type":"ContainerDied","Data":"56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e"}
Jun 15 06:51:52.918984 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.918920    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7" event={"ID":"6ac8c47f-2d30-480f-9bb4-128a5f5c4228","Type":"ContainerDied","Data":"d1fa34cdabfff582ec828bbda0da0200c5b691d62a7bcd4f370cf163ee1aa995"}
Jun 15 06:51:52.918984 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.918943    2573 scope.go:117] "RemoveContainer" containerID="56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e"
Jun 15 06:51:52.928447 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.928431    2573 scope.go:117] "RemoveContainer" containerID="91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4"
Jun 15 06:51:52.937065 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.937045    2573 scope.go:117] "RemoveContainer" containerID="78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09"
Jun 15 06:51:52.942330 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.942306    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"]
Jun 15 06:51:52.945823 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.945801    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7"]
Jun 15 06:51:52.949319 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.949296    2573 scope.go:117] "RemoveContainer" containerID="56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e"
Jun 15 06:51:52.949705 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:51:52.949682    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e\": container with ID starting with 56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e not found: ID does not exist" containerID="56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e"
Jun 15 06:51:52.949792 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.949716    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e"} err="failed to get container status \"56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e\": rpc error: code = NotFound desc = could not find container \"56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e\": container with ID starting with 56af4e09843dfee0fb2dba0012ed5768cb6de55b61b252371a8492891d276c1e not found: ID does not exist"
Jun 15 06:51:52.949792 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.949743    2573 scope.go:117] "RemoveContainer" containerID="91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4"
Jun 15 06:51:52.950041 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:51:52.950023    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4\": container with ID starting with 91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4 not found: ID does not exist" containerID="91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4"
Jun 15 06:51:52.950133 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.950047    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4"} err="failed to get container status \"91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4\": rpc error: code = NotFound desc = could not find container \"91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4\": container with ID starting with 91c27de6fb521b55afa536290cc8e706aaaf8b2494d3820e14bb8f02f5e918d4 not found: ID does not exist"
Jun 15 06:51:52.950133 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.950064    2573 scope.go:117] "RemoveContainer" containerID="78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09"
Jun 15 06:51:52.950374 ip-10-0-141-25 kubenswrapper[2573]: E0615 06:51:52.950354    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09\": container with ID starting with 78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09 not found: ID does not exist" containerID="78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09"
Jun 15 06:51:52.950434 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:52.950378    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09"} err="failed to get container status \"78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09\": rpc error: code = NotFound desc = could not find container \"78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09\": container with ID starting with 78572ce7be2d1aaffc769bed4e38b64a738de5e453df95a4d0ad51459d43ed09 not found: ID does not exist"
Jun 15 06:51:54.337325 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:51:54.337290    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" path="/var/lib/kubelet/pods/6ac8c47f-2d30-480f-9bb4-128a5f5c4228/volumes"
Jun 15 06:52:28.031632 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.031595    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"]
Jun 15 06:52:28.032196 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.032176    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerName="main"
Jun 15 06:52:28.032288 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.032200    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerName="main"
Jun 15 06:52:28.032288 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.032213    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerName="storage-initializer"
Jun 15 06:52:28.032288 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.032222    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerName="storage-initializer"
Jun 15 06:52:28.032288 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.032251    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerName="tokenizer"
Jun 15 06:52:28.032288 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.032260    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerName="tokenizer"
Jun 15 06:52:28.032622 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.032368    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerName="tokenizer"
Jun 15 06:52:28.032622 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.032383    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ac8c47f-2d30-480f-9bb4-128a5f5c4228" containerName="main"
Jun 15 06:52:28.035899 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.035878    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.038274 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.038252    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-pd-test-kserve-self-signed-certs\""
Jun 15 06:52:28.038384 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.038289    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-pd-test-epp-sa-dockercfg-zqkmt\""
Jun 15 06:52:28.046350 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.046328    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"]
Jun 15 06:52:28.183019 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.182987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.183227 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.183033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tokenizer-tmp\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.183227 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.183059    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.183227 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.183117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tokenizer-cache\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.183227 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.183144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9kqp\" (UniqueName: \"kubernetes.io/projected/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-kube-api-access-t9kqp\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.183227 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.183168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tokenizer-uds\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.284770 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.284671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.284770 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.284720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tokenizer-cache\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.284770 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.284746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9kqp\" (UniqueName: \"kubernetes.io/projected/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-kube-api-access-t9kqp\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.285048 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.284775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tokenizer-uds\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.285048 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.284927    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.285048 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.284977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tokenizer-tmp\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.285239 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.285165    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tokenizer-cache\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.285430 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.285408    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tokenizer-uds\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.285494 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.285443    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.285494 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.285482    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tokenizer-tmp\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.288412 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.288382    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.293304 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.293280    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9kqp\" (UniqueName: \"kubernetes.io/projected/bb6c90a3-f29e-457c-b4ff-2d9c233c7b18-kube-api-access-t9kqp\") pod \"router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b\" (UID: \"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.345844 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.345814    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:28.501906 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:28.501865    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"]
Jun 15 06:52:28.505537 ip-10-0-141-25 kubenswrapper[2573]: W0615 06:52:28.505498    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6c90a3_f29e_457c_b4ff_2d9c233c7b18.slice/crio-6c29b282a84d99188934551d5a53050f96fc380b5cc7981829d34bf4e031908c WatchSource:0}: Error finding container 6c29b282a84d99188934551d5a53050f96fc380b5cc7981829d34bf4e031908c: Status 404 returned error can't find the container with id 6c29b282a84d99188934551d5a53050f96fc380b5cc7981829d34bf4e031908c
Jun 15 06:52:29.107014 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:29.106976    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b" event={"ID":"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18","Type":"ContainerStarted","Data":"b0165dd19df93ec101af23e0273c86d22b0d98fc86065345f99a625f3d9da714"}
Jun 15 06:52:29.107395 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:29.107058    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b" event={"ID":"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18","Type":"ContainerStarted","Data":"6c29b282a84d99188934551d5a53050f96fc380b5cc7981829d34bf4e031908c"}
Jun 15 06:52:30.113967 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:30.113931    2573 generic.go:356] "Generic (PLEG): container finished" podID="bb6c90a3-f29e-457c-b4ff-2d9c233c7b18" containerID="b0165dd19df93ec101af23e0273c86d22b0d98fc86065345f99a625f3d9da714" exitCode=0
Jun 15 06:52:30.114390 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:30.114010    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b" event={"ID":"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18","Type":"ContainerDied","Data":"b0165dd19df93ec101af23e0273c86d22b0d98fc86065345f99a625f3d9da714"}
Jun 15 06:52:31.121314 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:31.121274    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b" event={"ID":"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18","Type":"ContainerStarted","Data":"f4ef13056d3d95581c0612908e5ac35deeb001f9dec7e33f6c7404acd1e899f5"}
Jun 15 06:52:31.121732 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:31.121346    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b" event={"ID":"bb6c90a3-f29e-457c-b4ff-2d9c233c7b18","Type":"ContainerStarted","Data":"416e6aa380be17d437d8fbc3bd0d12992e4125801d118845cc8706877afb3eb9"}
Jun 15 06:52:31.121732 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:31.121379    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:31.147788 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:31.147742    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b" podStartSLOduration=2.361063788 podStartE2EDuration="3.147724547s" totalImagesPullingTime="0s" totalInitContainerRuntime="786.660759ms" isStatefulPod=false podCreationTimestamp="2026-06-15 06:52:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:52:31.147592614 +0000 UTC m=+3831.281765900" watchObservedRunningTime="2026-06-15 06:52:31.147724547 +0000 UTC m=+3831.281897796"
Jun 15 06:52:38.346860 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:38.346824    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:38.347332 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:38.346886    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:38.349519 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:38.349495    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:52:39.166164 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:52:39.166137    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:53:00.171881 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:53:00.171805    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b"
Jun 15 06:59:41.076358 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:41.076332    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 06:59:41.083354 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:41.083334    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 06:59:41.091774 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:41.091753    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 06:59:59.763459 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:59.763427    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"]
Jun 15 06:59:59.767288 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:59.767267    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 06:59:59.771847 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:59.771817    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa-dockercfg-9nvdk\""
Jun 15 06:59:59.771964 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:59.771854    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs\""
Jun 15 06:59:59.788070 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:59.788040    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"]
Jun 15 06:59:59.928538 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:59.928491    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2addb78-1f4e-4983-8983-218180355838-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 06:59:59.928538 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:59.928544    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-tokenizer-tmp\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 06:59:59.928751 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:59.928566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-tokenizer-cache\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 06:59:59.928751 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:59.928616    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 06:59:59.928751 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:59.928647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kcg6\" (UniqueName: \"kubernetes.io/projected/d2addb78-1f4e-4983-8983-218180355838-kube-api-access-5kcg6\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 06:59:59.928751 ip-10-0-141-25 kubenswrapper[2573]: I0615 06:59:59.928668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.029573 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.029488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.029573 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.029530    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kcg6\" (UniqueName: \"kubernetes.io/projected/d2addb78-1f4e-4983-8983-218180355838-kube-api-access-5kcg6\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.029573 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.029553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.029856 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.029652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2addb78-1f4e-4983-8983-218180355838-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.029856 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.029686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-tokenizer-tmp\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.029856 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.029708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-tokenizer-cache\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.030017 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.029877    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.030017 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.029980    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.030017 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.030004    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-tokenizer-tmp\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.030172 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.030050    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2addb78-1f4e-4983-8983-218180355838-tokenizer-cache\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.032197 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.032178    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2addb78-1f4e-4983-8983-218180355838-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.039600 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.039580    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kcg6\" (UniqueName: \"kubernetes.io/projected/d2addb78-1f4e-4983-8983-218180355838-kube-api-access-5kcg6\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz\" (UID: \"d2addb78-1f4e-4983-8983-218180355838\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.076674 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.076641    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:00.233727 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.233441    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"]
Jun 15 07:00:00.236498 ip-10-0-141-25 kubenswrapper[2573]: W0615 07:00:00.236449    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2addb78_1f4e_4983_8983_218180355838.slice/crio-ef6536c976759912586dda0fc192973857e137d482bfa4b06685a6922d53914f WatchSource:0}: Error finding container ef6536c976759912586dda0fc192973857e137d482bfa4b06685a6922d53914f: Status 404 returned error can't find the container with id ef6536c976759912586dda0fc192973857e137d482bfa4b06685a6922d53914f
Jun 15 07:00:00.240717 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.240699    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 07:00:00.368159 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.368117    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz" event={"ID":"d2addb78-1f4e-4983-8983-218180355838","Type":"ContainerStarted","Data":"b08e52af2d09e251985984fb269bc1130bce1d7700bf5a1263c10e91787b198b"}
Jun 15 07:00:00.368360 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:00.368184    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz" event={"ID":"d2addb78-1f4e-4983-8983-218180355838","Type":"ContainerStarted","Data":"ef6536c976759912586dda0fc192973857e137d482bfa4b06685a6922d53914f"}
Jun 15 07:00:01.374684 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:01.374651    2573 generic.go:356] "Generic (PLEG): container finished" podID="d2addb78-1f4e-4983-8983-218180355838" containerID="b08e52af2d09e251985984fb269bc1130bce1d7700bf5a1263c10e91787b198b" exitCode=0
Jun 15 07:00:01.375049 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:01.374692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz" event={"ID":"d2addb78-1f4e-4983-8983-218180355838","Type":"ContainerDied","Data":"b08e52af2d09e251985984fb269bc1130bce1d7700bf5a1263c10e91787b198b"}
Jun 15 07:00:02.382517 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:02.382488    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz" event={"ID":"d2addb78-1f4e-4983-8983-218180355838","Type":"ContainerStarted","Data":"cb308918fa53aef9fd362cfb693f2ceb35813fe1459d600b38914cb5df0685c4"}
Jun 15 07:00:02.382930 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:02.382546    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz" event={"ID":"d2addb78-1f4e-4983-8983-218180355838","Type":"ContainerStarted","Data":"38a75b8b7c9c2a6bee7e5522f89ae945d6a240936f3b0b2b060859d029ba1613"}
Jun 15 07:00:02.382930 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:02.382658    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:02.406595 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:02.406529    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz" podStartSLOduration=2.5685210659999997 podStartE2EDuration="3.406501594s" totalImagesPullingTime="0s" totalInitContainerRuntime="837.980528ms" isStatefulPod=false podCreationTimestamp="2026-06-15 06:59:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:00:02.404174629 +0000 UTC m=+4282.538347880" watchObservedRunningTime="2026-06-15 07:00:02.406501594 +0000 UTC m=+4282.540674845"
Jun 15 07:00:10.077598 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:10.077554    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:10.078190 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:10.077667    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:10.080291 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:10.080265    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:10.425986 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:10.425954    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:00:31.431487 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:00:31.431408    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz"
Jun 15 07:07:16.038140 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:07:16.038110    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:07:16.045576 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:07:16.045558    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:07:16.054369 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:07:16.054350    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:16:52.194149 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:16:52.194046    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:16:52.202856 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:16:52.202828    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:16:52.215340 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:16:52.215321    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:17:06.424017 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.423982    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"]
Jun 15 07:17:06.429113 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.429071    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.431332 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.431309    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-epp-sa-dockercfg-mp4jx\""
Jun 15 07:17:06.431447 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.431358    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-kserve-self-signed-certs\""
Jun 15 07:17:06.440211 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.440181    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"]
Jun 15 07:17:06.509139 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.509104    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.509332 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.509152    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.509332 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.509255    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfzdq\" (UniqueName: \"kubernetes.io/projected/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kube-api-access-wfzdq\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.509472 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.509330    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.509472 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.509365    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.509472 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.509387    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.610402 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.610368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.610402 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.610400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.610623 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.610416    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.610623 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.610484    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.610623 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.610510    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.610623 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.610574    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfzdq\" (UniqueName: \"kubernetes.io/projected/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kube-api-access-wfzdq\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.610919 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.610887    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.611001 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.610917    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.611001 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.610969    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.611104 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.611066    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.613600 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.613580    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.620274 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.620251    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfzdq\" (UniqueName: \"kubernetes.io/projected/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kube-api-access-wfzdq\") pod \"stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.741413 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.741316    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:06.913326 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.913283    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"]
Jun 15 07:17:06.915265 ip-10-0-141-25 kubenswrapper[2573]: W0615 07:17:06.915233    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb4e4db_a081_4cd6_8c89_53dd9115c461.slice/crio-fbe7ff4f410aaba50e82f0496ef815b301af83f7f7216fdd3c91d01e72765ab4 WatchSource:0}: Error finding container fbe7ff4f410aaba50e82f0496ef815b301af83f7f7216fdd3c91d01e72765ab4: Status 404 returned error can't find the container with id fbe7ff4f410aaba50e82f0496ef815b301af83f7f7216fdd3c91d01e72765ab4
Jun 15 07:17:06.920947 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:06.920910    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 07:17:07.858999 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:07.858965    2573 generic.go:356] "Generic (PLEG): container finished" podID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerID="1b9643c4c83fe6cc6d24244d23e3667816301673e1e4a7aefa6ccebbf9276a07" exitCode=0
Jun 15 07:17:07.859401 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:07.859048    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd" event={"ID":"4eb4e4db-a081-4cd6-8c89-53dd9115c461","Type":"ContainerDied","Data":"1b9643c4c83fe6cc6d24244d23e3667816301673e1e4a7aefa6ccebbf9276a07"}
Jun 15 07:17:07.859401 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:07.859128    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd" event={"ID":"4eb4e4db-a081-4cd6-8c89-53dd9115c461","Type":"ContainerStarted","Data":"fbe7ff4f410aaba50e82f0496ef815b301af83f7f7216fdd3c91d01e72765ab4"}
Jun 15 07:17:08.867194 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:08.867156    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd" event={"ID":"4eb4e4db-a081-4cd6-8c89-53dd9115c461","Type":"ContainerStarted","Data":"9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f"}
Jun 15 07:17:08.867576 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:08.867213    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd" event={"ID":"4eb4e4db-a081-4cd6-8c89-53dd9115c461","Type":"ContainerStarted","Data":"b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237"}
Jun 15 07:17:08.867576 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:08.867234    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:08.892293 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:08.892237    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd" podStartSLOduration=2.141396567 podStartE2EDuration="2.892218s" totalImagesPullingTime="0s" totalInitContainerRuntime="750.821433ms" isStatefulPod=false podCreationTimestamp="2026-06-15 07:17:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:17:08.887863781 +0000 UTC m=+5309.022037031" watchObservedRunningTime="2026-06-15 07:17:08.892218 +0000 UTC m=+5309.026391251"
Jun 15 07:17:16.742288 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:16.742253    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:16.742742 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:16.742315    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:16.745113 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:16.745078    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:16.913059 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:16.913027    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:17:37.918832 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:17:37.918802    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:19:59.919531 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:19:59.919433    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"]
Jun 15 07:19:59.920166 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:19:59.919752    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd" podUID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerName="main" containerID="cri-o://b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237" gracePeriod=30
Jun 15 07:19:59.920271 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:19:59.920233    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd" podUID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerName="tokenizer" containerID="cri-o://9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f" gracePeriod=30
Jun 15 07:20:00.797871 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:00.797838    2573 generic.go:356] "Generic (PLEG): container finished" podID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerID="b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237" exitCode=0
Jun 15 07:20:00.798097 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:00.797905    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd" event={"ID":"4eb4e4db-a081-4cd6-8c89-53dd9115c461","Type":"ContainerDied","Data":"b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237"}
Jun 15 07:20:01.087590 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.087562    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:20:01.245405 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.245374    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfzdq\" (UniqueName: \"kubernetes.io/projected/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kube-api-access-wfzdq\") pod \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") "
Jun 15 07:20:01.245405 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.245410    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-uds\") pod \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") "
Jun 15 07:20:01.245591 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.245450    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kserve-provision-location\") pod \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") "
Jun 15 07:20:01.245591 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.245510    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-cache\") pod \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") "
Jun 15 07:20:01.245675 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.245594    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-tmp\") pod \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") "
Jun 15 07:20:01.245675 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.245634    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tls-certs\") pod \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\" (UID: \"4eb4e4db-a081-4cd6-8c89-53dd9115c461\") "
Jun 15 07:20:01.245781 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.245715    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "4eb4e4db-a081-4cd6-8c89-53dd9115c461" (UID: "4eb4e4db-a081-4cd6-8c89-53dd9115c461"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:20:01.245884 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.245834    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "4eb4e4db-a081-4cd6-8c89-53dd9115c461" (UID: "4eb4e4db-a081-4cd6-8c89-53dd9115c461"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:20:01.245985 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.245959    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "4eb4e4db-a081-4cd6-8c89-53dd9115c461" (UID: "4eb4e4db-a081-4cd6-8c89-53dd9115c461"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:20:01.246041 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.245996    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-uds\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:20:01.246041 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.246015    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-cache\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:20:01.246277 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.246256    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "4eb4e4db-a081-4cd6-8c89-53dd9115c461" (UID: "4eb4e4db-a081-4cd6-8c89-53dd9115c461"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:20:01.247759 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.247736    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4eb4e4db-a081-4cd6-8c89-53dd9115c461" (UID: "4eb4e4db-a081-4cd6-8c89-53dd9115c461"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:20:01.247825 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.247783    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kube-api-access-wfzdq" (OuterVolumeSpecName: "kube-api-access-wfzdq") pod "4eb4e4db-a081-4cd6-8c89-53dd9115c461" (UID: "4eb4e4db-a081-4cd6-8c89-53dd9115c461"). InnerVolumeSpecName "kube-api-access-wfzdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:20:01.347414 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.347333    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tokenizer-tmp\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:20:01.347414 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.347359    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb4e4db-a081-4cd6-8c89-53dd9115c461-tls-certs\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:20:01.347414 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.347369    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfzdq\" (UniqueName: \"kubernetes.io/projected/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kube-api-access-wfzdq\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:20:01.347414 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.347379    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4eb4e4db-a081-4cd6-8c89-53dd9115c461-kserve-provision-location\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:20:01.804915 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.804884    2573 generic.go:356] "Generic (PLEG): container finished" podID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerID="9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f" exitCode=0
Jun 15 07:20:01.805131 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.804988    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"
Jun 15 07:20:01.805131 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.805009    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd" event={"ID":"4eb4e4db-a081-4cd6-8c89-53dd9115c461","Type":"ContainerDied","Data":"9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f"}
Jun 15 07:20:01.805131 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.805107    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd" event={"ID":"4eb4e4db-a081-4cd6-8c89-53dd9115c461","Type":"ContainerDied","Data":"fbe7ff4f410aaba50e82f0496ef815b301af83f7f7216fdd3c91d01e72765ab4"}
Jun 15 07:20:01.805131 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.805120    2573 scope.go:117] "RemoveContainer" containerID="9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f"
Jun 15 07:20:01.816021 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.816007    2573 scope.go:117] "RemoveContainer" containerID="b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237"
Jun 15 07:20:01.825821 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.825804    2573 scope.go:117] "RemoveContainer" containerID="1b9643c4c83fe6cc6d24244d23e3667816301673e1e4a7aefa6ccebbf9276a07"
Jun 15 07:20:01.834700 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.834671    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"]
Jun 15 07:20:01.835224 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.835203    2573 scope.go:117] "RemoveContainer" containerID="9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f"
Jun 15 07:20:01.835597 ip-10-0-141-25 kubenswrapper[2573]: E0615 07:20:01.835568    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f\": container with ID starting with 9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f not found: ID does not exist" containerID="9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f"
Jun 15 07:20:01.836228 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.835600    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f"} err="failed to get container status \"9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f\": rpc error: code = NotFound desc = could not find container \"9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f\": container with ID starting with 9b4e46e888e306053852be941d292850e8945b96795f28e64999b9d6745ec00f not found: ID does not exist"
Jun 15 07:20:01.836228 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.835627    2573 scope.go:117] "RemoveContainer" containerID="b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237"
Jun 15 07:20:01.836938 ip-10-0-141-25 kubenswrapper[2573]: E0615 07:20:01.836911    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237\": container with ID starting with b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237 not found: ID does not exist" containerID="b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237"
Jun 15 07:20:01.837037 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.836942    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237"} err="failed to get container status \"b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237\": rpc error: code = NotFound desc = could not find container \"b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237\": container with ID starting with b6bd14f400eca8f580396ec7f6da104e4e0aefff5e32c5998502750899e64237 not found: ID does not exist"
Jun 15 07:20:01.837037 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.836963    2573 scope.go:117] "RemoveContainer" containerID="1b9643c4c83fe6cc6d24244d23e3667816301673e1e4a7aefa6ccebbf9276a07"
Jun 15 07:20:01.837289 ip-10-0-141-25 kubenswrapper[2573]: E0615 07:20:01.837257    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b9643c4c83fe6cc6d24244d23e3667816301673e1e4a7aefa6ccebbf9276a07\": container with ID starting with 1b9643c4c83fe6cc6d24244d23e3667816301673e1e4a7aefa6ccebbf9276a07 not found: ID does not exist" containerID="1b9643c4c83fe6cc6d24244d23e3667816301673e1e4a7aefa6ccebbf9276a07"
Jun 15 07:20:01.837348 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.837297    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9643c4c83fe6cc6d24244d23e3667816301673e1e4a7aefa6ccebbf9276a07"} err="failed to get container status \"1b9643c4c83fe6cc6d24244d23e3667816301673e1e4a7aefa6ccebbf9276a07\": rpc error: code = NotFound desc = could not find container \"1b9643c4c83fe6cc6d24244d23e3667816301673e1e4a7aefa6ccebbf9276a07\": container with ID starting with 1b9643c4c83fe6cc6d24244d23e3667816301673e1e4a7aefa6ccebbf9276a07 not found: ID does not exist"
Jun 15 07:20:01.838780 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:01.838761    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd"]
Jun 15 07:20:02.337011 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:20:02.336980    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" path="/var/lib/kubelet/pods/4eb4e4db-a081-4cd6-8c89-53dd9115c461/volumes"
Jun 15 07:21:20.757845 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.757765    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"]
Jun 15 07:21:20.758265 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.758196    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerName="tokenizer"
Jun 15 07:21:20.758265 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.758209    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerName="tokenizer"
Jun 15 07:21:20.758265 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.758223    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerName="storage-initializer"
Jun 15 07:21:20.758265 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.758229    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerName="storage-initializer"
Jun 15 07:21:20.758265 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.758246    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerName="main"
Jun 15 07:21:20.758265 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.758252    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerName="main"
Jun 15 07:21:20.758463 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.758316    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerName="main"
Jun 15 07:21:20.758463 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.758325    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb4e4db-a081-4cd6-8c89-53dd9115c461" containerName="tokenizer"
Jun 15 07:21:20.761334 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.761318    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.764482 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.764460    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-configmap-ref-test-epp-sa-dockercfg-njmn5\""
Jun 15 07:21:20.765027 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.765011    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
Jun 15 07:21:20.773649 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.773621    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"]
Jun 15 07:21:20.859176 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.859144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hth7z\" (UniqueName: \"kubernetes.io/projected/6768577f-9b48-4ecc-ad92-f35902cd205a-kube-api-access-hth7z\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.859176 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.859176    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-cache\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.859420 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.859257    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6768577f-9b48-4ecc-ad92-f35902cd205a-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.859420 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.859280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-tmp\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.859420 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.859392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-uds\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.960473 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.960439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6768577f-9b48-4ecc-ad92-f35902cd205a-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.960473 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.960481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-tmp\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.960738 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.960529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-uds\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.960738 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.960559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hth7z\" (UniqueName: \"kubernetes.io/projected/6768577f-9b48-4ecc-ad92-f35902cd205a-kube-api-access-hth7z\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.960738 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.960586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-cache\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.961054 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.961027    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-cache\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.961054 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.961040    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-tmp\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.961248 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.961108    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-uds\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.963200 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.963176    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6768577f-9b48-4ecc-ad92-f35902cd205a-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:20.971427 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:20.971403    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hth7z\" (UniqueName: \"kubernetes.io/projected/6768577f-9b48-4ecc-ad92-f35902cd205a-kube-api-access-hth7z\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:21.071364 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:21.071277    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:21.258343 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:21.258309    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"]
Jun 15 07:21:21.261466 ip-10-0-141-25 kubenswrapper[2573]: W0615 07:21:21.261425    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6768577f_9b48_4ecc_ad92_f35902cd205a.slice/crio-feb010e1f844dc78e63b0192ebbf19995b18d2e56e13dd5d91756dba0853218c WatchSource:0}: Error finding container feb010e1f844dc78e63b0192ebbf19995b18d2e56e13dd5d91756dba0853218c: Status 404 returned error can't find the container with id feb010e1f844dc78e63b0192ebbf19995b18d2e56e13dd5d91756dba0853218c
Jun 15 07:21:22.237060 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:22.237026    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj" event={"ID":"6768577f-9b48-4ecc-ad92-f35902cd205a","Type":"ContainerStarted","Data":"6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee"}
Jun 15 07:21:22.237549 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:22.237105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj" event={"ID":"6768577f-9b48-4ecc-ad92-f35902cd205a","Type":"ContainerStarted","Data":"c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e"}
Jun 15 07:21:22.237549 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:22.237131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj" event={"ID":"6768577f-9b48-4ecc-ad92-f35902cd205a","Type":"ContainerStarted","Data":"feb010e1f844dc78e63b0192ebbf19995b18d2e56e13dd5d91756dba0853218c"}
Jun 15 07:21:22.237549 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:22.237150    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:22.263392 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:22.263330    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj" podStartSLOduration=2.263310301 podStartE2EDuration="2.263310301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:21:22.259798857 +0000 UTC m=+5562.393972107" watchObservedRunningTime="2026-06-15 07:21:22.263310301 +0000 UTC m=+5562.397483553"
Jun 15 07:21:31.072119 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:31.072060    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:31.072591 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:31.072165    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:31.074757 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:31.074736    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:31.289832 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:31.289794    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:52.303044 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:52.303016    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:53.495150 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:53.495117    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"]
Jun 15 07:21:53.495662 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:53.495382    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj" podUID="6768577f-9b48-4ecc-ad92-f35902cd205a" containerName="main" containerID="cri-o://c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e" gracePeriod=30
Jun 15 07:21:53.495662 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:53.495459    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj" podUID="6768577f-9b48-4ecc-ad92-f35902cd205a" containerName="tokenizer" containerID="cri-o://6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee" gracePeriod=30
Jun 15 07:21:54.420257 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.420224    2573 generic.go:356] "Generic (PLEG): container finished" podID="6768577f-9b48-4ecc-ad92-f35902cd205a" containerID="c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e" exitCode=0
Jun 15 07:21:54.420439 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.420298    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj" event={"ID":"6768577f-9b48-4ecc-ad92-f35902cd205a","Type":"ContainerDied","Data":"c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e"}
Jun 15 07:21:54.747149 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.747123    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:54.890637 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.890601    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hth7z\" (UniqueName: \"kubernetes.io/projected/6768577f-9b48-4ecc-ad92-f35902cd205a-kube-api-access-hth7z\") pod \"6768577f-9b48-4ecc-ad92-f35902cd205a\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") "
Jun 15 07:21:54.890637 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.890637    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-uds\") pod \"6768577f-9b48-4ecc-ad92-f35902cd205a\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") "
Jun 15 07:21:54.890904 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.890671    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-cache\") pod \"6768577f-9b48-4ecc-ad92-f35902cd205a\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") "
Jun 15 07:21:54.890904 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.890778    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6768577f-9b48-4ecc-ad92-f35902cd205a-tls-certs\") pod \"6768577f-9b48-4ecc-ad92-f35902cd205a\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") "
Jun 15 07:21:54.890904 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.890822    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-tmp\") pod \"6768577f-9b48-4ecc-ad92-f35902cd205a\" (UID: \"6768577f-9b48-4ecc-ad92-f35902cd205a\") "
Jun 15 07:21:54.891074 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.890901    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "6768577f-9b48-4ecc-ad92-f35902cd205a" (UID: "6768577f-9b48-4ecc-ad92-f35902cd205a"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:21:54.891074 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.890947    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "6768577f-9b48-4ecc-ad92-f35902cd205a" (UID: "6768577f-9b48-4ecc-ad92-f35902cd205a"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:21:54.891187 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.891164    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "6768577f-9b48-4ecc-ad92-f35902cd205a" (UID: "6768577f-9b48-4ecc-ad92-f35902cd205a"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:21:54.891227 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.891214    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-uds\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:21:54.891266 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.891229    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-cache\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:21:54.892981 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.892960    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6768577f-9b48-4ecc-ad92-f35902cd205a-kube-api-access-hth7z" (OuterVolumeSpecName: "kube-api-access-hth7z") pod "6768577f-9b48-4ecc-ad92-f35902cd205a" (UID: "6768577f-9b48-4ecc-ad92-f35902cd205a"). InnerVolumeSpecName "kube-api-access-hth7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:21:54.893058 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.893028    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6768577f-9b48-4ecc-ad92-f35902cd205a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6768577f-9b48-4ecc-ad92-f35902cd205a" (UID: "6768577f-9b48-4ecc-ad92-f35902cd205a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:21:54.992465 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.992382    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hth7z\" (UniqueName: \"kubernetes.io/projected/6768577f-9b48-4ecc-ad92-f35902cd205a-kube-api-access-hth7z\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:21:54.992465 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.992411    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6768577f-9b48-4ecc-ad92-f35902cd205a-tls-certs\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:21:54.992465 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:54.992422    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6768577f-9b48-4ecc-ad92-f35902cd205a-tokenizer-tmp\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:21:55.427864 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.427833    2573 generic.go:356] "Generic (PLEG): container finished" podID="6768577f-9b48-4ecc-ad92-f35902cd205a" containerID="6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee" exitCode=0
Jun 15 07:21:55.428025 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.427876    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"
Jun 15 07:21:55.428025 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.427908    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj" event={"ID":"6768577f-9b48-4ecc-ad92-f35902cd205a","Type":"ContainerDied","Data":"6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee"}
Jun 15 07:21:55.428025 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.427959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj" event={"ID":"6768577f-9b48-4ecc-ad92-f35902cd205a","Type":"ContainerDied","Data":"feb010e1f844dc78e63b0192ebbf19995b18d2e56e13dd5d91756dba0853218c"}
Jun 15 07:21:55.428025 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.427982    2573 scope.go:117] "RemoveContainer" containerID="6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee"
Jun 15 07:21:55.438217 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.438200    2573 scope.go:117] "RemoveContainer" containerID="c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e"
Jun 15 07:21:55.446511 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.446496    2573 scope.go:117] "RemoveContainer" containerID="6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee"
Jun 15 07:21:55.446757 ip-10-0-141-25 kubenswrapper[2573]: E0615 07:21:55.446738    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee\": container with ID starting with 6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee not found: ID does not exist" containerID="6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee"
Jun 15 07:21:55.446846 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.446760    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee"} err="failed to get container status \"6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee\": rpc error: code = NotFound desc = could not find container \"6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee\": container with ID starting with 6b44e32756c1658250ed2848aa3403f61bbf48323cdc388706cfccbff24fdaee not found: ID does not exist"
Jun 15 07:21:55.446846 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.446778    2573 scope.go:117] "RemoveContainer" containerID="c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e"
Jun 15 07:21:55.446971 ip-10-0-141-25 kubenswrapper[2573]: E0615 07:21:55.446956    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e\": container with ID starting with c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e not found: ID does not exist" containerID="c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e"
Jun 15 07:21:55.447009 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.446975    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e"} err="failed to get container status \"c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e\": rpc error: code = NotFound desc = could not find container \"c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e\": container with ID starting with c9264fc89f8e5f4962702dad72b995d3d6d057a2323e10eefa1ec2fc8814738e not found: ID does not exist"
Jun 15 07:21:55.450880 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.450854    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"]
Jun 15 07:21:55.455280 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:55.455260    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj"]
Jun 15 07:21:56.337679 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:21:56.337648    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6768577f-9b48-4ecc-ad92-f35902cd205a" path="/var/lib/kubelet/pods/6768577f-9b48-4ecc-ad92-f35902cd205a/volumes"
Jun 15 07:32:46.304340 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.304297    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"]
Jun 15 07:32:46.308507 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.308462    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv" podUID="8f596b9f-5a78-4580-8e9c-f3ca752ba88e" containerName="manager" containerID="cri-o://070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687" gracePeriod=30
Jun 15 07:32:46.590873 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.590848    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 07:32:46.668821 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.668796    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-cert\") pod \"8f596b9f-5a78-4580-8e9c-f3ca752ba88e\" (UID: \"8f596b9f-5a78-4580-8e9c-f3ca752ba88e\") "
Jun 15 07:32:46.668988 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.668906    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7dkn\" (UniqueName: \"kubernetes.io/projected/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-kube-api-access-h7dkn\") pod \"8f596b9f-5a78-4580-8e9c-f3ca752ba88e\" (UID: \"8f596b9f-5a78-4580-8e9c-f3ca752ba88e\") "
Jun 15 07:32:46.671013 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.670978    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-cert" (OuterVolumeSpecName: "cert") pod "8f596b9f-5a78-4580-8e9c-f3ca752ba88e" (UID: "8f596b9f-5a78-4580-8e9c-f3ca752ba88e"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:32:46.671145 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.671030    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-kube-api-access-h7dkn" (OuterVolumeSpecName: "kube-api-access-h7dkn") pod "8f596b9f-5a78-4580-8e9c-f3ca752ba88e" (UID: "8f596b9f-5a78-4580-8e9c-f3ca752ba88e"). InnerVolumeSpecName "kube-api-access-h7dkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:32:46.770135 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.770100    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7dkn\" (UniqueName: \"kubernetes.io/projected/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-kube-api-access-h7dkn\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:32:46.770135 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.770129    2573 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f596b9f-5a78-4580-8e9c-f3ca752ba88e-cert\") on node \"ip-10-0-141-25.ec2.internal\" DevicePath \"\""
Jun 15 07:32:46.837183 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.837108    2573 generic.go:356] "Generic (PLEG): container finished" podID="8f596b9f-5a78-4580-8e9c-f3ca752ba88e" containerID="070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687" exitCode=0
Jun 15 07:32:46.837183 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.837153    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"
Jun 15 07:32:46.837183 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.837160    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv" event={"ID":"8f596b9f-5a78-4580-8e9c-f3ca752ba88e","Type":"ContainerDied","Data":"070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687"}
Jun 15 07:32:46.837420 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.837209    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-58d9dd6777-f4fnv" event={"ID":"8f596b9f-5a78-4580-8e9c-f3ca752ba88e","Type":"ContainerDied","Data":"06a58efe0cf390175f4b121f23944f4b2b1e0d47b386ffb81ee3bebcb44622ed"}
Jun 15 07:32:46.837420 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.837232    2573 scope.go:117] "RemoveContainer" containerID="070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687"
Jun 15 07:32:46.848217 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.848198    2573 scope.go:117] "RemoveContainer" containerID="070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687"
Jun 15 07:32:46.848471 ip-10-0-141-25 kubenswrapper[2573]: E0615 07:32:46.848449    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687\": container with ID starting with 070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687 not found: ID does not exist" containerID="070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687"
Jun 15 07:32:46.848508 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.848480    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687"} err="failed to get container status \"070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687\": rpc error: code = NotFound desc = could not find container \"070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687\": container with ID starting with 070287c30a98a51d764344ab7f70ba911cc45986e347165e7d533691c2afc687 not found: ID does not exist"
Jun 15 07:32:46.865536 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.865509    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"]
Jun 15 07:32:46.868693 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:46.868674    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/llmisvc-controller-manager-58d9dd6777-f4fnv"]
Jun 15 07:32:48.338234 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:32:48.338195    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f596b9f-5a78-4580-8e9c-f3ca752ba88e" path="/var/lib/kubelet/pods/8f596b9f-5a78-4580-8e9c-f3ca752ba88e/volumes"
Jun 15 07:33:53.917156 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:53.917122    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:33:54.125154 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.125118    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:33:54.158652 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.158628    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:33:54.174369 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.174307    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:33:54.268820 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.268790    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:33:54.291432 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.291411    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:33:54.304469 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.304450    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:33:54.375730 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.375704    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:33:54.403470 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.403450    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:33:54.415659 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.415643    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:33:54.447570 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.447513    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:33:54.593305 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.593275    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:33:54.615973 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.615950    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:33:54.626548 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:54.626530    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:33:56.273786 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.273758    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:33:56.387312 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.387275    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:33:56.412156 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.412130    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:33:56.422365 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.422342    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:33:56.482102 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.482066    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:33:56.500150 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.500121    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:33:56.507311 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.507292    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:33:56.558079 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.557996    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:33:56.586249 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.586230    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:33:56.599351 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.599334    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:33:56.630893 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.630869    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:33:56.798829 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.798803    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:33:56.821994 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.821909    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:33:56.830448 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:56.830427    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:33:58.486146 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:58.486103    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:33:58.621376 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:58.621344    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:33:58.644671 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:58.644650    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:33:58.657474 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:58.657451    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:33:58.726310 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:58.726284    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:33:58.748438 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:58.748375    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:33:58.756950 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:58.756929    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:33:58.809709 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:58.809690    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:33:58.836628 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:58.836601    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:33:58.849689 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:58.849657    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:33:58.888407 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:58.888382    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:33:59.057670 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:59.057580    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:33:59.083391 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:59.083357    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:33:59.093498 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:33:59.093477    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:00.807296 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:00.807265    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:00.916725 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:00.916675    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:00.939167 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:00.939135    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:00.946638 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:00.946616    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:00.996888 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:00.996863    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:01.017038 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:01.017019    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:01.031748 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:01.031716    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:01.086201 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:01.086135    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:01.114652 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:01.114633    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:01.126680 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:01.126656    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:01.162914 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:01.162876    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:01.309710 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:01.309683    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:01.335751 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:01.335720    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:01.345928 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:01.345841    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:02.983161 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:02.983131    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:03.097696 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.097669    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:03.122497 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.122458    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:03.130244 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.130205    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:03.186303 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.186274    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:03.207891 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.207862    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:03.214897 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.214858    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:03.262764 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.262680    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:03.290280 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.290243    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:03.303188 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.303168    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:03.342181 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.342148    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:03.480475 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.480445    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:03.510910 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.510876    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:03.527634 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:03.527552    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:05.400631 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.400596    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:05.526617 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.526589    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:05.559596 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.559563    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:05.568590 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.568567    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:05.634694 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.634661    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:05.657336 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.657255    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:05.665050 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.665023    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:05.715004 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.714972    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:05.745228 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.745198    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:05.760066 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.760040    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:05.793730 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.793709    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:05.938312 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.938282    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:05.960179 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.960156    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:05.968394 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:05.968368    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:07.767390 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:07.767353    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:07.908579 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:07.908528    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:07.935369 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:07.935342    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:07.945027 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:07.945003    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:08.011256 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:08.011229    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:08.035951 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:08.035869    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:08.046580 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:08.046548    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:08.136750 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:08.136716    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:08.172737 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:08.172713    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:08.199484 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:08.199459    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:08.233244 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:08.233221    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:08.376966 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:08.376876    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:08.400158 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:08.400127    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:08.408463 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:08.408443    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:10.038182 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.038144    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:10.145647 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.145599    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:10.169766 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.169714    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:10.178267 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.178246    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:10.247285 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.247265    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:10.267397 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.267377    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:10.274571 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.274552    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:10.324521 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.324451    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:10.355316 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.355295    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:10.369140 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.369107    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:10.405236 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.405212    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:10.539186 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.539163    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:10.566729 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.566708    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:10.574970 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:10.574918    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:12.247018 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.246985    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:12.392800 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.392772    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:12.419125 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.419098    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:12.426687 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.426643    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:12.485126 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.485097    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:12.504839 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.504771    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:12.511501 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.511478    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:12.567317 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.567298    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:12.596709 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.596684    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:12.610113 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.610072    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:12.646223 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.646189    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:12.796312 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.796235    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:12.818498 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.818452    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:12.827639 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:12.827605    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:14.493196 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:14.493161    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:14.618100 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:14.618055    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:14.650355 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:14.650331    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:14.667801 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:14.667778    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:14.730471 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:14.730450    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:14.757571 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:14.757490    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:14.768850 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:14.768828    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:14.836169 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:14.836137    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:14.868055 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:14.868037    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:14.887792 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:14.887770    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:14.925811 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:14.925782    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:15.079326 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:15.079236    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:15.103104 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:15.103035    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:15.112991 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:15.112963    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:16.755963 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:16.755934    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:16.899901 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:16.899859    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:16.929824 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:16.929801    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:16.965241 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:16.965213    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:17.082495 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:17.082398    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:17.144030 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:17.144000    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:17.168520 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:17.168491    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:17.286642 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:17.286612    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:17.348459 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:17.348370    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:17.374260 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:17.374237    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:17.436009 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:17.435982    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:17.624099 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:17.624009    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:17.657909 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:17.657883    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:17.666277 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:17.666252    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:19.311333 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.311300    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:19.415841 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.415816    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:19.440044 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.440014    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:19.447629 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.447607    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:19.501491 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.501470    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:19.524388 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.524366    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:19.532612 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.532592    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:19.582485 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.582418    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:19.609413 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.609391    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:19.627490 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.627468    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:19.660813 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.660793    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:19.802958 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.802931    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:19.826742 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.826720    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:19.836612 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:19.836556    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:21.582339 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:21.582315    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:21.704929 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:21.704899    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:21.732483 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:21.732458    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:21.750185 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:21.750165    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:21.816546 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:21.816523    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:21.840932 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:21.840862    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:21.847868 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:21.847842    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:21.899437 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:21.899414    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:21.929185 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:21.929164    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:21.946158 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:21.946141    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:21.980210 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:21.980190    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:22.114381 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:22.114301    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:22.136494 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:22.136462    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:22.148003 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:22.147980    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:23.788963 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:23.788924    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:23.910499 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:23.910472    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:23.935141 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:23.935114    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:23.946685 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:23.946664    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:24.019703 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:24.019678    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:24.047854 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:24.047792    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:24.060108 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:24.060068    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:24.113760 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:24.113648    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:24.141904 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:24.141881    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:24.158517 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:24.158497    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:24.194343 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:24.194319    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:24.429182 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:24.429156    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:24.453356 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:24.453334    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:24.465180 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:24.464687    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:27.009696 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:27.009663    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qbmcr_bd668c67-4e01-4178-be57-e43a17a4657d/discovery/0.log"
Jun 15 07:34:27.040957 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:27.040931    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/1.log"
Jun 15 07:34:27.094416 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:27.094382    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/2.log"
Jun 15 07:34:28.049171 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.049122    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:28.161797 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.161771    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:28.186754 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.186729    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:28.195745 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.195717    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:28.256861 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.256836    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:28.282685 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.282654    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:28.291129 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.291106    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:28.350975 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.350909    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:28.379759 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.379732    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:28.391696 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.391675    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:28.423916 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.423892    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:28.562329 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.562303    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:28.583425 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.583396    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:28.601429 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:28.601373    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:30.381880 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.381855    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:30.544762 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.544734    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:30.569322 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.569296    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:30.579026 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.578999    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:30.645243 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.645163    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:30.668540 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.668514    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:30.678825 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.678794    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:30.736408 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.736373    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:30.769015 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.768985    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:30.783231 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.783204    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:30.818324 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.818265    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:30.971604 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.971574    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:30.995223 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:30.995193    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:31.007384 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:31.007356    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:32.614290 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:32.614255    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:32.721568 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:32.721539    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:32.745670 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:32.745642    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:32.752676 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:32.752654    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:32.806137 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:32.806104    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:32.826618 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:32.826586    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:32.835060 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:32.835030    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:32.881414 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:32.881332    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:32.916004 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:32.915974    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:32.932558 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:32.932529    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:32.966502 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:32.966474    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:33.104102 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:33.104065    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:33.124566 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:33.124531    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:33.131274 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:33.131250    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:34.754631 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:34.754601    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:34.851858 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:34.851827    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:34.874845 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:34.874818    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:34.882469 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:34.882448    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:34.960775 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:34.960746    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:34.985011 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:34.984981    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:34.992976 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:34.992954    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:35.047390 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:35.047294    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:35.081938 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:35.081907    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:35.095287 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:35.095266    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:35.128912 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:35.128889    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:35.274762 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:35.274735    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:35.296598 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:35.296571    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:35.309828 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:35.309764    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:36.919684 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:36.919651    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:37.035730 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.035703    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:37.059125 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.059097    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:37.066707 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.066684    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:37.123296 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.123275    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:37.143740 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.143716    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:37.156994 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.156959    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:37.241874 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.241785    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:37.277531 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.277504    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:37.288994 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.288971    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:37.324537 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.324516    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:37.466509 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.466476    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:37.488437 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.488416    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:37.498675 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:37.498612    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:39.085988 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.085959    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_auth-enabled-test-kserve-85d86d876c-vrqhw_03be4983-7e0f-4763-b9f9-537fa20b4610/storage-initializer/0.log"
Jun 15 07:34:39.195109 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.195061    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/main/0.log"
Jun 15 07:34:39.218608 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.218577    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/tokenizer/0.log"
Jun 15 07:34:39.229063 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.229037    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw_d15a90cc-1bc7-4614-9bf0-26231da0604c/storage-initializer/0.log"
Jun 15 07:34:39.283097 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.283066    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/main/0.log"
Jun 15 07:34:39.303927 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.303910    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/tokenizer/0.log"
Jun 15 07:34:39.311158 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.311138    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz_d2addb78-1f4e-4983-8983-218180355838/storage-initializer/0.log"
Jun 15 07:34:39.368399 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.368311    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/main/0.log"
Jun 15 07:34:39.396007 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.395979    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk_8e1b69b4-ea1b-42c3-9cb9-591db3c02643/tokenizer/0.log"
Jun 15 07:34:39.409478 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.409460    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/main/0.log"
Jun 15 07:34:39.445114 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.445094    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj_1264e5f9-09ea-4712-8848-1be6c22009fa/tokenizer/0.log"
Jun 15 07:34:39.579097 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.579058    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/main/0.log"
Jun 15 07:34:39.600447 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.600426    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/tokenizer/0.log"
Jun 15 07:34:39.608072 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:39.608052    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b_bb6c90a3-f29e-457c-b4ff-2d9c233c7b18/storage-initializer/0.log"
Jun 15 07:34:42.078507 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:42.078472    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qbmcr_bd668c67-4e01-4178-be57-e43a17a4657d/discovery/0.log"
Jun 15 07:34:42.119002 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:42.118946    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/1.log"
Jun 15 07:34:42.179418 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:42.179384    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/2.log"
Jun 15 07:34:43.882604 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:43.882568    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qbmcr_bd668c67-4e01-4178-be57-e43a17a4657d/discovery/0.log"
Jun 15 07:34:43.924198 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:43.924160    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/1.log"
Jun 15 07:34:43.978932 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:43.978905    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/2.log"
Jun 15 07:34:45.780444 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:45.780405    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qbmcr_bd668c67-4e01-4178-be57-e43a17a4657d/discovery/0.log"
Jun 15 07:34:45.816345 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:45.816309    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/1.log"
Jun 15 07:34:45.869942 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:45.869922    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/2.log"
Jun 15 07:34:46.827117 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:46.827067    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:34:47.031605 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:47.031580    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:34:47.056347 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:47.056308    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:34:48.056198 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:48.056174    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:34:48.267662 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:48.267637    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:34:48.287868 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:48.287843    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:34:49.374230 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:49.374201    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:34:49.587483 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:49.587453    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:34:49.605368 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:49.605341    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:34:50.590653 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:50.590576    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:34:50.789001 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:50.788971    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:34:50.807442 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:50.807411    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:34:51.786133 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:51.786050    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:34:52.009824 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:52.009793    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:34:52.032241 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:52.032214    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:34:53.028189 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:53.028159    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:34:53.229012 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:53.228983    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:34:53.248211 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:53.248183    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:34:54.301577 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:54.301527    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:34:54.504451 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:54.504418    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:34:54.522143 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:54.522113    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:34:55.540612 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:55.540583    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:34:55.757575 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:55.757546    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:34:55.778605 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:55.778576    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:34:56.858268 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:56.858236    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:34:57.070425 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:57.070400    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:34:57.094660 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:57.094631    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:34:58.116260 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:58.116226    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:34:58.316803 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:58.316761    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:34:58.336057 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:58.336023    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:34:59.391961 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:59.391935    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:34:59.604131 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:59.604101    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:34:59.624733 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:34:59.624680    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:00.596411 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:00.596379    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:00.802696 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:00.802667    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:00.825206 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:00.825178    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:01.810832 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:01.810800    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:02.018892 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:02.018866    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:02.037738 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:02.037697    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:03.005405 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:03.005380    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:03.220787 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:03.220757    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:03.250753 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:03.250727    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:04.298543 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:04.298502    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:04.497360 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:04.497331    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:04.517244 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:04.517212    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:05.561742 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:05.561713    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:05.769489 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:05.769464    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:05.789100 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:05.789049    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:06.755517 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:06.755481    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:06.953986 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:06.953954    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:06.972503 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:06.972472    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:07.952553 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:07.952523    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:08.164552 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:08.164526    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:08.181591 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:08.181562    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:09.199501 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:09.199475    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:09.395949 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:09.395921    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:09.415747 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:09.415719    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:10.412910 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:10.412874    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:10.617314 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:10.617285    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:10.636541 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:10.636437    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:11.606691 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:11.606652    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:11.822283 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:11.822257    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:11.840445 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:11.840415    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:12.809854 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:12.809822    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:13.005102 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:13.005055    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:13.025223 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:13.025197    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:14.044463 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:14.044435    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:14.295835 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:14.295740    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:14.312341 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:14.312314    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:15.320658 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:15.320628    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:15.538241 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:15.538206    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:15.558910 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:15.558881    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:16.550561 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:16.550531    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:16.757788 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:16.757760    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:16.776251 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:16.776216    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:17.768877 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:17.768850    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:17.991476 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:17.991449    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:18.009509 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:18.009483    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:18.992247 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:18.992215    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:19.206128 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:19.206098    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:19.223949 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:19.223919    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:20.221530 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:20.221503    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:20.436036 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:20.436007    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:20.453977 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:20.453941    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:21.479793 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:21.479743    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:21.684319 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:21.684290    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:21.709702 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:21.709677    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:22.683795 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:22.683759    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:22.886289 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:22.886260    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:22.905246 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:22.905213    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:23.903447 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:23.903415    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:24.125124 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:24.125072    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:24.143514 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:24.143480    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:25.134883 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:25.134853    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:25.335276 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:25.335237    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:25.358146 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:25.358116    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:26.344977 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:26.344949    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:26.551955 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:26.551924    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:26.572877 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:26.572848    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:27.558439 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:27.558413    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:27.771391 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:27.771360    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:27.790450 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:27.790428    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:28.776196 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:28.776167    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:28.974819 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:28.974789    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:28.993997 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:28.993962    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:30.044421 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:30.044392    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:30.264337 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:30.264309    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:30.295299 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:30.295217    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:31.304894 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:31.304864    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:31.513614 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:31.513592    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:31.538661 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:31.538635    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:32.605499 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:32.605469    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:32.824341 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:32.824314    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:32.843469 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:32.843445    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:33.885362 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:33.885328    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:34.088957 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:34.088926    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:34.106812 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:34.106789    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:35.110719 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:35.110679    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:35.326535 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:35.326504    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:35.347208 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:35.347174    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:36.367627 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:36.367599    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:36.573397 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:36.573372    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:36.591984 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:36.591960    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:37.583924 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:37.583894    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:37.790199 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:37.790175    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:37.810939 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:37.810914    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:38.840291 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:38.840253    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:39.093207 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:39.093115    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:39.114687 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:39.114657    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:40.124876 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:40.124847    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:40.335184 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:40.335134    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:40.356413 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:40.356387    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:41.412558 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:41.412525    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:41.616732 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:41.616698    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:41.636814 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:41.636779    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:42.694912 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:42.694879    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:42.901206 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:42.901177    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:42.919834 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:42.919800    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:43.907949 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:43.907916    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:44.119803 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:44.119776    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:44.137251 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:44.137227    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:45.140109 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:45.140059    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:45.339721 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:45.339694    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:45.361357 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:45.361320    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:46.359717 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:46.359674    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:46.570685 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:46.570654    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:46.590408 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:46.590377    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:52.039523 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:52.039494    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rvr6v_6a65ec4b-de31-4506-937e-2c1bfdc83280/global-pull-secret-syncer/0.log"
Jun 15 07:35:52.160566 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:52.160538    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pt4g7_f0d67bc6-7933-45b9-85fd-e4428633f6b9/konnectivity-agent/0.log"
Jun 15 07:35:52.332000 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:52.331925    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-25.ec2.internal_3d5b178b73f320befed2c5f1e6de4004/haproxy/0.log"
Jun 15 07:35:55.473118 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:55.473075    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-8cd6g_4229277a-90a9-4198-9b7e-2909a3443e8c/sail-operator/0.log"
Jun 15 07:35:56.777402 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:56.777375    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d75c86569-cxdzr_d7702eb8-c68c-4f71-b444-704933993bed/manager/0.log"
Jun 15 07:35:57.057426 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:57.057346    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-qnf8x_ee0e0e76-378b-4fdf-9532-b20ff00fdbaf/limitador/0.log"
Jun 15 07:35:57.093401 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:57.093368    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-cgn2h_c11ebb87-dc2e-473b-8d76-7e645a23a065/manager/0.log"
Jun 15 07:35:58.951273 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:58.951230    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-cwbxl_67d2a45c-c745-4455-93a8-af6176c98b06/monitoring-plugin/0.log"
Jun 15 07:35:59.239495 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:59.239391    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t8h8g_d055b417-cb68-4566-9ab6-12ea2e5c6103/node-exporter/0.log"
Jun 15 07:35:59.275332 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:59.275304    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t8h8g_d055b417-cb68-4566-9ab6-12ea2e5c6103/kube-rbac-proxy/0.log"
Jun 15 07:35:59.317416 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:59.317387    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t8h8g_d055b417-cb68-4566-9ab6-12ea2e5c6103/init-textfile/0.log"
Jun 15 07:35:59.366949 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:59.366901    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-dwz9z_c553ea1e-df3e-4909-81d9-a436ee756df0/kube-rbac-proxy-main/0.log"
Jun 15 07:35:59.409399 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:59.409372    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-dwz9z_c553ea1e-df3e-4909-81d9-a436ee756df0/kube-rbac-proxy-self/0.log"
Jun 15 07:35:59.460249 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:35:59.460221    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-dwz9z_c553ea1e-df3e-4909-81d9-a436ee756df0/openshift-state-metrics/0.log"
Jun 15 07:36:00.089567 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:00.089484    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6545f694f6-ctq84_aaf30b3c-3b29-4fe8-ba40-5c2901447a74/telemeter-client/0.log"
Jun 15 07:36:00.155147 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:00.155114    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6545f694f6-ctq84_aaf30b3c-3b29-4fe8-ba40-5c2901447a74/reload/0.log"
Jun 15 07:36:00.205615 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:00.205589    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6545f694f6-ctq84_aaf30b3c-3b29-4fe8-ba40-5c2901447a74/kube-rbac-proxy/0.log"
Jun 15 07:36:00.252757 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:00.252705    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc75ff8df-4h5kr_bfe197c5-cfc0-4ba3-b269-8d2056fc720b/thanos-query/0.log"
Jun 15 07:36:00.298076 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:00.298044    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc75ff8df-4h5kr_bfe197c5-cfc0-4ba3-b269-8d2056fc720b/kube-rbac-proxy-web/0.log"
Jun 15 07:36:00.412155 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:00.412126    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc75ff8df-4h5kr_bfe197c5-cfc0-4ba3-b269-8d2056fc720b/kube-rbac-proxy/0.log"
Jun 15 07:36:00.525457 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:00.525428    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc75ff8df-4h5kr_bfe197c5-cfc0-4ba3-b269-8d2056fc720b/prom-label-proxy/0.log"
Jun 15 07:36:00.679157 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:00.679054    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc75ff8df-4h5kr_bfe197c5-cfc0-4ba3-b269-8d2056fc720b/kube-rbac-proxy-rules/0.log"
Jun 15 07:36:00.845257 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:00.845228    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc75ff8df-4h5kr_bfe197c5-cfc0-4ba3-b269-8d2056fc720b/kube-rbac-proxy-metrics/0.log"
Jun 15 07:36:02.449489 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.449454    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"]
Jun 15 07:36:02.450006 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.449987    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f596b9f-5a78-4580-8e9c-f3ca752ba88e" containerName="manager"
Jun 15 07:36:02.450111 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.450009    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f596b9f-5a78-4580-8e9c-f3ca752ba88e" containerName="manager"
Jun 15 07:36:02.450111 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.450038    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6768577f-9b48-4ecc-ad92-f35902cd205a" containerName="main"
Jun 15 07:36:02.450111 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.450047    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6768577f-9b48-4ecc-ad92-f35902cd205a" containerName="main"
Jun 15 07:36:02.450111 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.450066    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6768577f-9b48-4ecc-ad92-f35902cd205a" containerName="tokenizer"
Jun 15 07:36:02.450111 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.450074    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6768577f-9b48-4ecc-ad92-f35902cd205a" containerName="tokenizer"
Jun 15 07:36:02.450358 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.450206    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6768577f-9b48-4ecc-ad92-f35902cd205a" containerName="tokenizer"
Jun 15 07:36:02.450358 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.450220    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6768577f-9b48-4ecc-ad92-f35902cd205a" containerName="main"
Jun 15 07:36:02.450358 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.450234    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f596b9f-5a78-4580-8e9c-f3ca752ba88e" containerName="manager"
Jun 15 07:36:02.453479 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.453461    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.460830 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.460807    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d7tsl\"/\"kube-root-ca.crt\""
Jun 15 07:36:02.461451 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.461432    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d7tsl\"/\"openshift-service-ca.crt\""
Jun 15 07:36:02.461579 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.461449    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d7tsl\"/\"default-dockercfg-vgmh8\""
Jun 15 07:36:02.467147 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.467121    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"]
Jun 15 07:36:02.525564 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.525533    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-proc\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.525564 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.525566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zrqm\" (UniqueName: \"kubernetes.io/projected/df0cd840-ad0f-4737-b34d-cb2e15b3789b-kube-api-access-5zrqm\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.525797 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.525603    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-podres\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.525797 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.525689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-sys\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.525797 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.525722    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-lib-modules\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.626804 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.626763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-podres\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.627027 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.626851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-sys\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.627027 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.626882    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-lib-modules\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.627027 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.626933    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-podres\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.627027 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.626949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-proc\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.627027 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.626961    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-sys\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.627027 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.626978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zrqm\" (UniqueName: \"kubernetes.io/projected/df0cd840-ad0f-4737-b34d-cb2e15b3789b-kube-api-access-5zrqm\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.627027 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.626998    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-proc\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.627303 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.627076    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df0cd840-ad0f-4737-b34d-cb2e15b3789b-lib-modules\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.646273 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.646244    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zrqm\" (UniqueName: \"kubernetes.io/projected/df0cd840-ad0f-4737-b34d-cb2e15b3789b-kube-api-access-5zrqm\") pod \"perf-node-gather-daemonset-86hxx\" (UID: \"df0cd840-ad0f-4737-b34d-cb2e15b3789b\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.764103 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.763979    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:02.912311 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:02.912284    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"]
Jun 15 07:36:02.915118 ip-10-0-141-25 kubenswrapper[2573]: W0615 07:36:02.915052    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddf0cd840_ad0f_4737_b34d_cb2e15b3789b.slice/crio-da5b14135e7feb6c1019ba5a7028e0238cabbd4fb27a9d1feedfe20a51f82c55 WatchSource:0}: Error finding container da5b14135e7feb6c1019ba5a7028e0238cabbd4fb27a9d1feedfe20a51f82c55: Status 404 returned error can't find the container with id da5b14135e7feb6c1019ba5a7028e0238cabbd4fb27a9d1feedfe20a51f82c55
Jun 15 07:36:03.270092 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:03.270066    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6db995c7bf-t6hv2_f717a237-4dd9-47ab-b3f9-83e2d756b1b3/console/0.log"
Jun 15 07:36:03.345969 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:03.345937    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-nvblt_68e8bf12-3723-4bfe-b3eb-b4cc906ec673/download-server/0.log"
Jun 15 07:36:03.889207 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:03.889168    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx" event={"ID":"df0cd840-ad0f-4737-b34d-cb2e15b3789b","Type":"ContainerStarted","Data":"db62975dafc10f8495ee1d152acf36e706633ea5f5143e14b23ac2dcf05309f4"}
Jun 15 07:36:03.889616 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:03.889217    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx" event={"ID":"df0cd840-ad0f-4737-b34d-cb2e15b3789b","Type":"ContainerStarted","Data":"da5b14135e7feb6c1019ba5a7028e0238cabbd4fb27a9d1feedfe20a51f82c55"}
Jun 15 07:36:03.889616 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:03.889362    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:03.917056 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:03.917007    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx" podStartSLOduration=1.916991766 podStartE2EDuration="1.916991766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:36:03.915588901 +0000 UTC m=+6444.049762145" watchObservedRunningTime="2026-06-15 07:36:03.916991766 +0000 UTC m=+6444.051165054"
Jun 15 07:36:05.357621 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:05.357587    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tcnn8_cf41c355-b017-42b9-861a-0315d6a804ef/dns/0.log"
Jun 15 07:36:05.392908 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:05.392879    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tcnn8_cf41c355-b017-42b9-861a-0315d6a804ef/kube-rbac-proxy/0.log"
Jun 15 07:36:05.429854 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:05.429825    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6znm2_f488e8ed-c9e0-47ec-941f-5b3ae6b60398/dns-node-resolver/0.log"
Jun 15 07:36:06.185772 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:06.185739    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-749ffdbb68-qbnt2_caa637b4-927a-4d9b-995a-c5db1795fb86/registry/0.log"
Jun 15 07:36:06.320143 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:06.320112    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hw222_52653dba-0e0e-4625-a6ab-c4cd62794b05/node-ca/0.log"
Jun 15 07:36:08.383954 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:08.383912    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qbmcr_bd668c67-4e01-4178-be57-e43a17a4657d/discovery/0.log"
Jun 15 07:36:08.445754 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:08.445722    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/1.log"
Jun 15 07:36:08.508626 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:08.508594    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/2.log"
Jun 15 07:36:09.121487 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:09.121462    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8d8zh_0dfb688b-9b54-4fd2-a1be-4ba6627ec2ea/serve-healthcheck-canary/0.log"
Jun 15 07:36:09.904565 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:09.904540    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-86hxx"
Jun 15 07:36:09.933254 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:09.933227    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mrjn4_e3acebfb-e473-48bb-b1d9-3c6d02e69269/kube-rbac-proxy/0.log"
Jun 15 07:36:09.955051 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:09.955020    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mrjn4_e3acebfb-e473-48bb-b1d9-3c6d02e69269/exporter/0.log"
Jun 15 07:36:09.984145 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:09.984120    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mrjn4_e3acebfb-e473-48bb-b1d9-3c6d02e69269/extractor/0.log"
Jun 15 07:36:14.088621 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:14.088592    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-6c7654bd99-m8vkw_4ced559b-fcd7-405f-ae68-54de2269dc47/manager/0.log"
Jun 15 07:36:17.949211 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:17.949176    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qbmcr_bd668c67-4e01-4178-be57-e43a17a4657d/discovery/0.log"
Jun 15 07:36:17.979939 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:17.979910    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/1.log"
Jun 15 07:36:18.036192 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:18.036169    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/2.log"
Jun 15 07:36:19.982043 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:19.982006    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qbmcr_bd668c67-4e01-4178-be57-e43a17a4657d/discovery/0.log"
Jun 15 07:36:20.024561 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:20.024532    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/1.log"
Jun 15 07:36:20.083059 ip-10-0-141-25 kubenswrapper[2573]: I0615 07:36:20.083033    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd_80d602fe-af57-4796-94f6-2bfcac712cb4/istio-proxy/2.log"